2024-04-26T07:34:04.130 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T07:34:04.130 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_gsalomon@teuthology --archive /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619 --name gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi --verbose --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} -- /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/orig.config.yaml 2024-04-26T07:34:04.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T07:34:04.265 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619 branch: fix_error_message_flow description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: gsalomon@redhat.com first_in_suite: false job_id: '7674619' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: fix_error_message_flow ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 rgw: frontend: beast s3tests: force-branch: fix_non_handled_error_resonse git_remote: https://github.com/galsalomon66/ thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: fix_error_message_flow sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 owner: scheduled_gsalomon@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 8229 sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 sleep_before_teardown: 0 suite: rgw suite_branch: fix_error_message_flow suite_path: /home/teuthworker/src/github.com_galsalomon66_ceph_5bfac0af933f1833ec096c3048e2c80e20507e52/qa suite_relpath: qa suite_repo: https://github.com/galsalomon66/ceph suite_sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK2NDFCCrWKISak/JGe3xCYCgZBaXcSu0QQmjLnX2D9oV1t7gds1lvqbfwf43GgiFDsTlS2W8pAc4h3UwFLLLvU= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK7R2hOArHMu8L81fTESMeoNqqLkl1u5hxML9r8X5sDr2eaQJtktWSNXP5D09f4PvUyvKKYfKMprDDVSrgEaPao= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_07:23:10 tube: smithi user: gsalomon verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T07:34:04.265 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_galsalomon66_ceph_5bfac0af933f1833ec096c3048e2c80e20507e52/qa; will attempt to use it 2024-04-26T07:34:04.266 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_galsalomon66_ceph_5bfac0af933f1833ec096c3048e2c80e20507e52/qa/tasks 2024-04-26T07:34:04.266 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T07:34:04.267 INFO:teuthology.task.internal:Checking packages... 2024-04-26T07:34:04.293 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '5bfac0af933f1833ec096c3048e2c80e20507e52' 2024-04-26T07:34:04.293 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T07:34:04.293 INFO:teuthology.packaging:ref: None 2024-04-26T07:34:04.294 INFO:teuthology.packaging:tag: None 2024-04-26T07:34:04.294 INFO:teuthology.packaging:branch: fix_error_message_flow 2024-04-26T07:34:04.294 INFO:teuthology.packaging:sha1: 5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:34:04.294 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=fix_error_message_flow 2024-04-26T07:34:04.596 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:34:04.597 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T07:34:04.604 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T07:34:04.604 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T07:34:04.612 INFO:teuthology.task.internal:Saving configuration 2024-04-26T07:34:04.627 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T07:34:04.635 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T07:34:04.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 07:26:52.855850', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOmE5M819pODy+GxmbgMG63eD0TP2uqPJJTsK1h3G270'} 2024-04-26T07:34:04.754 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 07:26:52.857118', 'locked_by': 'scheduled_gsalomon@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINALLjho10T5ZFHigXTbq9zzadsBD4F+Yh1dbrnvejHT'} 2024-04-26T07:34:04.754 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T07:34:04.760 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-26T07:34:04.761 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-26T07:34:04.761 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T07:34:04.884 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f98d0a49280>, signals=[15]) 2024-04-26T07:34:04.885 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T07:34:04.892 INFO:teuthology.task.internal:Opening connections... 2024-04-26T07:34:04.892 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:34:04.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:34:04.996 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:34:04.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:34:05.110 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T07:34:05.117 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-04-26T07:34:05.123 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-04-26T07:34:05.123 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-04-26T07:34:05.169 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu" 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="22.04" 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=jammy 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T07:34:05.170 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=jammy 2024-04-26T07:34:05.171 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-04-26T07:34:05.205 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-04-26T07:34:05.211 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-04-26T07:34:05.211 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-26T07:34:05.258 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="22.04" 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=jammy 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T07:34:05.259 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=jammy 2024-04-26T07:34:05.260 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-26T07:34:05.288 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T07:34:05.299 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T07:34:05.313 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T07:34:05.313 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-04-26T07:34:05.316 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-04-26T07:34:05.320 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T07:34:05.329 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T07:34:05.330 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-04-26T07:34:05.364 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-04-26T07:34:05.382 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T07:34:05.462 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T07:34:05.481 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-26T07:34:05.481 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-26T07:34:05.481 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T07:34:05.482 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T07:34:05.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:34:05.487 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-04-26T07:34:05.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:34:05.488 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-26T07:34:05.535 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-56-generic 2024-04-26T07:34:05.536 INFO:teuthology.orchestra.run.smithi191.stdout:5.15.0-56-generic 2024-04-26T07:34:05.536 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.15.0-56-generic 2024-04-26T07:34:05.536 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2024-04-26T07:34:05.536 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.15.0-56-generic 2024-04-26T07:34:05.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get clean 2024-04-26T07:34:05.656 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-04-26T07:34:05.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-04-26T07:34:05.823 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T07:34:05.824 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T07:34:05.824 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T07:34:05.836 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T07:34:05.836 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T07:34:05.836 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T07:34:05.906 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T07:34:05.922 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T07:34:06.058 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T07:34:06.093 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T07:34:06.129 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T07:34:06.143 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T07:34:06.174 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T07:34:06.174 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T07:34:06.187 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T07:34:06.190 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T07:34:06.190 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T07:34:06.204 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T07:34:06.218 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T07:34:06.219 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T07:34:06.224 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T07:34:06.224 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T07:34:06.228 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T07:34:06.234 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T07:34:06.234 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T07:34:06.241 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T07:34:06.248 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T07:34:06.279 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T07:34:06.279 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T07:34:06.279 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T07:34:06.279 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T07:34:06.282 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T07:34:06.287 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T07:34:06.311 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T07:34:06.311 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T07:34:06.311 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T07:34:06.311 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T07:34:06.311 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T07:34:06.312 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T07:34:06.313 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T07:34:06.313 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T07:34:06.320 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T07:34:06.321 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T07:34:06.321 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T07:34:06.321 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T07:34:06.324 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T07:34:06.325 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T07:34:06.345 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T07:34:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T07:34:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T07:34:06.355 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T07:34:06.374 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T07:34:06.375 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T07:34:06.378 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T07:34:06.378 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T07:34:06.384 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T07:34:06.388 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T07:34:06.388 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T07:34:06.389 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T07:34:06.394 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T07:34:06.397 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T07:34:06.400 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T07:34:06.400 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T07:34:06.400 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T07:34:06.403 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T07:34:06.405 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T07:34:06.405 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T07:34:06.406 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T07:34:06.406 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T07:34:06.406 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T07:34:06.421 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T07:34:06.421 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T07:34:06.422 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T07:34:06.424 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T07:34:06.424 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T07:34:06.425 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T07:34:06.425 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T07:34:06.425 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T07:34:06.425 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T07:34:06.426 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T07:34:06.426 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T07:34:06.426 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T07:34:06.427 INFO:teuthology.orchestra.run.smithi191.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T07:34:06.444 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T07:34:06.444 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T07:34:06.445 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T07:34:06.445 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T07:34:06.445 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T07:34:11.938 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 13.2 MB in 2s (6,842 kB/s) 2024-04-26T07:34:12.280 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 13.2 MB in 2s (6,748 kB/s) 2024-04-26T07:34:13.373 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-26T07:34:13.389 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T07:34:13.445 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-26T07:34:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-26T07:34:13.625 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-26T07:34:13.700 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-04-26T07:34:13.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T07:34:13.779 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T07:34:13.779 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T07:34:13.779 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T07:34:13.779 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T07:34:13.779 INFO:teuthology.orchestra.run.smithi191.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T07:34:13.779 INFO:teuthology.orchestra.run.smithi191.stdout: python2.7-minimal 2024-04-26T07:34:13.779 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T07:34:13.781 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2024-04-26T07:34:13.781 INFO:teuthology.orchestra.run.smithi191.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T07:34:13.781 INFO:teuthology.orchestra.run.smithi191.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T07:34:13.781 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T07:34:13.782 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2024-04-26T07:34:13.782 INFO:teuthology.orchestra.run.smithi191.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T07:34:13.782 INFO:teuthology.orchestra.run.smithi191.stdout:Recommended packages: 2024-04-26T07:34:13.782 INFO:teuthology.orchestra.run.smithi191.stdout: thermald 2024-04-26T07:34:13.785 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-04-26T07:34:13.823 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-04-26T07:34:13.823 INFO:teuthology.orchestra.run.smithi191.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T07:34:13.823 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T07:34:13.823 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T07:34:13.824 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages will be upgraded: 2024-04-26T07:34:13.824 INFO:teuthology.orchestra.run.smithi191.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T07:34:13.990 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-04-26T07:34:13.991 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-04-26T07:34:14.003 INFO:teuthology.orchestra.run.smithi191.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T07:34:14.003 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 113 MB of archives. 2024-04-26T07:34:14.003 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T07:34:14.003 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T07:34:14.171 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T07:34:14.171 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T07:34:14.172 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T07:34:14.172 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T07:34:14.172 INFO:teuthology.orchestra.run.smithi053.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T07:34:14.172 INFO:teuthology.orchestra.run.smithi053.stdout: python2.7-minimal 2024-04-26T07:34:14.172 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T07:34:14.173 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2024-04-26T07:34:14.174 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T07:34:14.174 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T07:34:14.174 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T07:34:14.175 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2024-04-26T07:34:14.175 INFO:teuthology.orchestra.run.smithi053.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T07:34:14.175 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2024-04-26T07:34:14.176 INFO:teuthology.orchestra.run.smithi053.stdout: thermald 2024-04-26T07:34:14.221 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2024-04-26T07:34:14.221 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T07:34:14.221 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T07:34:14.221 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T07:34:14.222 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages will be upgraded: 2024-04-26T07:34:14.223 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T07:34:14.404 INFO:teuthology.orchestra.run.smithi053.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T07:34:14.404 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 113 MB of archives. 2024-04-26T07:34:14.404 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T07:34:14.404 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T07:34:15.436 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T07:34:15.771 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T07:34:17.927 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T07:34:17.927 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T07:34:17.927 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T07:34:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T07:34:18.533 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T07:34:18.941 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 113 MB in 5s (24.1 MB/s) 2024-04-26T07:34:19.164 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T07:34:21.254 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T07:34:21.259 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T07:34:21.352 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:23.952 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T07:34:23.973 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T07:34:24.062 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:24.523 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T07:34:24.543 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T07:34:24.589 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:31.235 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T07:34:31.359 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T07:34:31.693 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T07:34:31.814 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T07:34:32.093 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T07:34:32.115 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T07:34:32.159 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T07:34:38.161 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T07:34:38.199 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T07:34:38.236 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:40.981 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T07:34:41.649 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T07:34:42.366 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T07:34:42.487 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:42.614 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T07:34:42.764 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:44.103 INFO:teuthology.orchestra.run.smithi191.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T07:34:44.103 INFO:teuthology.orchestra.run.smithi191.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T07:34:44.103 INFO:teuthology.orchestra.run.smithi191.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T07:34:44.104 INFO:teuthology.orchestra.run.smithi191.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T07:34:44.270 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:45.997 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:47.831 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T07:34:47.957 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T07:34:48.100 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:34:48.157 INFO:teuthology.orchestra.run.smithi191.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T07:34:48.157 INFO:teuthology.orchestra.run.smithi191.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T07:35:02.301 INFO:teuthology.orchestra.run.smithi191.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T07:35:02.302 INFO:teuthology.orchestra.run.smithi191.stdout:Sourcing file `/etc/default/grub' 2024-04-26T07:35:02.320 INFO:teuthology.orchestra.run.smithi191.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T07:35:02.342 INFO:teuthology.orchestra.run.smithi191.stdout:Generating grub configuration file ... 2024-04-26T07:35:02.588 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T07:35:02.621 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T07:35:02.903 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T07:35:02.909 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T07:35:02.974 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T07:35:02.979 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T07:35:03.149 INFO:teuthology.orchestra.run.smithi191.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T07:35:03.149 INFO:teuthology.orchestra.run.smithi191.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T07:35:03.150 INFO:teuthology.orchestra.run.smithi191.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T07:35:03.193 INFO:teuthology.orchestra.run.smithi191.stdout:done 2024-04-26T07:35:03.656 DEBUG:teuthology.orchestra.run.smithi191:> dpkg -s linux-image-generic 2024-04-26T07:35:03.678 INFO:teuthology.orchestra.run.smithi191.stdout:Package: linux-image-generic 2024-04-26T07:35:03.678 INFO:teuthology.orchestra.run.smithi191.stdout:Status: install ok installed 2024-04-26T07:35:03.678 INFO:teuthology.orchestra.run.smithi191.stdout:Priority: optional 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Section: kernel 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Installed-Size: 21 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: amd64 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Source: linux-meta 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Version: 5.15.0.105.102 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Recommends: thermald 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout:Description: Generic Linux kernel image 2024-04-26T07:35:03.679 INFO:teuthology.orchestra.run.smithi191.stdout: This package will always depend on the latest generic kernel image 2024-04-26T07:35:03.680 INFO:teuthology.orchestra.run.smithi191.stdout: available. 2024-04-26T07:35:03.680 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T07:35:03.680 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T07:35:03.680 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T07:35:03.680 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-26T07:35:03.680 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T07:35:03.680 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get clean 2024-04-26T07:35:03.862 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-04-26T07:35:03.986 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T07:35:04.001 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T07:35:04.022 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T07:35:04.104 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T07:35:05.367 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-26T07:35:05.385 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T07:35:05.444 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-26T07:35:05.645 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-26T07:35:05.645 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-26T07:35:05.823 INFO:teuthology.orchestra.run.smithi191.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T07:35:05.823 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T07:35:05.823 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T07:35:05.823 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T07:35:05.823 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T07:35:05.823 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T07:35:05.824 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T07:35:05.824 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T07:35:05.861 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T07:35:05.864 DEBUG:teuthology.orchestra.run.smithi191:> dpkg -s linux-image-generic 2024-04-26T07:35:05.920 INFO:teuthology.orchestra.run.smithi191.stdout:Package: linux-image-generic 2024-04-26T07:35:05.920 INFO:teuthology.orchestra.run.smithi191.stdout:Status: install ok installed 2024-04-26T07:35:05.920 INFO:teuthology.orchestra.run.smithi191.stdout:Priority: optional 2024-04-26T07:35:05.920 INFO:teuthology.orchestra.run.smithi191.stdout:Section: kernel 2024-04-26T07:35:05.920 INFO:teuthology.orchestra.run.smithi191.stdout:Installed-Size: 21 2024-04-26T07:35:05.920 INFO:teuthology.orchestra.run.smithi191.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T07:35:05.920 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: amd64 2024-04-26T07:35:05.920 INFO:teuthology.orchestra.run.smithi191.stdout:Source: linux-meta 2024-04-26T07:35:05.921 INFO:teuthology.orchestra.run.smithi191.stdout:Version: 5.15.0.105.102 2024-04-26T07:35:05.921 INFO:teuthology.orchestra.run.smithi191.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T07:35:05.921 INFO:teuthology.orchestra.run.smithi191.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T07:35:05.921 INFO:teuthology.orchestra.run.smithi191.stdout:Recommends: thermald 2024-04-26T07:35:05.921 INFO:teuthology.orchestra.run.smithi191.stdout:Description: Generic Linux kernel image 2024-04-26T07:35:05.921 INFO:teuthology.orchestra.run.smithi191.stdout: This package will always depend on the latest generic kernel image 2024-04-26T07:35:05.921 INFO:teuthology.orchestra.run.smithi191.stdout: available. 2024-04-26T07:35:05.921 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-04-26T07:35:05.966 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.omEQZZHXll 2024-04-26T07:35:05.966 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub/grub.cfg /tmp/tmp.omEQZZHXll 2024-04-26T07:35:06.022 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.omEQZZHXll 2024-04-26T07:35:06.139 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.omEQZZHXll is 10KB 2024-04-26T07:35:06.153 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.omEQZZHXll 2024-04-26T07:35:06.159 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T07:35:06.213 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:35:06.213 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T07:35:06.213 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T07:35:06.286 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T07:35:06.286 DEBUG:teuthology.orchestra.run.smithi191:> sudo update-grub 2024-04-26T07:35:07.606 INFO:teuthology.orchestra.run.smithi191.stderr:Sourcing file `/etc/default/grub' 2024-04-26T07:35:07.608 INFO:teuthology.orchestra.run.smithi191.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T07:35:07.611 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2024-04-26T07:35:07.782 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T07:35:07.789 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T07:35:08.059 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T07:35:08.064 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T07:35:08.108 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T07:35:08.113 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T07:35:08.231 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T07:35:08.231 INFO:teuthology.orchestra.run.smithi191.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T07:35:08.231 INFO:teuthology.orchestra.run.smithi191.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T07:35:08.241 INFO:teuthology.orchestra.run.smithi191.stderr:done 2024-04-26T07:35:08.244 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2024-04-26T07:35:15.289 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T07:35:16.284 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T07:35:18.567 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T07:35:18.649 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T07:35:18.731 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T07:35:19.171 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T07:35:19.332 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T07:35:19.757 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 113 MB in 1min 5s (1,740 kB/s) 2024-04-26T07:35:19.957 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T07:35:21.955 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T07:35:21.959 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T07:35:22.063 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:24.482 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T07:35:24.503 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T07:35:24.604 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:25.077 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T07:35:25.098 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T07:35:25.127 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:32.041 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T07:35:32.157 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T07:35:32.482 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T07:35:32.610 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T07:35:32.947 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T07:35:32.969 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T07:35:33.013 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T07:35:38.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T07:35:38.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-26T07:35:38.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:35:38.978 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T07:35:39.016 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T07:35:39.078 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:41.820 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T07:35:41.971 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T07:35:42.322 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T07:35:42.467 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:42.585 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T07:35:42.713 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:44.096 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T07:35:44.097 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T07:35:44.097 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T07:35:44.097 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T07:35:44.267 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:45.710 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:47.136 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T07:35:47.287 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T07:35:47.405 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T07:35:47.468 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T07:35:47.469 INFO:teuthology.orchestra.run.smithi053.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T07:35:56.706 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-26T07:36:01.991 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T07:36:01.991 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub' 2024-04-26T07:36:02.013 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T07:36:02.033 INFO:teuthology.orchestra.run.smithi053.stdout:Generating grub configuration file ... 2024-04-26T07:36:02.302 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T07:36:02.328 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T07:36:02.668 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T07:36:02.674 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T07:36:02.740 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T07:36:02.745 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T07:36:02.918 INFO:teuthology.orchestra.run.smithi053.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T07:36:02.918 INFO:teuthology.orchestra.run.smithi053.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T07:36:02.918 INFO:teuthology.orchestra.run.smithi053.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T07:36:02.964 INFO:teuthology.orchestra.run.smithi053.stdout:done 2024-04-26T07:36:03.488 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2024-04-26T07:36:03.512 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2024-04-26T07:36:03.512 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2024-04-26T07:36:03.512 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2024-04-26T07:36:03.512 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2024-04-26T07:36:03.512 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 21 2024-04-26T07:36:03.512 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T07:36:03.512 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2024-04-26T07:36:03.513 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2024-04-26T07:36:03.513 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.105.102 2024-04-26T07:36:03.513 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T07:36:03.513 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T07:36:03.513 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2024-04-26T07:36:03.513 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2024-04-26T07:36:03.513 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2024-04-26T07:36:03.513 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2024-04-26T07:36:03.513 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T07:36:03.513 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T07:36:03.513 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T07:36:03.514 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T07:36:03.514 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T07:36:03.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2024-04-26T07:36:03.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-04-26T07:36:03.764 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T07:36:03.777 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T07:36:03.797 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T07:36:03.882 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T07:36:05.205 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-04-26T07:36:05.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T07:36:05.289 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-04-26T07:36:05.492 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-04-26T07:36:05.492 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-04-26T07:36:05.679 INFO:teuthology.orchestra.run.smithi053.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T07:36:05.679 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T07:36:05.679 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T07:36:05.679 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T07:36:05.679 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T07:36:05.680 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T07:36:05.680 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T07:36:05.680 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T07:36:05.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-26T07:36:05.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:36:05.736 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T07:36:05.737 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2024-04-26T07:36:05.749 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 21 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.105.102 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T07:36:05.750 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2024-04-26T07:36:05.751 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2024-04-26T07:36:05.751 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2024-04-26T07:36:05.751 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2024-04-26T07:36:05.751 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-04-26T07:36:05.796 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.7qN86J3aeB 2024-04-26T07:36:05.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub/grub.cfg /tmp/tmp.7qN86J3aeB 2024-04-26T07:36:05.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.7qN86J3aeB 2024-04-26T07:36:05.977 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.7qN86J3aeB is 10KB 2024-04-26T07:36:05.990 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.7qN86J3aeB 2024-04-26T07:36:05.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T07:36:06.050 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:36:06.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T07:36:06.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T07:36:06.149 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T07:36:06.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo update-grub 2024-04-26T07:36:07.412 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub' 2024-04-26T07:36:07.413 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T07:36:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-04-26T07:36:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T07:36:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T07:36:07.831 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T07:36:07.837 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T07:36:07.882 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T07:36:07.887 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T07:36:08.027 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T07:36:08.027 INFO:teuthology.orchestra.run.smithi053.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T07:36:08.027 INFO:teuthology.orchestra.run.smithi053.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T07:36:08.056 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-04-26T07:36:08.065 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-04-26T07:36:08.798 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-26T07:36:20.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-26T07:36:20.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:36:38.082 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T07:36:38.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-26T07:36:38.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:36:39.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-26T07:36:54.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-26T07:36:54.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:36:54.529 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-26T07:36:55.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-26T07:36:55.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-26T07:36:55.104 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-26T07:36:55.151 INFO:teuthology.orchestra.run.smithi191.stdout:5.15.0-105-generic 2024-04-26T07:36:55.151 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T07:36:55.151 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T07:36:55.152 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T07:36:56.152 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T07:36:56.153 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T07:36:56.216 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2024-04-26T07:36:56.245 DEBUG:teuthology.parallel:result is None 2024-04-26T07:36:56.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-26T07:37:05.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-26T07:37:05.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:37:23.998 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-26T07:37:35.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-26T07:37:36.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:37:38.584 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-26T07:37:53.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-26T07:37:53.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:37:53.826 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-04-26T07:37:54.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-26T07:37:54.486 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-26T07:37:54.486 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-04-26T07:37:54.534 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-105-generic 2024-04-26T07:37:54.535 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T07:37:54.535 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T07:37:54.535 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T07:37:55.535 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T07:37:55.536 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T07:37:55.608 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-04-26T07:37:55.627 DEBUG:teuthology.parallel:result is None 2024-04-26T07:37:55.628 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T07:37:55.640 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T07:37:55.641 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T07:37:55.643 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T07:37:55.650 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T07:37:55.705 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T07:37:55.713 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T07:37:55.714 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T07:37:55.716 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T07:37:55.740 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T07:37:55.746 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T07:37:55.746 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T07:37:55.771 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T07:37:55.786 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:37:55.794 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:37:55.801 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:37:55.809 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T07:37:55.811 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T07:37:55.819 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T07:37:55.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T07:37:55.839 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T07:37:55.867 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T07:37:55.876 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T07:37:55.877 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T07:37:55.895 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T07:37:55.915 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:37:55.946 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:37:55.994 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:37:55.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T07:37:56.087 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T07:37:56.093 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T07:37:56.139 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:37:56.140 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T07:37:56.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-04-26T07:37:56.200 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-04-26T07:37:56.269 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T07:37:56.277 INFO:teuthology.task.internal:Starting timer... 2024-04-26T07:37:56.277 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T07:37:56.287 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T07:37:56.295 DEBUG:teuthology.task.selinux:Excluding smithi053: OS 'ubuntu' does not support SELinux 2024-04-26T07:37:56.295 DEBUG:teuthology.task.selinux:Excluding smithi191: OS 'ubuntu' does not support SELinux 2024-04-26T07:37:56.295 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T07:37:56.295 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T07:37:56.295 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T07:37:56.296 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T07:37:56.304 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T07:37:56.334 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T07:37:56.336 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T07:45:14.735 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-04-26T07:45:14.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-26T07:45:14.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:45:14.842 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-04-26T07:45:14.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-26T07:45:14.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-26T07:45:14.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T07:45:15.001 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-26T07:45:15.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-26T07:45:15.083 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T07:45:15.093 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T07:45:15.093 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T07:45:15.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:45:15.096 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T07:45:15.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:45:15.122 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T07:45:15.122 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Command line: ntpd -gq 2024-04-26T07:45:15.122 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: ---------------------------------------------------- 2024-04-26T07:45:15.122 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T07:45:15.122 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T07:45:15.122 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: corporation. Support and training for ntp-4 are 2024-04-26T07:45:15.123 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: available at https://www.nwtime.org/support 2024-04-26T07:45:15.123 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: ---------------------------------------------------- 2024-04-26T07:45:15.123 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: proto: precision = 0.046 usec (-24) 2024-04-26T07:45:15.124 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: basedate set to 2022-02-04 2024-04-26T07:45:15.124 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: gps base set to 2022-02-06 (week 2196) 2024-04-26T07:45:15.124 INFO:teuthology.orchestra.run.smithi053.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T07:45:15.124 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T07:45:15.124 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T07:45:15.125 INFO:teuthology.orchestra.run.smithi053.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T07:45:15.126 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T07:45:15.126 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T07:45:15.126 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T07:45:15.126 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Listen normally on 3 ens1f0 172.21.15.53:123 2024-04-26T07:45:15.126 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Listen normally on 4 lo [::1]:123 2024-04-26T07:45:15.126 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:3718%2]:123 2024-04-26T07:45:15.126 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:15 ntpd[17125]: Listening on routing socket on fd #22 for interface updates 2024-04-26T07:45:15.148 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T07:45:15.148 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Command line: ntpd -gq 2024-04-26T07:45:15.148 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: ---------------------------------------------------- 2024-04-26T07:45:15.148 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T07:45:15.148 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T07:45:15.148 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: corporation. Support and training for ntp-4 are 2024-04-26T07:45:15.148 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: available at https://www.nwtime.org/support 2024-04-26T07:45:15.148 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: ---------------------------------------------------- 2024-04-26T07:45:15.149 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: proto: precision = 0.043 usec (-24) 2024-04-26T07:45:15.149 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: basedate set to 2022-02-04 2024-04-26T07:45:15.149 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: gps base set to 2022-02-06 (week 2196) 2024-04-26T07:45:15.149 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T07:45:15.149 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T07:45:15.150 INFO:teuthology.orchestra.run.smithi191.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T07:45:15.150 INFO:teuthology.orchestra.run.smithi191.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T07:45:15.151 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T07:45:15.151 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T07:45:15.151 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T07:45:15.151 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Listen normally on 3 enp3s0f1 172.21.15.191:123 2024-04-26T07:45:15.151 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Listen normally on 4 lo [::1]:123 2024-04-26T07:45:15.151 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7211%5]:123 2024-04-26T07:45:15.151 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:15 ntpd[17232]: Listening on routing socket on fd #22 for interface updates 2024-04-26T07:45:16.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:16 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:16.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:16 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:16.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:16 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:16.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:16 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:16.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:16 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:16.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:16 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:16.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:16.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:16 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:18.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:18 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:18.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:18.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:18.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:18.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:18.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:18.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:18.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:18.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:18.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:18.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:18.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:18.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:18 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:19.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:19 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:19.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:19 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:19.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:19 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:19.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:19 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:19.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:19 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:19.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:19 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:19.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:19 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:19.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:19 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:19.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:19 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:19.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:19 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:19.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:19 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:19.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:19 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:19.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:19 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:19.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:19 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:20.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:20.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:20.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:20.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:20 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:20.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:20.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:20.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:20.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:20.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:20.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:20 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:21 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:21 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:21 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:21 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:21 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:21.123 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:21 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:21.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:21 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:21.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:21 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:21.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:21 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:21.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:21 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:21.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:21 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:21.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:21 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:22.124 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:22.125 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:22.125 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:22.125 INFO:teuthology.orchestra.run.smithi053.stdout:26 Apr 07:45:22 ntpd[17125]: ntpd: time slew +0.000004 s 2024-04-26T07:45:22.125 INFO:teuthology.orchestra.run.smithi053.stdout:ntpd: time slew +0.000004s 2024-04-26T07:45:22.125 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T07:45:22.126 INFO:teuthology.orchestra.run.smithi053.stderr:26 Apr 07:45:22 ntpd[17125]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T07:45:22.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:22.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:22.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:22.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:22.148 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T07:45:22.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T07:45:22.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T07:45:22.149 INFO:teuthology.orchestra.run.smithi191.stdout:26 Apr 07:45:22 ntpd[17232]: ntpd: time slew -0.002346 s 2024-04-26T07:45:22.149 INFO:teuthology.orchestra.run.smithi191.stdout:ntpd: time slew -0.002346s 2024-04-26T07:45:22.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T07:45:22.149 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T07:45:22.150 INFO:teuthology.orchestra.run.smithi191.stderr:26 Apr 07:45:22 ntpd[17232]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T07:45:22.181 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T07:45:22.181 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2024-04-26T07:45:22.181 INFO:teuthology.orchestra.run.smithi053.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:45:22.181 INFO:teuthology.orchestra.run.smithi053.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:45:22.181 INFO:teuthology.orchestra.run.smithi053.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:45:22.181 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:45:22.199 INFO:teuthology.orchestra.run.smithi191.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T07:45:22.199 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================== 2024-04-26T07:45:22.199 INFO:teuthology.orchestra.run.smithi191.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:45:22.199 INFO:teuthology.orchestra.run.smithi191.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:45:22.199 INFO:teuthology.orchestra.run.smithi191.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:45:22.199 INFO:teuthology.orchestra.run.smithi191.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:45:22.200 INFO:teuthology.run_tasks:Running task install... 2024-04-26T07:45:22.208 DEBUG:teuthology.task.install:project ceph 2024-04-26T07:45:22.208 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}} 2024-04-26T07:45:22.209 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'} 2024-04-26T07:45:22.209 INFO:teuthology.task.install:Using flavor: default 2024-04-26T07:45:22.214 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T07:45:22.214 INFO:teuthology.task.install:extra packages: [] 2024-04-26T07:45:22.215 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-key list | grep Ceph 2024-04-26T07:45:22.215 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-key list | grep Ceph 2024-04-26T07:45:22.283 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T07:45:22.303 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T07:45:22.313 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T07:45:22.314 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T07:45:22.314 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T07:45:22.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:45:22.332 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T07:45:22.332 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T07:45:22.333 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T07:45:22.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:45:22.461 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default/ 2024-04-26T07:45:22.461 INFO:teuthology.task.install.deb:Package version is 19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:45:22.477 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default/ 2024-04-26T07:45:22.477 INFO:teuthology.task.install.deb:Package version is 19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:45:22.644 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:45:22.644 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T07:45:22.657 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:45:22.657 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T07:45:22.659 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-04-26T07:45:22.671 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-04-26T07:45:22.838 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T07:45:22.838 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T07:45:22.848 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T07:45:22.850 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T07:45:22.859 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T07:45:22.872 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T07:45:22.880 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T07:45:22.883 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T07:45:22.894 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T07:45:22.904 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T07:45:22.915 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T07:45:22.926 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T07:45:22.937 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T07:45:22.947 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-04-26T07:45:22.958 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T07:45:22.965 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T07:45:22.975 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T07:45:22.984 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-04-26T07:45:23.198 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 29.2 kB in 0s (81.5 kB/s) 2024-04-26T07:45:23.206 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 29.2 kB in 0s (82.8 kB/s) 2024-04-26T07:45:24.132 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-04-26T07:45:24.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3092-g5bfac0af-1jammy cephadm=19.0.0-3092-g5bfac0af-1jammy ceph-mds=19.0.0-3092-g5bfac0af-1jammy ceph-mgr=19.0.0-3092-g5bfac0af-1jammy ceph-common=19.0.0-3092-g5bfac0af-1jammy ceph-fuse=19.0.0-3092-g5bfac0af-1jammy ceph-test=19.0.0-3092-g5bfac0af-1jammy ceph-volume=19.0.0-3092-g5bfac0af-1jammy radosgw=19.0.0-3092-g5bfac0af-1jammy python3-rados=19.0.0-3092-g5bfac0af-1jammy python3-rgw=19.0.0-3092-g5bfac0af-1jammy python3-cephfs=19.0.0-3092-g5bfac0af-1jammy python3-rbd=19.0.0-3092-g5bfac0af-1jammy libcephfs2=19.0.0-3092-g5bfac0af-1jammy libcephfs-dev=19.0.0-3092-g5bfac0af-1jammy librados2=19.0.0-3092-g5bfac0af-1jammy librbd1=19.0.0-3092-g5bfac0af-1jammy rbd-fuse=19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:45:24.186 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-26T07:45:24.201 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3092-g5bfac0af-1jammy cephadm=19.0.0-3092-g5bfac0af-1jammy ceph-mds=19.0.0-3092-g5bfac0af-1jammy ceph-mgr=19.0.0-3092-g5bfac0af-1jammy ceph-common=19.0.0-3092-g5bfac0af-1jammy ceph-fuse=19.0.0-3092-g5bfac0af-1jammy ceph-test=19.0.0-3092-g5bfac0af-1jammy ceph-volume=19.0.0-3092-g5bfac0af-1jammy radosgw=19.0.0-3092-g5bfac0af-1jammy python3-rados=19.0.0-3092-g5bfac0af-1jammy python3-rgw=19.0.0-3092-g5bfac0af-1jammy python3-cephfs=19.0.0-3092-g5bfac0af-1jammy python3-rbd=19.0.0-3092-g5bfac0af-1jammy libcephfs2=19.0.0-3092-g5bfac0af-1jammy libcephfs-dev=19.0.0-3092-g5bfac0af-1jammy librados2=19.0.0-3092-g5bfac0af-1jammy librbd1=19.0.0-3092-g5bfac0af-1jammy rbd-fuse=19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:45:24.210 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-04-26T07:45:24.255 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-04-26T07:45:24.411 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-04-26T07:45:24.412 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-04-26T07:45:24.433 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-04-26T07:45:24.434 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-04-26T07:45:24.607 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T07:45:24.607 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T07:45:24.607 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T07:45:24.608 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T07:45:24.608 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T07:45:24.609 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T07:45:24.609 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T07:45:24.609 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2024-04-26T07:45:24.609 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T07:45:24.609 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T07:45:24.609 INFO:teuthology.orchestra.run.smithi191.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T07:45:24.609 INFO:teuthology.orchestra.run.smithi191.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T07:45:24.610 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T07:45:24.610 INFO:teuthology.orchestra.run.smithi191.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T07:45:24.611 INFO:teuthology.orchestra.run.smithi191.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet zip 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T07:45:24.612 INFO:teuthology.orchestra.run.smithi191.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T07:45:24.613 INFO:teuthology.orchestra.run.smithi191.stdout:Recommended packages: 2024-04-26T07:45:24.613 INFO:teuthology.orchestra.run.smithi191.stdout: btrfs-tools 2024-04-26T07:45:24.617 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T07:45:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T07:45:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T07:45:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T07:45:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T07:45:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T07:45:24.618 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T07:45:24.619 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2024-04-26T07:45:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T07:45:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T07:45:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T07:45:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T07:45:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T07:45:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T07:45:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T07:45:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet zip 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T07:45:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T07:45:24.623 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2024-04-26T07:45:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: btrfs-tools 2024-04-26T07:45:24.711 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-04-26T07:45:24.711 INFO:teuthology.orchestra.run.smithi191.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T07:45:24.711 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T07:45:24.711 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T07:45:24.711 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T07:45:24.711 INFO:teuthology.orchestra.run.smithi191.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T07:45:24.711 INFO:teuthology.orchestra.run.smithi191.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T07:45:24.713 INFO:teuthology.orchestra.run.smithi191.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T07:45:24.713 INFO:teuthology.orchestra.run.smithi191.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T07:45:24.713 INFO:teuthology.orchestra.run.smithi191.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T07:45:24.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T07:45:24.713 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T07:45:24.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T07:45:24.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T07:45:24.715 INFO:teuthology.orchestra.run.smithi191.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T07:45:24.728 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2024-04-26T07:45:24.728 INFO:teuthology.orchestra.run.smithi053.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T07:45:24.728 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T07:45:24.728 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T07:45:24.729 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T07:45:24.729 INFO:teuthology.orchestra.run.smithi053.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T07:45:24.729 INFO:teuthology.orchestra.run.smithi053.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T07:45:24.729 INFO:teuthology.orchestra.run.smithi053.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T07:45:24.730 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T07:45:24.731 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T07:45:24.731 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T07:45:24.731 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T07:45:24.731 INFO:teuthology.orchestra.run.smithi053.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T07:45:24.799 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T07:45:24.799 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 181 MB of archives. 2024-04-26T07:45:24.799 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-26T07:45:24.799 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T07:45:24.855 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T07:45:24.855 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 181 MB of archives. 2024-04-26T07:45:24.855 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-26T07:45:24.855 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3092-g5bfac0af-1jammy [3,554 kB] 2024-04-26T07:45:24.875 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3092-g5bfac0af-1jammy [3,554 kB] 2024-04-26T07:45:24.899 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T07:45:24.907 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T07:45:24.910 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T07:45:24.931 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T07:45:25.001 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T07:45:25.007 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T07:45:25.021 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T07:45:25.025 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T07:45:25.026 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T07:45:25.027 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T07:45:25.035 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T07:45:25.037 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T07:45:25.039 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T07:45:25.041 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T07:45:25.049 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T07:45:25.051 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T07:45:25.053 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T07:45:25.070 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T07:45:25.070 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T07:45:25.071 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T07:45:25.072 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T07:45:25.072 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T07:45:25.073 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T07:45:25.073 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T07:45:25.090 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T07:45:25.091 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T07:45:25.091 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T07:45:25.116 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T07:45:25.117 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T07:45:25.118 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T07:45:25.118 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T07:45:25.120 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T07:45:25.120 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T07:45:25.120 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T07:45:25.137 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T07:45:25.138 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T07:45:25.139 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T07:45:25.150 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3092-g5bfac0af-1jammy [3,224 kB] 2024-04-26T07:45:25.158 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T07:45:25.158 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T07:45:25.159 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T07:45:25.160 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T07:45:25.161 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T07:45:25.163 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T07:45:25.164 INFO:teuthology.orchestra.run.smithi053.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T07:45:25.176 INFO:teuthology.orchestra.run.smithi053.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3092-g5bfac0af-1jammy [3,224 kB] 2024-04-26T07:45:25.180 INFO:teuthology.orchestra.run.smithi053.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T07:45:25.181 INFO:teuthology.orchestra.run.smithi053.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T07:45:25.183 INFO:teuthology.orchestra.run.smithi053.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T07:45:25.202 INFO:teuthology.orchestra.run.smithi053.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T07:45:25.203 INFO:teuthology.orchestra.run.smithi053.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T07:45:25.206 INFO:teuthology.orchestra.run.smithi053.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T07:45:25.269 INFO:teuthology.orchestra.run.smithi053.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T07:45:25.270 INFO:teuthology.orchestra.run.smithi053.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T07:45:25.271 INFO:teuthology.orchestra.run.smithi053.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T07:45:25.272 INFO:teuthology.orchestra.run.smithi053.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T07:45:25.273 INFO:teuthology.orchestra.run.smithi053.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T07:45:25.294 INFO:teuthology.orchestra.run.smithi053.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T07:45:25.296 INFO:teuthology.orchestra.run.smithi053.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T07:45:25.296 INFO:teuthology.orchestra.run.smithi053.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T07:45:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T07:45:25.314 INFO:teuthology.orchestra.run.smithi053.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T07:45:25.315 INFO:teuthology.orchestra.run.smithi053.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T07:45:25.315 INFO:teuthology.orchestra.run.smithi053.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T07:45:25.316 INFO:teuthology.orchestra.run.smithi053.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T07:45:25.316 INFO:teuthology.orchestra.run.smithi053.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T07:45:25.327 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T07:45:25.328 INFO:teuthology.orchestra.run.smithi053.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T07:45:25.328 INFO:teuthology.orchestra.run.smithi053.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T07:45:25.332 INFO:teuthology.orchestra.run.smithi053.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T07:45:25.339 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T07:45:25.344 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3092-g5bfac0af-1jammy [712 kB] 2024-04-26T07:45:25.349 INFO:teuthology.orchestra.run.smithi053.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T07:45:25.350 INFO:teuthology.orchestra.run.smithi053.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T07:45:25.351 INFO:teuthology.orchestra.run.smithi053.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T07:45:25.356 INFO:teuthology.orchestra.run.smithi053.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T07:45:25.359 INFO:teuthology.orchestra.run.smithi053.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T07:45:25.360 INFO:teuthology.orchestra.run.smithi053.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T07:45:25.360 INFO:teuthology.orchestra.run.smithi053.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T07:45:25.370 INFO:teuthology.orchestra.run.smithi053.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T07:45:25.370 INFO:teuthology.orchestra.run.smithi053.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T07:45:25.373 INFO:teuthology.orchestra.run.smithi053.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T07:45:25.380 INFO:teuthology.orchestra.run.smithi053.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3092-g5bfac0af-1jammy [712 kB] 2024-04-26T07:45:25.390 INFO:teuthology.orchestra.run.smithi053.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T07:45:25.390 INFO:teuthology.orchestra.run.smithi053.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T07:45:25.391 INFO:teuthology.orchestra.run.smithi053.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T07:45:25.395 INFO:teuthology.orchestra.run.smithi053.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T07:45:25.395 INFO:teuthology.orchestra.run.smithi053.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T07:45:25.399 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3092-g5bfac0af-1jammy [356 kB] 2024-04-26T07:45:25.400 INFO:teuthology.orchestra.run.smithi053.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T07:45:25.400 INFO:teuthology.orchestra.run.smithi053.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T07:45:25.411 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3092-g5bfac0af-1jammy [32.8 kB] 2024-04-26T07:45:25.411 INFO:teuthology.orchestra.run.smithi053.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T07:45:25.412 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3092-g5bfac0af-1jammy [180 kB] 2024-04-26T07:45:25.414 INFO:teuthology.orchestra.run.smithi053.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T07:45:25.414 INFO:teuthology.orchestra.run.smithi053.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T07:45:25.418 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3092-g5bfac0af-1jammy [66.9 kB] 2024-04-26T07:45:25.420 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3092-g5bfac0af-1jammy [330 kB] 2024-04-26T07:45:25.421 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T07:45:25.436 INFO:teuthology.orchestra.run.smithi053.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3092-g5bfac0af-1jammy [356 kB] 2024-04-26T07:45:25.449 INFO:teuthology.orchestra.run.smithi053.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3092-g5bfac0af-1jammy [32.8 kB] 2024-04-26T07:45:25.450 INFO:teuthology.orchestra.run.smithi053.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3092-g5bfac0af-1jammy [180 kB] 2024-04-26T07:45:25.456 INFO:teuthology.orchestra.run.smithi053.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3092-g5bfac0af-1jammy [66.9 kB] 2024-04-26T07:45:25.458 INFO:teuthology.orchestra.run.smithi053.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3092-g5bfac0af-1jammy [330 kB] 2024-04-26T07:45:25.466 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3092-g5bfac0af-1jammy [6,888 kB] 2024-04-26T07:45:25.504 INFO:teuthology.orchestra.run.smithi053.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3092-g5bfac0af-1jammy [6,888 kB] 2024-04-26T07:45:25.652 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T07:45:25.663 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T07:45:25.693 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T07:45:25.705 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T07:45:25.706 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T07:45:25.708 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T07:45:25.723 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T07:45:25.898 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T07:45:25.919 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3092-g5bfac0af-1jammy [112 kB] 2024-04-26T07:45:25.922 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3092-g5bfac0af-1jammy [466 kB] 2024-04-26T07:45:25.931 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3092-g5bfac0af-1jammy [25.8 MB] 2024-04-26T07:45:25.946 INFO:teuthology.orchestra.run.smithi053.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3092-g5bfac0af-1jammy [112 kB] 2024-04-26T07:45:25.948 INFO:teuthology.orchestra.run.smithi053.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3092-g5bfac0af-1jammy [466 kB] 2024-04-26T07:45:25.993 INFO:teuthology.orchestra.run.smithi053.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3092-g5bfac0af-1jammy [25.8 MB] 2024-04-26T07:45:26.591 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T07:45:26.767 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T07:45:26.778 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T07:45:27.266 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T07:45:27.669 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T07:45:27.742 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3092-g5bfac0af-1jammy [5,092 kB] 2024-04-26T07:45:27.777 INFO:teuthology.orchestra.run.smithi053.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3092-g5bfac0af-1jammy [5,092 kB] 2024-04-26T07:45:27.938 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3092-g5bfac0af-1jammy [244 kB] 2024-04-26T07:45:27.970 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3092-g5bfac0af-1jammy [124 kB] 2024-04-26T07:45:27.973 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3092-g5bfac0af-1jammy [1,526 kB] 2024-04-26T07:45:28.033 INFO:teuthology.orchestra.run.smithi053.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3092-g5bfac0af-1jammy [244 kB] 2024-04-26T07:45:28.040 INFO:teuthology.orchestra.run.smithi053.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3092-g5bfac0af-1jammy [124 kB] 2024-04-26T07:45:28.061 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3092-g5bfac0af-1jammy [6,258 kB] 2024-04-26T07:45:28.062 INFO:teuthology.orchestra.run.smithi053.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3092-g5bfac0af-1jammy [1,526 kB] 2024-04-26T07:45:28.140 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T07:45:28.169 INFO:teuthology.orchestra.run.smithi053.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3092-g5bfac0af-1jammy [6,258 kB] 2024-04-26T07:45:28.279 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T07:45:28.289 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T07:45:28.462 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3092-g5bfac0af-1jammy [22.8 MB] 2024-04-26T07:45:28.502 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T07:45:28.507 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T07:45:28.565 INFO:teuthology.orchestra.run.smithi053.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3092-g5bfac0af-1jammy [22.8 MB] 2024-04-26T07:45:28.686 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T07:45:28.771 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T07:45:28.800 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T07:45:28.818 INFO:teuthology.orchestra.run.smithi191.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T07:45:28.861 INFO:teuthology.orchestra.run.smithi191.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T07:45:29.079 INFO:teuthology.orchestra.run.smithi191.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T07:45:29.094 INFO:teuthology.orchestra.run.smithi191.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T07:45:29.100 INFO:teuthology.orchestra.run.smithi191.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T07:45:29.106 INFO:teuthology.orchestra.run.smithi191.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T07:45:29.127 INFO:teuthology.orchestra.run.smithi191.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T07:45:29.131 INFO:teuthology.orchestra.run.smithi191.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T07:45:29.299 INFO:teuthology.orchestra.run.smithi191.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T07:45:29.635 INFO:teuthology.orchestra.run.smithi191.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T07:45:29.674 INFO:teuthology.orchestra.run.smithi191.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T07:45:29.687 INFO:teuthology.orchestra.run.smithi191.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T07:45:29.894 INFO:teuthology.orchestra.run.smithi191.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T07:45:29.895 INFO:teuthology.orchestra.run.smithi191.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T07:45:29.900 INFO:teuthology.orchestra.run.smithi191.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T07:45:29.906 INFO:teuthology.orchestra.run.smithi191.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T07:45:29.995 INFO:teuthology.orchestra.run.smithi191.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T07:45:29.998 INFO:teuthology.orchestra.run.smithi191.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3092-g5bfac0af-1jammy [14.0 kB] 2024-04-26T07:45:29.999 INFO:teuthology.orchestra.run.smithi191.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3092-g5bfac0af-1jammy [870 kB] 2024-04-26T07:45:30.002 INFO:teuthology.orchestra.run.smithi191.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T07:45:30.004 INFO:teuthology.orchestra.run.smithi191.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T07:45:30.019 INFO:teuthology.orchestra.run.smithi191.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3092-g5bfac0af-1jammy [2,436 kB] 2024-04-26T07:45:30.096 INFO:teuthology.orchestra.run.smithi191.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3092-g5bfac0af-1jammy [791 kB] 2024-04-26T07:45:30.142 INFO:teuthology.orchestra.run.smithi191.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3092-g5bfac0af-1jammy [148 kB] 2024-04-26T07:45:30.155 INFO:teuthology.orchestra.run.smithi191.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3092-g5bfac0af-1jammy [2,304 kB] 2024-04-26T07:45:30.175 INFO:teuthology.orchestra.run.smithi191.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T07:45:30.279 INFO:teuthology.orchestra.run.smithi191.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3092-g5bfac0af-1jammy [8,625 kB] 2024-04-26T07:45:30.282 INFO:teuthology.orchestra.run.smithi053.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3092-g5bfac0af-1jammy [14.0 kB] 2024-04-26T07:45:30.283 INFO:teuthology.orchestra.run.smithi053.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3092-g5bfac0af-1jammy [870 kB] 2024-04-26T07:45:30.299 INFO:teuthology.orchestra.run.smithi053.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3092-g5bfac0af-1jammy [2,436 kB] 2024-04-26T07:45:30.439 INFO:teuthology.orchestra.run.smithi191.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T07:45:30.449 INFO:teuthology.orchestra.run.smithi053.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3092-g5bfac0af-1jammy [791 kB] 2024-04-26T07:45:30.517 INFO:teuthology.orchestra.run.smithi053.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3092-g5bfac0af-1jammy [148 kB] 2024-04-26T07:45:30.521 INFO:teuthology.orchestra.run.smithi053.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3092-g5bfac0af-1jammy [2,304 kB] 2024-04-26T07:45:30.638 INFO:teuthology.orchestra.run.smithi191.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T07:45:30.655 INFO:teuthology.orchestra.run.smithi191.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T07:45:30.675 INFO:teuthology.orchestra.run.smithi191.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T07:45:30.695 INFO:teuthology.orchestra.run.smithi053.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3092-g5bfac0af-1jammy [8,625 kB] 2024-04-26T07:45:30.734 INFO:teuthology.orchestra.run.smithi191.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T07:45:30.748 INFO:teuthology.orchestra.run.smithi191.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3092-g5bfac0af-1jammy [14.2 kB] 2024-04-26T07:45:30.749 INFO:teuthology.orchestra.run.smithi191.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3092-g5bfac0af-1jammy [51.6 MB] 2024-04-26T07:45:31.025 INFO:teuthology.orchestra.run.smithi191.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T07:45:31.027 INFO:teuthology.orchestra.run.smithi191.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T07:45:31.030 INFO:teuthology.orchestra.run.smithi191.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T07:45:31.031 INFO:teuthology.orchestra.run.smithi191.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T07:45:31.033 INFO:teuthology.orchestra.run.smithi191.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T07:45:31.384 INFO:teuthology.orchestra.run.smithi053.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3092-g5bfac0af-1jammy [14.2 kB] 2024-04-26T07:45:31.384 INFO:teuthology.orchestra.run.smithi053.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3092-g5bfac0af-1jammy [51.6 MB] 2024-04-26T07:45:33.857 INFO:teuthology.orchestra.run.smithi191.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T07:45:33.988 INFO:teuthology.orchestra.run.smithi191.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3092-g5bfac0af-1jammy [121 kB] 2024-04-26T07:45:33.990 INFO:teuthology.orchestra.run.smithi191.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3092-g5bfac0af-1jammy [38.9 kB] 2024-04-26T07:45:33.991 INFO:teuthology.orchestra.run.smithi191.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3092-g5bfac0af-1jammy [13.6 MB] 2024-04-26T07:45:34.306 INFO:teuthology.orchestra.run.smithi191.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T07:45:34.312 INFO:teuthology.orchestra.run.smithi191.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T07:45:34.654 INFO:teuthology.orchestra.run.smithi191.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3092-g5bfac0af-1jammy [91.2 kB] 2024-04-26T07:45:35.115 INFO:teuthology.orchestra.run.smithi053.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3092-g5bfac0af-1jammy [121 kB] 2024-04-26T07:45:35.117 INFO:teuthology.orchestra.run.smithi053.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3092-g5bfac0af-1jammy [38.9 kB] 2024-04-26T07:45:35.119 INFO:teuthology.orchestra.run.smithi053.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3092-g5bfac0af-1jammy [13.6 MB] 2024-04-26T07:45:35.455 INFO:teuthology.orchestra.run.smithi053.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/fix_error_message_flow/5bfac0af933f1833ec096c3048e2c80e20507e52/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3092-g5bfac0af-1jammy [91.2 kB] 2024-04-26T07:45:36.113 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 181 MB in 11s (16.8 MB/s) 2024-04-26T07:45:36.242 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T07:45:36.342 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T07:45:36.348 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T07:45:36.416 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T07:45:36.736 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T07:45:36.763 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T07:45:36.803 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T07:45:37.164 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T07:45:37.191 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T07:45:37.231 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T07:45:37.609 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T07:45:37.636 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T07:45:37.676 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:45:37.726 INFO:teuthology.orchestra.run.smithi191.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T07:45:37.761 INFO:teuthology.orchestra.run.smithi191.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T07:45:37.919 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 2024-04-26T07:45:38.084 INFO:teuthology.orchestra.run.smithi191.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T07:45:38.132 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T07:45:38.158 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T07:45:38.232 INFO:teuthology.orchestra.run.smithi191.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T07:45:38.317 INFO:teuthology.orchestra.run.smithi191.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T07:45:38.321 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:45:38.381 INFO:teuthology.orchestra.run.smithi191.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T07:45:38.397 INFO:teuthology.orchestra.run.smithi191.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T07:45:38.429 INFO:teuthology.orchestra.run.smithi191.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T07:45:38.783 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T07:45:38.809 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T07:45:38.849 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:45:39.161 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T07:45:39.188 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T07:45:39.228 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T07:45:39.556 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librados2. 2024-04-26T07:45:39.583 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../007-librados2_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:39.622 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librados2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:39.829 INFO:teuthology.orchestra.run.smithi191.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T07:45:40.108 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librbd1. 2024-04-26T07:45:40.136 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../008-librbd1_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:40.175 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librbd1 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:40.222 INFO:teuthology.orchestra.run.smithi191.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T07:45:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T07:45:40.605 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:40.636 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:40.746 INFO:teuthology.orchestra.run.smithi191.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T07:45:40.897 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rados. 2024-04-26T07:45:40.913 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:40.932 INFO:teuthology.orchestra.run.smithi191.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T07:45:40.955 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rados (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:41.275 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T07:45:41.302 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:45:41.341 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-argparse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:41.594 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T07:45:41.621 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:41.669 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cephfs (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:41.914 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T07:45:41.940 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:45:41.972 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-common (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:42.187 INFO:teuthology.orchestra.run.smithi191.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T07:45:42.275 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T07:45:42.302 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T07:45:42.342 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T07:45:42.670 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T07:45:42.697 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T07:45:42.736 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T07:45:42.821 INFO:teuthology.orchestra.run.smithi191.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T07:45:43.006 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T07:45:43.033 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:43.072 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rbd (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:43.168 INFO:teuthology.orchestra.run.smithi191.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T07:45:43.226 INFO:teuthology.orchestra.run.smithi191.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T07:45:43.526 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T07:45:43.552 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T07:45:43.584 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T07:45:43.854 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T07:45:43.880 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T07:45:43.920 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T07:45:44.256 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T07:45:44.283 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T07:45:44.323 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T07:45:44.411 INFO:teuthology.orchestra.run.smithi191.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T07:45:44.463 INFO:teuthology.orchestra.run.smithi191.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T07:45:44.618 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua5.1. 2024-04-26T07:45:44.634 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T07:45:44.668 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T07:45:44.787 INFO:teuthology.orchestra.run.smithi191.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T07:45:44.792 INFO:teuthology.orchestra.run.smithi191.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T07:45:44.847 INFO:teuthology.orchestra.run.smithi191.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T07:45:44.874 INFO:teuthology.orchestra.run.smithi191.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T07:45:44.988 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-any. 2024-04-26T07:45:45.015 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T07:45:45.096 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T07:45:45.221 INFO:teuthology.orchestra.run.smithi191.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T07:45:45.341 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package zip. 2024-04-26T07:45:45.367 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T07:45:45.407 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T07:45:45.417 INFO:teuthology.orchestra.run.smithi191.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T07:45:45.719 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package unzip. 2024-04-26T07:45:45.745 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T07:45:45.785 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T07:45:46.198 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package luarocks. 2024-04-26T07:45:46.224 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T07:45:46.264 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T07:45:46.597 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librgw2. 2024-04-26T07:45:46.624 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../025-librgw2_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:46.664 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librgw2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:46.904 INFO:teuthology.orchestra.run.smithi191.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T07:45:47.091 INFO:teuthology.orchestra.run.smithi191.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T07:45:47.118 INFO:teuthology.orchestra.run.smithi191.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T07:45:47.216 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T07:45:47.232 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:47.275 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rgw (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:47.354 INFO:teuthology.orchestra.run.smithi191.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T07:45:47.379 INFO:teuthology.orchestra.run.smithi191.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T07:45:47.616 INFO:teuthology.orchestra.run.smithi191.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T07:45:47.628 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T07:45:47.654 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T07:45:47.694 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T07:45:47.981 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T07:45:48.008 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:48.039 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libradosstriper1 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:48.176 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 181 MB in 23s (7,909 kB/s) 2024-04-26T07:45:48.315 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T07:45:48.414 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T07:45:48.419 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T07:45:48.563 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T07:45:48.668 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-common. 2024-04-26T07:45:48.695 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:48.734 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-common (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:48.892 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T07:45:48.918 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T07:45:48.958 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T07:45:49.320 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T07:45:49.347 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T07:45:49.387 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T07:45:49.749 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T07:45:49.775 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T07:45:49.815 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:45:50.210 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T07:45:50.231 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-base. 2024-04-26T07:45:50.237 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T07:45:50.259 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:50.277 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:45:50.307 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-base (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:50.597 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T07:45:50.623 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T07:45:50.663 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:45:50.869 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T07:45:50.896 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T07:45:50.935 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T07:45:50.958 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T07:45:50.984 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T07:45:51.016 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T07:45:51.241 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T07:45:51.268 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T07:45:51.307 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T07:45:51.311 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librados2. 2024-04-26T07:45:51.337 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../007-librados2_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:51.377 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librados2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:51.635 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T07:45:51.662 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T07:45:51.701 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T07:45:51.780 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librbd1. 2024-04-26T07:45:51.806 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../008-librbd1_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:51.847 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librbd1 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:52.004 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T07:45:52.032 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T07:45:52.071 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T07:45:52.233 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T07:45:52.248 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:52.291 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libcephfs2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:52.374 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T07:45:52.398 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T07:45:52.432 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T07:45:52.569 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rados. 2024-04-26T07:45:52.595 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:52.635 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rados (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:52.718 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T07:45:52.745 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T07:45:52.785 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T07:45:52.989 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T07:45:53.015 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:45:53.055 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-ceph-argparse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:53.096 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-portend. 2024-04-26T07:45:53.123 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T07:45:53.162 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T07:45:53.308 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T07:45:53.334 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:53.374 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cephfs (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:53.474 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T07:45:53.501 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T07:45:53.540 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T07:45:53.793 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T07:45:53.802 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T07:45:53.821 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T07:45:53.828 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:45:53.851 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T07:45:53.869 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-ceph-common (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:54.205 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T07:45:54.213 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T07:45:54.232 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T07:45:54.239 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T07:45:54.271 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T07:45:54.280 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T07:45:54.558 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T07:45:54.574 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T07:45:54.585 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T07:45:54.601 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T07:45:54.624 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T07:45:54.633 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T07:45:54.886 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T07:45:54.894 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T07:45:54.912 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:54.922 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T07:45:54.952 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rbd (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:54.960 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T07:45:55.280 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-mako. 2024-04-26T07:45:55.307 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T07:45:55.313 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T07:45:55.339 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T07:45:55.347 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T07:45:55.380 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T07:45:55.657 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T07:45:55.673 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T07:45:55.683 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T07:45:55.711 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T07:45:55.716 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T07:45:55.750 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T07:45:56.021 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T07:45:56.036 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T07:45:56.053 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T07:45:56.079 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T07:45:56.080 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T07:45:56.119 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T07:45:56.414 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webob. 2024-04-26T07:45:56.441 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T07:45:56.458 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua5.1. 2024-04-26T07:45:56.471 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T07:45:56.484 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T07:45:56.525 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T07:45:56.796 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-any. 2024-04-26T07:45:56.800 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T07:45:56.822 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T07:45:56.827 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T07:45:56.862 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T07:45:56.870 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T07:45:57.107 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package zip. 2024-04-26T07:45:57.122 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T07:45:57.166 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T07:45:57.178 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T07:45:57.205 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T07:45:57.244 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T07:45:57.461 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package unzip. 2024-04-26T07:45:57.487 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T07:45:57.528 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T07:45:57.547 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-paste. 2024-04-26T07:45:57.574 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T07:45:57.613 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T07:45:57.917 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T07:45:57.933 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package luarocks. 2024-04-26T07:45:57.933 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T07:45:57.959 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T07:45:57.975 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T07:45:57.999 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T07:45:59.279 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T07:45:59.306 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T07:45:59.345 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T07:45:59.435 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librgw2. 2024-04-26T07:45:59.461 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../025-librgw2_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:45:59.501 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librgw2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:45:59.607 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T07:45:59.623 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T07:45:59.665 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T07:45:59.918 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T07:45:59.945 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T07:45:59.984 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T07:46:00.063 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T07:46:00.078 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:00.122 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rgw (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:00.297 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T07:46:00.325 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T07:46:00.387 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T07:46:00.392 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T07:46:00.419 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T07:46:00.450 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T07:46:00.717 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-idna. 2024-04-26T07:46:00.744 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T07:46:00.762 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T07:46:00.783 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T07:46:00.789 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:00.829 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libradosstriper1 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:01.094 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T07:46:01.121 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T07:46:01.161 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T07:46:01.192 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-common. 2024-04-26T07:46:01.218 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:01.250 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-common (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:01.472 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests. 2024-04-26T07:46:01.499 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T07:46:01.539 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T07:46:01.850 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T07:46:01.878 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T07:46:01.917 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T07:46:02.203 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T07:46:02.219 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:02.261 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:02.641 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T07:46:02.657 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-base. 2024-04-26T07:46:02.669 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:02.683 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:02.708 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:02.733 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-base (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:03.027 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T07:46:03.055 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T07:46:03.093 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T07:46:03.304 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T07:46:03.330 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T07:46:03.371 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T07:46:03.396 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T07:46:03.424 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T07:46:03.463 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T07:46:03.683 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T07:46:03.709 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T07:46:03.749 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T07:46:03.750 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T07:46:03.766 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:03.799 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:04.079 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T07:46:04.105 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T07:46:04.145 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T07:46:04.203 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T07:46:04.230 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:04.269 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mon (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:04.424 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T07:46:04.450 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T07:46:04.491 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T07:46:04.778 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T07:46:04.804 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T07:46:04.844 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T07:46:04.948 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T07:46:04.975 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:05.022 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-osd (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:05.148 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T07:46:05.174 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T07:46:05.215 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T07:46:05.494 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-portend. 2024-04-26T07:46:05.516 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T07:46:05.552 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T07:46:05.856 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T07:46:05.882 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T07:46:05.922 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T07:46:06.218 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T07:46:06.244 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T07:46:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph. 2024-04-26T07:46:06.284 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T07:46:06.286 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../066-ceph_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:06.334 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:06.623 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T07:46:06.645 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T07:46:06.649 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T07:46:06.672 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:06.689 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T07:46:06.711 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-fuse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:07.002 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T07:46:07.028 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T07:46:07.093 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T07:46:07.098 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T07:46:07.125 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:07.164 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mds (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:07.338 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T07:46:07.354 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T07:46:07.388 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T07:46:07.618 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephadm. 2024-04-26T07:46:07.645 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../069-cephadm_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:07.675 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-mako. 2024-04-26T07:46:07.692 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephadm (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:07.702 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T07:46:07.742 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T07:46:08.037 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T07:46:08.063 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T07:46:08.064 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T07:46:08.089 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T07:46:08.103 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T07:46:08.129 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T07:46:08.408 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T07:46:08.435 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T07:46:08.447 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T07:46:08.466 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T07:46:08.475 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T07:46:08.522 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T07:46:08.753 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-webob. 2024-04-26T07:46:08.779 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T07:46:08.820 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T07:46:09.408 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T07:46:09.434 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T07:46:09.477 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T07:46:09.719 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-babel. 2024-04-26T07:46:09.747 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T07:46:09.785 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T07:46:09.786 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T07:46:09.812 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T07:46:09.852 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T07:46:10.114 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T07:46:10.123 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-paste. 2024-04-26T07:46:10.141 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T07:46:10.149 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T07:46:10.180 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T07:46:10.190 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T07:46:10.519 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T07:46:10.525 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T07:46:10.534 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T07:46:10.552 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:10.577 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T07:46:10.591 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:10.931 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T07:46:10.936 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T07:46:10.953 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T07:46:10.957 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T07:46:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T07:46:10.998 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T07:46:11.251 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T07:46:11.278 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T07:46:11.297 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-routes. 2024-04-26T07:46:11.314 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T07:46:11.318 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T07:46:11.355 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T07:46:11.630 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T07:46:11.657 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T07:46:11.684 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T07:46:11.701 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:11.705 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T07:46:11.742 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:12.070 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T07:46:12.096 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T07:46:12.136 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T07:46:12.449 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-idna. 2024-04-26T07:46:12.475 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T07:46:12.515 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T07:46:12.794 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T07:46:12.820 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T07:46:12.860 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T07:46:12.938 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T07:46:12.954 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T07:46:12.996 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T07:46:13.157 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-requests. 2024-04-26T07:46:13.183 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T07:46:13.223 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T07:46:13.500 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T07:46:13.528 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T07:46:13.535 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T07:46:13.562 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T07:46:13.567 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T07:46:13.602 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T07:46:13.872 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T07:46:13.888 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:13.931 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:13.945 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T07:46:13.972 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T07:46:14.011 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T07:46:14.323 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T07:46:14.351 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T07:46:14.354 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T07:46:14.380 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:14.389 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T07:46:14.421 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:14.716 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T07:46:14.743 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T07:46:14.783 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T07:46:15.087 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T07:46:15.098 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T07:46:15.114 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T07:46:15.126 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:15.153 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T07:46:15.250 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:15.457 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T07:46:15.484 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:15.524 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:15.886 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T07:46:15.913 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:15.953 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mon (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:16.229 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T07:46:16.256 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T07:46:16.295 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T07:46:16.558 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T07:46:16.584 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:16.598 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T07:46:16.624 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-osd (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:16.625 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T07:46:16.655 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T07:46:17.026 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T07:46:17.054 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T07:46:17.092 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T07:46:17.387 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T07:46:17.415 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T07:46:17.453 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T07:46:17.695 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph. 2024-04-26T07:46:17.721 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../066-ceph_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:17.761 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:17.782 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T07:46:17.810 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T07:46:17.857 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T07:46:18.123 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T07:46:18.144 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T07:46:18.150 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:18.171 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T07:46:18.190 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-fuse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:18.226 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T07:46:18.527 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T07:46:18.530 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T07:46:18.554 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:18.557 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T07:46:18.585 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mds (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T07:46:18.900 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T07:46:18.927 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T07:46:18.958 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T07:46:18.973 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package cephadm. 2024-04-26T07:46:19.002 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../069-cephadm_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:19.039 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking cephadm (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:19.368 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T07:46:19.394 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T07:46:19.434 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T07:46:19.946 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T07:46:19.962 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T07:46:20.004 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T07:46:20.080 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T07:46:20.098 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:20.129 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:20.416 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T07:46:20.443 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T07:46:20.491 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T07:46:20.836 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T07:46:20.863 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T07:46:20.902 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T07:46:20.995 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-babel. 2024-04-26T07:46:21.022 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T07:46:21.061 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T07:46:21.154 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package jq. 2024-04-26T07:46:21.171 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T07:46:21.213 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T07:46:21.396 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T07:46:21.423 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T07:46:21.465 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T07:46:21.466 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package socat. 2024-04-26T07:46:21.493 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T07:46:21.532 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T07:46:21.819 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T07:46:21.846 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:21.852 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T07:46:21.869 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T07:46:21.885 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:21.901 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T07:46:22.231 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T07:46:22.247 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-test. 2024-04-26T07:46:22.258 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T07:46:22.264 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:22.298 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T07:46:22.305 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-test (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:22.560 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-routes. 2024-04-26T07:46:22.576 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T07:46:22.610 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T07:46:22.914 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T07:46:22.937 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:22.972 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:24.212 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T07:46:24.228 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T07:46:24.262 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T07:46:24.568 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T07:46:24.585 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:24.618 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-volume (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:24.734 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T07:46:24.761 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T07:46:24.800 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T07:46:24.897 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T07:46:24.913 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:24.980 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs-dev (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:25.221 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T07:46:25.249 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T07:46:25.275 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T07:46:25.288 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T07:46:25.302 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T07:46:25.341 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T07:46:25.600 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T07:46:25.627 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T07:46:25.666 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T07:46:25.679 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T07:46:25.707 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T07:46:25.745 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T07:46:26.124 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T07:46:26.153 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T07:46:26.199 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T07:46:26.386 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T07:46:26.414 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:26.538 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:26.629 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package pkg-config. 2024-04-26T07:46:26.657 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T07:46:26.696 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T07:46:26.923 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T07:46:26.940 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T07:46:26.975 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T07:46:27.368 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T07:46:27.385 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T07:46:27.418 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T07:46:27.593 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T07:46:27.621 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T07:46:27.660 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T07:46:27.704 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T07:46:27.732 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T07:46:27.770 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T07:46:27.964 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T07:46:27.990 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T07:46:28.030 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T07:46:28.099 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T07:46:28.127 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T07:46:28.166 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T07:46:28.326 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T07:46:28.354 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T07:46:28.393 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T07:46:28.485 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T07:46:28.513 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T07:46:28.552 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T07:46:28.705 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T07:46:28.720 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T07:46:28.755 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T07:46:28.863 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-py. 2024-04-26T07:46:28.884 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T07:46:28.921 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T07:46:29.093 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T07:46:29.120 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T07:46:29.160 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T07:46:29.241 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T07:46:29.269 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T07:46:29.299 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T07:46:29.481 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T07:46:29.508 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T07:46:29.547 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T07:46:29.797 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T07:46:29.825 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T07:46:29.851 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T07:46:29.863 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T07:46:29.878 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T07:46:29.918 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T07:46:30.174 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-toml. 2024-04-26T07:46:30.203 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T07:46:30.240 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T07:46:30.414 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T07:46:30.441 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T07:46:30.480 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T07:46:30.502 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T07:46:30.530 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T07:46:30.560 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T07:46:30.914 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T07:46:30.942 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T07:46:30.980 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T07:46:31.096 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T07:46:31.112 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:31.154 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:31.241 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T07:46:31.258 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T07:46:31.299 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T07:46:31.474 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T07:46:31.501 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T07:46:31.540 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T07:46:31.818 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T07:46:31.845 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T07:46:31.885 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T07:46:32.003 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package radosgw. 2024-04-26T07:46:32.031 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../116-radosgw_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:32.061 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking radosgw (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:32.112 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package jq. 2024-04-26T07:46:32.139 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T07:46:32.187 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T07:46:32.414 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package socat. 2024-04-26T07:46:32.430 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T07:46:32.472 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T07:46:32.776 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T07:46:32.803 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T07:46:32.842 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T07:46:32.897 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T07:46:32.914 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:32.955 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-fuse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:33.213 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-test. 2024-04-26T07:46:33.229 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:33.271 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-test (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:33.285 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T07:46:33.594 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T07:46:33.720 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T07:46:33.990 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T07:46:34.316 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T07:46:34.739 INFO:teuthology.orchestra.run.smithi053.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T07:46:34.839 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephadm (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:35.701 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T07:46:35.728 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3092-g5bfac0af-1jammy_all.deb ... 2024-04-26T07:46:35.783 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-volume (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:35.964 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user cephadm....done 2024-04-26T07:46:36.062 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T07:46:36.078 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:36.120 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libcephfs-dev (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:36.121 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T07:46:36.405 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T07:46:36.440 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T07:46:36.467 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T07:46:36.506 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T07:46:36.665 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T07:46:36.791 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T07:46:36.836 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T07:46:36.863 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T07:46:36.902 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T07:46:37.042 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T07:46:37.273 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T07:46:37.300 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T07:46:37.301 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T07:46:37.347 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T07:46:37.461 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T07:46:37.761 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package pkg-config. 2024-04-26T07:46:37.789 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T07:46:37.796 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T07:46:37.827 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T07:46:38.055 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T07:46:38.071 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T07:46:38.113 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T07:46:38.164 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T07:46:38.416 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T07:46:38.508 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T07:46:38.536 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T07:46:38.574 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T07:46:38.700 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T07:46:38.886 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T07:46:38.913 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T07:46:38.952 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T07:46:38.977 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T07:46:39.272 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T07:46:39.299 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T07:46:39.355 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T07:46:39.420 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T07:46:39.666 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T07:46:39.694 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T07:46:39.695 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T07:46:39.733 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T07:46:39.963 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-argparse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:40.078 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-py. 2024-04-26T07:46:40.105 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T07:46:40.152 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T07:46:40.231 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T07:46:40.357 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T07:46:40.472 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T07:46:40.483 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T07:46:40.499 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T07:46:40.538 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T07:46:40.634 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T07:46:40.919 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T07:46:41.209 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T07:46:41.225 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T07:46:41.259 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T07:46:41.306 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T07:46:41.354 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T07:46:41.422 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T07:46:41.548 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T07:46:41.728 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-toml. 2024-04-26T07:46:41.756 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T07:46:41.795 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T07:46:41.907 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T07:46:42.033 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T07:46:42.097 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T07:46:42.125 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T07:46:42.164 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T07:46:42.318 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T07:46:42.484 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T07:46:42.512 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T07:46:42.550 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T07:46:42.619 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T07:46:42.820 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T07:46:42.836 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T07:46:42.878 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T07:46:42.937 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T07:46:43.080 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T07:46:43.640 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package radosgw. 2024-04-26T07:46:43.668 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../116-radosgw_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:43.706 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking radosgw (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:43.798 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T07:46:44.049 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T07:46:44.175 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T07:46:44.318 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T07:46:44.501 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T07:46:44.529 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3092-g5bfac0af-1jammy_amd64.deb ... 2024-04-26T07:46:44.567 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking rbd-fuse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:44.644 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T07:46:44.846 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T07:46:45.046 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T07:46:45.097 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T07:46:45.232 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T07:46:45.372 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T07:46:45.491 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T07:46:45.790 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T07:46:45.835 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T07:46:46.083 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T07:46:46.272 INFO:teuthology.orchestra.run.smithi191.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T07:46:46.351 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up cephadm (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:46.434 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T07:46:46.719 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T07:46:46.845 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-common (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:46.943 INFO:teuthology.orchestra.run.smithi191.stdout:Adding system user cephadm....done 2024-04-26T07:46:47.146 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T07:46:47.158 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T07:46:47.472 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T07:46:47.554 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T07:46:47.900 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T07:46:48.127 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T07:46:48.379 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T07:46:48.638 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T07:46:48.711 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T07:46:48.739 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T07:46:48.971 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:46:49.050 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T07:46:49.105 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T07:46:49.373 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T07:46:49.435 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T07:46:49.499 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T07:46:49.650 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T07:46:49.677 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T07:46:49.937 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T07:46:49.960 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T07:46:50.213 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T07:46:50.236 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T07:46:50.464 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T07:46:50.504 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:46:50.638 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T07:46:50.723 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T07:46:50.965 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T07:46:50.974 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-ceph-argparse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:51.215 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T07:46:51.234 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T07:46:51.368 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T07:46:51.467 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T07:46:51.477 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T07:46:51.578 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T07:46:51.734 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T07:46:51.821 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T07:46:52.003 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T07:46:52.197 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T07:46:52.226 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T07:46:52.278 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T07:46:52.291 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T07:46:52.417 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T07:46:52.429 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T07:46:52.714 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T07:46:52.785 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T07:46:52.815 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T07:46:52.894 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T07:46:53.132 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T07:46:53.161 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T07:46:53.429 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T07:46:53.442 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T07:46:53.727 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T07:46:53.747 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T07:46:53.853 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T07:46:53.873 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T07:46:53.979 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T07:46:54.067 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T07:46:54.322 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T07:46:54.448 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T07:46:54.533 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T07:46:54.793 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T07:46:54.866 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T07:46:54.902 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T07:46:55.011 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T07:46:55.153 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T07:46:55.296 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T07:46:55.310 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T07:46:55.603 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:46:55.664 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T07:46:55.757 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T07:46:56.006 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T07:46:56.205 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T07:46:56.514 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T07:46:56.557 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T07:46:56.799 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T07:46:56.859 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T07:46:56.925 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T07:46:57.193 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T07:46:57.202 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T07:46:57.486 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T07:46:57.486 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T07:46:57.595 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-ceph-common (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:57.856 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T07:46:57.897 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T07:46:58.206 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T07:46:58.257 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T07:46:58.559 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T07:46:58.911 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T07:46:59.062 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librados2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:59.189 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:59.314 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T07:46:59.445 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T07:46:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:59.671 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:46:59.789 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T07:46:59.802 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libradosstriper1 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:46:59.953 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T07:47:00.065 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T07:47:00.191 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T07:47:00.254 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librbd1 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:00.325 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T07:47:00.380 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-modules-core (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:00.506 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-fuse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:00.627 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T07:47:00.726 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T07:47:00.726 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T07:47:00.878 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T07:47:01.137 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:47:01.191 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs-dev (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:01.263 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T07:47:01.300 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rados (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:01.426 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librgw2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:01.561 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T07:47:01.564 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T07:47:01.824 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T07:47:02.091 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T07:47:02.359 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T07:47:02.594 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T07:47:02.822 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rbd (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:02.861 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T07:47:02.949 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-fuse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:02.987 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T07:47:03.075 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rgw (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:03.201 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cephfs (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:03.272 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T07:47:03.343 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-common (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:03.397 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T07:47:03.682 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T07:47:03.970 INFO:teuthology.orchestra.run.smithi053.stdout:Adding group ceph....done 2024-04-26T07:47:03.983 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T07:47:04.243 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T07:47:04.288 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user ceph....done 2024-04-26T07:47:04.369 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T07:47:04.457 INFO:teuthology.orchestra.run.smithi053.stdout:Setting system user ceph properties....done 2024-04-26T07:47:04.474 INFO:teuthology.orchestra.run.smithi053.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T07:47:04.511 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T07:47:04.591 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T07:47:04.618 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T07:47:04.812 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T07:47:04.922 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T07:47:04.924 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T07:47:05.315 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T07:47:05.395 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-test (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:05.521 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up radosgw (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:05.574 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T07:47:05.709 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T07:47:05.968 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T07:47:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T07:47:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T07:47:06.094 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T07:47:06.404 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T07:47:06.439 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-base (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:06.696 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T07:47:06.799 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T07:47:06.955 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T07:47:07.081 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T07:47:07.241 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mds (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:07.357 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T07:47:07.492 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T07:47:07.492 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T07:47:07.634 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T07:47:07.935 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:07.970 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T07:47:08.162 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T07:47:08.162 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T07:47:08.372 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T07:47:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-osd (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:08.656 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T07:47:08.914 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T07:47:08.914 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T07:47:09.042 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T07:47:09.168 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librados2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:09.294 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:09.404 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:09.412 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T07:47:09.530 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:09.665 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mon (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:09.715 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libcephfs2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:09.840 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libradosstriper1 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:09.867 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T07:47:09.867 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T07:47:09.966 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T07:47:10.252 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librbd1 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:10.353 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-modules-core (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:10.357 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-cephadm (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:10.479 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-fuse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:10.492 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:10.617 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-dashboard (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:10.690 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T07:47:10.691 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T07:47:10.777 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-volume (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:11.180 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libcephfs-dev (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:11.230 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T07:47:11.297 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rados (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:11.423 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librgw2 (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:11.525 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T07:47:11.549 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T07:47:11.686 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T07:47:12.753 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T07:47:12.828 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rbd (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:12.954 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up rbd-fuse (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:13.080 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rgw (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:13.205 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cephfs (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:13.331 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-common (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:13.424 INFO:teuthology.orchestra.run.smithi053.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T07:47:13.429 DEBUG:teuthology.parallel:result is None 2024-04-26T07:47:13.883 INFO:teuthology.orchestra.run.smithi191.stdout:Adding group ceph....done 2024-04-26T07:47:14.175 INFO:teuthology.orchestra.run.smithi191.stdout:Adding system user ceph....done 2024-04-26T07:47:14.319 INFO:teuthology.orchestra.run.smithi191.stdout:Setting system user ceph properties....done 2024-04-26T07:47:14.339 INFO:teuthology.orchestra.run.smithi191.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T07:47:14.496 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T07:47:14.836 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T07:47:15.307 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-test (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:15.434 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up radosgw (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:15.893 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T07:47:15.893 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T07:47:16.343 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-base (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:16.680 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T07:47:17.483 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mds (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:17.708 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T07:47:17.708 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T07:47:18.184 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T07:47:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T07:47:18.844 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-osd (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:19.125 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T07:47:19.125 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T07:47:19.612 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:19.721 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:19.872 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mon (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:20.085 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T07:47:20.085 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T07:47:20.581 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-cephadm (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:20.732 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:20.859 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-dashboard (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:20.985 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-volume (19.0.0-3092-g5bfac0af-1jammy) ... 2024-04-26T07:47:21.337 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T07:47:21.430 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T07:47:21.557 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T07:47:22.640 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T07:47:23.254 INFO:teuthology.orchestra.run.smithi191.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T07:47:23.259 DEBUG:teuthology.parallel:result is None 2024-04-26T07:47:23.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:47:23.406 DEBUG:teuthology.orchestra.run.smithi053:> dpkg-query -W -f '${Version}' ceph 2024-04-26T07:47:23.427 INFO:teuthology.orchestra.run.smithi053.stdout:19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:47:23.427 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:47:23.427 INFO:teuthology.task.install:The correct ceph version 19.0.0-3092-g5bfac0af-1jammy is installed. 2024-04-26T07:47:23.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:47:23.569 DEBUG:teuthology.orchestra.run.smithi191:> dpkg-query -W -f '${Version}' ceph 2024-04-26T07:47:23.588 INFO:teuthology.orchestra.run.smithi191.stdout:19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:47:23.589 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3092-g5bfac0af-1jammy 2024-04-26T07:47:23.589 INFO:teuthology.task.install:The correct ceph version 19.0.0-3092-g5bfac0af-1jammy is installed. 2024-04-26T07:47:23.590 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T07:47:23.591 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:23.591 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T07:47:23.605 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:23.605 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T07:47:23.646 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T07:47:23.646 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:23.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T07:47:23.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T07:47:23.716 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:23.716 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T07:47:23.729 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T07:47:23.785 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T07:47:23.785 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:23.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T07:47:23.799 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T07:47:23.852 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:23.852 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T07:47:23.865 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T07:47:23.920 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T07:47:23.920 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:23.920 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T07:47:23.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T07:47:23.989 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:23.989 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T07:47:24.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T07:47:24.055 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T07:47:24.138 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T07:47:24.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-04-26T07:47:24.141 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2024-04-26T07:47:24.153 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T07:47:24.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T07:47:24.198 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T07:47:24.210 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T07:47:24.211 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T07:47:24.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T07:47:24.275 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T07:47:24.276 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T07:47:24.276 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619', 'branch': 'fix_error_message_flow', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': 'gsalomon@redhat.com', 'first_in_suite': False, 'job_id': '7674619', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'fix_error_message_flow'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'fix_non_handled_error_resonse', 'git_remote': 'https://github.com/galsalomon66/'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'fix_error_message_flow', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}}, 'owner': 'scheduled_gsalomon@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 8229, 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'fix_error_message_flow', 'suite_path': '/home/teuthworker/src/github.com_galsalomon66_ceph_5bfac0af933f1833ec096c3048e2c80e20507e52/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/galsalomon66/ceph', 'suite_sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52', 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK2NDFCCrWKISak/JGe3xCYCgZBaXcSu0QQmjLnX2D9oV1t7gds1lvqbfwf43GgiFDsTlS2W8pAc4h3UwFLLLvU=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK7R2hOArHMu8L81fTESMeoNqqLkl1u5hxML9r8X5sDr2eaQJtktWSNXP5D09f4PvUyvKKYfKMprDDVSrgEaPao='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_07:23:10', 'tube': 'smithi', 'user': 'gsalomon', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T07:47:24.276 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T07:47:24.310 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T07:47:24.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T07:47:24.358 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T07:47:24.370 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:24.371 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T07:47:24.417 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T07:47:24.417 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-04-26T07:47:24.467 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T07:47:24.467 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:47:24.467 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-04-26T07:47:24.467 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:47:24.467 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-04-26 07:41:56.872269709 +0000 2024-04-26T07:47:24.467 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-04-26 07:41:56.604272099 +0000 2024-04-26T07:47:24.467 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-04-26 07:41:56.604272099 +0000 2024-04-26T07:47:24.467 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-04-26T07:47:24.468 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T07:47:24.519 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-04-26T07:47:24.519 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-04-26T07:47:24.519 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.00031269 s, 1.6 MB/s 2024-04-26T07:47:24.521 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T07:47:24.570 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-04-26T07:47:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T07:47:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:47:24.618 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-26T07:47:24.618 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:47:24.618 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-04-26 07:41:57.392265069 +0000 2024-04-26T07:47:24.618 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-04-26 07:41:57.104267638 +0000 2024-04-26T07:47:24.618 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-04-26 07:41:57.104267638 +0000 2024-04-26T07:47:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-04-26T07:47:24.619 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T07:47:24.671 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-04-26T07:47:24.671 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-04-26T07:47:24.671 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.00025281 s, 2.0 MB/s 2024-04-26T07:47:24.673 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T07:47:24.722 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-04-26T07:47:24.768 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T07:47:24.769 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:47:24.769 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-26T07:47:24.769 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:47:24.769 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-04-26 07:41:57.888260644 +0000 2024-04-26T07:47:24.769 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-04-26 07:41:57.636262893 +0000 2024-04-26T07:47:24.769 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-04-26 07:41:57.636262893 +0000 2024-04-26T07:47:24.769 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-04-26T07:47:24.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T07:47:24.823 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-04-26T07:47:24.823 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-04-26T07:47:24.823 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000297657 s, 1.7 MB/s 2024-04-26T07:47:24.825 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T07:47:24.874 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-04-26T07:47:24.921 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T07:47:24.921 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:47:24.921 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-26T07:47:24.921 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:47:24.921 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-04-26 07:41:58.372256326 +0000 2024-04-26T07:47:24.921 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-04-26 07:41:58.128258504 +0000 2024-04-26T07:47:24.921 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-04-26 07:41:58.128258504 +0000 2024-04-26T07:47:24.921 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-04-26T07:47:24.921 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T07:47:24.975 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-04-26T07:47:24.975 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-04-26T07:47:24.975 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000301724 s, 1.7 MB/s 2024-04-26T07:47:24.977 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T07:47:25.027 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:25.027 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:25.027 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T07:47:25.033 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T07:47:25.033 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-04-26T07:47:25.082 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T07:47:25.082 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:47:25.082 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-04-26T07:47:25.082 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:47:25.082 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-26 07:41:44.401604595 +0000 2024-04-26T07:47:25.082 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-26 07:41:44.125607057 +0000 2024-04-26T07:47:25.083 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-26 07:41:44.125607057 +0000 2024-04-26T07:47:25.083 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2024-04-26T07:47:25.083 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T07:47:25.135 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-26T07:47:25.135 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-26T07:47:25.136 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000444467 s, 1.2 MB/s 2024-04-26T07:47:25.137 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T07:47:25.186 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-04-26T07:47:25.233 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T07:47:25.233 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:47:25.233 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-04-26T07:47:25.233 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:47:25.233 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-26 07:41:44.893600207 +0000 2024-04-26T07:47:25.233 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-26 07:41:44.633602527 +0000 2024-04-26T07:47:25.233 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-26 07:41:44.633602527 +0000 2024-04-26T07:47:25.233 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2024-04-26T07:47:25.233 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T07:47:25.287 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-26T07:47:25.287 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-26T07:47:25.287 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000446303 s, 1.1 MB/s 2024-04-26T07:47:25.288 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T07:47:25.338 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-04-26T07:47:25.385 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T07:47:25.385 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:47:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-04-26T07:47:25.385 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:47:25.386 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-26 07:41:45.369595960 +0000 2024-04-26T07:47:25.386 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-26 07:41:45.125598138 +0000 2024-04-26T07:47:25.386 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-26 07:41:45.125598138 +0000 2024-04-26T07:47:25.386 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2024-04-26T07:47:25.386 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T07:47:25.439 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-26T07:47:25.439 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-26T07:47:25.439 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.00038345 s, 1.3 MB/s 2024-04-26T07:47:25.441 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T07:47:25.491 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-04-26T07:47:25.537 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T07:47:25.537 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T07:47:25.537 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-04-26T07:47:25.537 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T07:47:25.537 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-26 07:41:45.865591535 +0000 2024-04-26T07:47:25.537 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-26 07:41:45.601593890 +0000 2024-04-26T07:47:25.537 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-26 07:41:45.601593890 +0000 2024-04-26T07:47:25.537 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2024-04-26T07:47:25.537 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T07:47:25.595 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-26T07:47:25.596 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-26T07:47:25.596 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000326554 s, 1.6 MB/s 2024-04-26T07:47:25.597 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T07:47:25.647 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:25.647 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T07:47:25.647 INFO:tasks.ceph:Generating config... 2024-04-26T07:47:25.648 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-04-26T07:47:25.648 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T07:47:25.648 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T07:47:25.648 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T07:47:25.648 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T07:47:25.648 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T07:47:25.648 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T07:47:25.648 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T07:47:25.648 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T07:47:25.649 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-26T07:47:25.649 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T07:47:25.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T07:47:25.685 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T07:47:25.699 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T07:47:25.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:47:25.827 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53'), ('mon.c', '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]'), ('mon.b', '172.21.15.191')] 2024-04-26T07:47:25.827 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],172.21.15.191'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-26T07:47:25.828 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:25.828 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T07:47:25.873 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --addv c '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]' --add b 172.21.15.191 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:25.954 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:25.954 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid 49487ed9-d16e-45ed-bfa2-5a4b8da36b24 2024-04-26T07:47:25.954 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = quincy 2024-04-26T07:47:25.954 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2024-04-26T07:47:25.954 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 49487ed9-d16e-45ed-bfa2-5a4b8da36b24 2024-04-26T07:47:25.954 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2024-04-26T07:47:25.957306+0000 2024-04-26T07:47:25.954 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-04-26T07:47:25.957306+0000 2024-04-26T07:47:25.954 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 17 (quincy) 2024-04-26T07:47:25.955 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2024-04-26T07:47:25.955 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-04-26T07:47:25.955 INFO:teuthology.orchestra.run.smithi053.stdout:1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-04-26T07:47:25.955 INFO:teuthology.orchestra.run.smithi053.stdout:2: [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] mon.c 2024-04-26T07:47:25.955 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T07:47:25.956 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T07:47:26.004 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 49487ed9-d16e-45ed-bfa2-5a4b8da36b24... 2024-04-26T07:47:26.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T07:47:26.050 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-04-26T07:47:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-04-26T07:47:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],172.21.15.191" 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 49487ed9-d16e-45ed-bfa2-5a4b8da36b24 2024-04-26T07:47:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2024-04-26T07:47:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: osd blocked scrub grace period = 3600 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: osd max markdown count = 1000 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: osd shutdown pgref assert = True 2024-04-26T07:47:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-04-26T07:47:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-04-26T07:47:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: rgw relaxed s3 bucket names = True 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2024-04-26T07:47:26.087 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.088 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T07:47:26.089 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],172.21.15.191" 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = 49487ed9-d16e-45ed-bfa2-5a4b8da36b24 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.090 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug trim objects = true 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2024-04-26T07:47:26.091 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore allocator = bitmap 2024-04-26T07:47:26.092 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: osd blocked scrub grace period = 3600 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: osd max markdown count = 1000 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: osd shutdown pgref assert = True 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2024-04-26T07:47:26.093 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2024-04-26T07:47:26.094 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.095 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout: rgw relaxed s3 bucket names = True 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2024-04-26T07:47:26.096 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2024-04-26T07:47:26.097 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T07:47:26.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T07:47:26.191 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T07:47:26.191 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:26.191 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T07:47:26.197 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:26.197 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T07:47:26.245 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:47:26.245 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:26.245 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T07:47:26.245 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:47:26.309 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:26.310 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:26.357 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:47:26.357 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:26.357 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T07:47:26.357 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T07:47:26.380 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:26.380 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:26.429 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T07:47:26.429 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T07:47:26.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T07:47:26.475 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T07:47:26.478 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T07:47:26.518 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T07:47:26.532 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T07:47:26.532 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T07:47:26.532 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T07:47:26.567 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T07:47:26.578 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T07:47:26.612 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T07:47:26.622 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T07:47:26.622 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T07:47:26.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T07:47:26.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:26.635 INFO:tasks.ceph:role: osd.0 2024-04-26T07:47:26.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:47:26.635 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:47:26.689 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:47:26.713 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-04-26T07:47:26.715 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-04-26T07:47:26.715 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T07:47:26.771 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T07:47:26.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:26.821 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T07:47:26.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T07:47:26.874 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:26.874 INFO:tasks.ceph:role: osd.1 2024-04-26T07:47:26.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:47:26.875 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:47:26.929 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:47:26.952 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-04-26T07:47:26.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-04-26T07:47:26.954 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T07:47:27.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T07:47:27.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:27.070 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T07:47:27.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T07:47:27.122 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:27.122 INFO:tasks.ceph:role: osd.2 2024-04-26T07:47:27.122 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:47:27.122 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:47:27.176 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:47:27.177 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:47:27.200 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-04-26T07:47:27.202 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-04-26T07:47:27.202 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T07:47:27.260 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T07:47:27.315 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T07:47:27.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:27.316 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T07:47:27.369 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:27.369 INFO:tasks.ceph:role: osd.3 2024-04-26T07:47:27.369 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:47:27.369 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:47:27.425 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:47:27.448 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-04-26T07:47:27.450 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-04-26T07:47:27.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T07:47:27.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T07:47:27.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:27.563 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T07:47:27.563 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:27.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:27.664+0000 7f0cb05ab7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T07:47:27.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:27.664+0000 7f0cb05ab7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T07:47:27.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:27.664+0000 7f0cb05ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:47:27.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:27.664+0000 7f0cb05ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:47:27.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:27.664+0000 7f0cb05ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T07:47:27.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:27.664+0000 7f0cb05ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T07:47:30.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T07:47:30.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:30.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:30.756+0000 7fa4b76067c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T07:47:30.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:30.756+0000 7fa4b76067c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T07:47:30.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:30.756+0000 7fa4b76067c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:47:30.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:30.756+0000 7fa4b76067c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:47:30.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:30.756+0000 7fa4b76067c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T07:47:30.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:30.756+0000 7fa4b76067c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T07:47:33.720 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T07:47:33.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:33.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:33.860+0000 7f76621387c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T07:47:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:33.860+0000 7f76621387c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T07:47:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:33.860+0000 7f76621387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:47:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:33.860+0000 7f76621387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:47:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:33.860+0000 7f76621387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T07:47:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:33.860+0000 7f76621387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T07:47:36.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T07:47:36.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:37.000+0000 7f7b3ffb07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T07:47:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:37.000+0000 7f7b3ffb07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T07:47:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:37.000+0000 7f7b3ffb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:47:37.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:37.000+0000 7f7b3ffb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:47:37.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:37.000+0000 7f7b3ffb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T07:47:37.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-26T07:47:37.000+0000 7f7b3ffb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T07:47:39.997 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T07:47:40.054 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T07:47:40.069 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:40.069 INFO:tasks.ceph:role: osd.4 2024-04-26T07:47:40.069 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:47:40.069 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T07:47:40.133 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:47:40.133 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:47:40.133 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:47:40.133 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:47:40.134 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:47:40.134 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:47:40.134 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:47:40.134 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:47:40.134 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:47:40.134 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:47:40.585 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-26T07:47:40.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-26T07:47:40.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T07:47:40.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T07:47:40.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:40.689 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T07:47:40.690 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T07:47:40.742 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:40.742 INFO:tasks.ceph:role: osd.5 2024-04-26T07:47:40.742 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:47:40.742 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T07:47:40.807 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:47:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:47:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:47:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:47:40.808 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:47:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:47:40.808 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:47:40.808 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:47:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:47:40.808 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:47:41.268 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-26T07:47:41.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-26T07:47:41.270 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T07:47:41.427 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T07:47:41.438 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T07:47:41.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:41.439 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T07:47:41.492 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:41.492 INFO:tasks.ceph:role: osd.6 2024-04-26T07:47:41.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:47:41.493 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T07:47:41.556 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:47:41.557 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:47:42.036 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-26T07:47:42.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-26T07:47:42.038 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T07:47:42.185 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T07:47:42.195 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T07:47:42.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:42.196 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T07:47:42.253 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T07:47:42.254 INFO:tasks.ceph:role: osd.7 2024-04-26T07:47:42.254 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:47:42.254 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T07:47:42.316 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T07:47:42.316 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T07:47:42.316 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T07:47:42.317 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T07:47:42.317 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T07:47:42.317 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-26T07:47:42.317 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T07:47:42.317 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T07:47:42.317 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T07:47:42.317 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T07:47:42.739 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-26T07:47:42.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-26T07:47:42.741 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T07:47:42.842 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T07:47:42.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:47:42.852 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T07:47:42.852 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:42.963 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:42.959+0000 7f1dc7c8e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T07:47:42.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:42.967+0000 7f1dc7c8e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T07:47:42.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:42.967+0000 7f1dc7c8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T07:47:42.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:42.967+0000 7f1dc7c8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T07:47:42.970 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:42.967+0000 7f1dc7c8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T07:47:42.970 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:42.967+0000 7f1dc7c8e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T07:47:45.946 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T07:47:45.960 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:46.043 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:46.039+0000 7fb00ccba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T07:47:46.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:46.039+0000 7fb00ccba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T07:47:46.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:46.039+0000 7fb00ccba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T07:47:46.045 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:46.039+0000 7fb00ccba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T07:47:46.045 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:46.039+0000 7fb00ccba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T07:47:46.045 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:46.043+0000 7fb00ccba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T07:47:49.032 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T07:47:49.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:49.165 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:49.163+0000 7f726bc767c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T07:47:49.166 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:49.163+0000 7f726bc767c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T07:47:49.166 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:49.163+0000 7f726bc767c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T07:47:49.166 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:49.163+0000 7f726bc767c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T07:47:49.166 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:49.163+0000 7f726bc767c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T07:47:49.167 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:49.163+0000 7f726bc767c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T07:47:52.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T07:47:52.198 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:52.279 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:52.275+0000 7fb8a128d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T07:47:52.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:52.275+0000 7fb8a128d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T07:47:52.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:52.275+0000 7fb8a128d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T07:47:52.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:52.275+0000 7fb8a128d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T07:47:52.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:52.275+0000 7fb8a128d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T07:47:52.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-26T07:47:52.279+0000 7fb8a128d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T07:47:55.250 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T07:47:55.305 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T07:47:55.305 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:55.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T07:47:55.320 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:55.320 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T07:47:55.376 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:55.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T07:47:55.432 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:55.432 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T07:47:55.492 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:55.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T07:47:55.548 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:55.549 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T07:47:55.562 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:55.562 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T07:47:55.616 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:55.616 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T07:47:55.673 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:55.673 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T07:47:55.727 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:55.727 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T07:47:55.780 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:47:55.781 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T07:47:55.786 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:47:55.787 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T07:47:55.829 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T07:47:55.829 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T07:47:55.831 DEBUG:teuthology.orchestra.run.smithi191:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T07:47:55.874 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2024-04-26T07:47:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAOXCtm0z+EHBAAzCItTX3+Y5CqrNvecMD/ag== 2024-04-26T07:47:55.874 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAPXCtmSvXqJxAAISh8+iQOF+kNmRPBXePV3A== 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQASXCtmdqJPLRAAJZqzEz8msqcctt5QuEE37A== 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAVXCtmX+qLMxAAUQdWtO4dg3qeuYI4q5vSlA== 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAZXCtmkIBGABAAHS0WfSW550D1emJ7XCCOWg== 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAOXCtmTwT4HhAAggD/d4ByYSLQUlLBc8YP3A== 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAeXCtm8+VzORAA+dfO51YzB4PXus/hFMouVA== 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2024-04-26T07:47:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAiXCtmjJaeAhAA+l+15FNk/sJ//prSTOHCpg== 2024-04-26T07:47:55.876 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2024-04-26T07:47:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAlXCtmVB/uCRAAJqp/hAbywgYifH9zJTbLHg== 2024-04-26T07:47:55.876 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2024-04-26T07:47:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAoXCtmxpawEBAA5UGIP1BJa0iO7Z2FfPDxkA== 2024-04-26T07:47:55.876 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-04-26T07:47:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAOXCtmkF8EIhAAnzSZEDWDrJyGRm7ZTfRnGg== 2024-04-26T07:47:55.876 INFO:teuthology.orchestra.run.smithi053.stdout:[client.1] 2024-04-26T07:47:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQAOXCtm5YSJJBAAkBLZEG9UYiaCwnZg219uyw== 2024-04-26T07:47:55.882 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.y] 2024-04-26T07:47:55.882 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAOXCtm0z+EHBAAzCItTX3+Y5CqrNvecMD/ag== 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAPXCtmSvXqJxAAISh8+iQOF+kNmRPBXePV3A== 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQASXCtmdqJPLRAAJZqzEz8msqcctt5QuEE37A== 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAVXCtmX+qLMxAAUQdWtO4dg3qeuYI4q5vSlA== 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.3] 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAZXCtmkIBGABAAHS0WfSW550D1emJ7XCCOWg== 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.x] 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAOXCtmTwT4HhAAggD/d4ByYSLQUlLBc8YP3A== 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.4] 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAeXCtm8+VzORAA+dfO51YzB4PXus/hFMouVA== 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.5] 2024-04-26T07:47:55.883 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAiXCtmjJaeAhAA+l+15FNk/sJ//prSTOHCpg== 2024-04-26T07:47:55.884 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.6] 2024-04-26T07:47:55.884 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAlXCtmVB/uCRAAJqp/hAbywgYifH9zJTbLHg== 2024-04-26T07:47:55.884 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.7] 2024-04-26T07:47:55.884 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAoXCtmxpawEBAA5UGIP1BJa0iO7Z2FfPDxkA== 2024-04-26T07:47:55.884 INFO:teuthology.orchestra.run.smithi191.stdout:[client.0] 2024-04-26T07:47:55.884 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAOXCtmkF8EIhAAnzSZEDWDrJyGRm7ZTfRnGg== 2024-04-26T07:47:55.884 INFO:teuthology.orchestra.run.smithi191.stdout:[client.1] 2024-04-26T07:47:55.884 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAOXCtm5YSJJBAAkBLZEG9UYiaCwnZg219uyw== 2024-04-26T07:47:55.885 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T07:47:55.921 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T07:47:55.972 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:55.974 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T07:47:56.317 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T07:47:56.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.402 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.485 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.563 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.565 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.643 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T07:47:56.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T07:47:56.730 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T07:47:56.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T07:47:56.806 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T07:47:56.895 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T07:47:56.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T07:47:56.908 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T07:47:57.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T07:47:57.015 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T07:47:57.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T07:47:57.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T07:47:57.167 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T07:47:57.181 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T07:47:57.273 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T07:47:57.284 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:57.286 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T07:47:57.332 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T07:47:57.332 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T07:47:57.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T07:47:57.335 INFO:tasks.ceph.mon.a:Started 2024-04-26T07:47:57.335 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T07:47:57.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T07:47:57.337 INFO:tasks.ceph.mon.c:Started 2024-04-26T07:47:57.337 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T07:47:57.337 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T07:47:57.378 INFO:tasks.ceph.mon.b:Started 2024-04-26T07:47:57.378 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T07:47:57.378 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T07:47:57.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T07:47:57.380 INFO:tasks.ceph.mgr.y:Started 2024-04-26T07:47:57.380 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T07:47:57.381 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T07:47:57.383 INFO:tasks.ceph.mgr.x:Started 2024-04-26T07:47:57.383 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T07:47:57.383 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T07:48:02.909 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-04-26T07:48:02.928 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T07:48:02.928 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T07:48:02.929 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:48:02.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T07:48:02.940 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:48:02.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T07:48:02.998 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:48:02.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T07:48:03.053 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:48:03.053 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T07:48:03.061 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:03.060+0000 7f963d898180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T07:48:03.071 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:48:03.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T07:48:03.086 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:48:03.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T07:48:03.141 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:48:03.141 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T07:48:03.196 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-26T07:48:03.196 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T07:48:03.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 6c19b301-d4c3-4075-aea7-ab2ee53aaf3a 0 2024-04-26T07:48:03.282 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:03.279+0000 7fb3dca0c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T07:48:03.499 INFO:teuthology.orchestra.run.smithi191.stdout:0 2024-04-26T07:48:03.515 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 639db176-ee73-4aa3-aa4b-e1e713fb0026 1 2024-04-26T07:48:03.622 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:03.620+0000 7f963d898180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T07:48:03.788 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-04-26T07:48:03.814 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new f2832add-3da3-4a41-b7eb-80c0b58a6166 2 2024-04-26T07:48:03.837 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:03.836+0000 7f963d898180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T07:48:03.869 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:03.867+0000 7fb3dca0c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T07:48:04.020 INFO:teuthology.orchestra.run.smithi191.stdout:2 2024-04-26T07:48:04.038 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new e532d54a-ed1f-4177-8289-2eea90fe5d27 3 2024-04-26T07:48:04.085 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:04.083+0000 7fb3dca0c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T07:48:04.242 INFO:teuthology.orchestra.run.smithi191.stdout:3 2024-04-26T07:48:04.258 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 17337c8b-3ed8-41fb-900b-e7068a4cc2e4 4 2024-04-26T07:48:04.420 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:04.420+0000 7f963d898180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T07:48:04.458 INFO:teuthology.orchestra.run.smithi191.stdout:4 2024-04-26T07:48:04.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 99310d57-c1a3-4935-9bbf-908dd237036d 5 2024-04-26T07:48:04.477 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:04.476+0000 7f963d898180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T07:48:04.533 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:04.532+0000 7f963d898180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T07:48:04.614 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:04.612+0000 7f963d898180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T07:48:04.654 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:04.651+0000 7fb3dca0c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T07:48:04.668 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:04.668+0000 7f963d898180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T07:48:04.676 INFO:teuthology.orchestra.run.smithi191.stdout:5 2024-04-26T07:48:04.693 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 2fef5c6a-e83d-4ab2-b571-794295b6fe31 6 2024-04-26T07:48:04.712 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:04.707+0000 7fb3dca0c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T07:48:04.750 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:04.748+0000 7f963d898180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T07:48:04.766 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:04.763+0000 7fb3dca0c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T07:48:04.807 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:04.804+0000 7f963d898180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T07:48:04.846 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:04.843+0000 7fb3dca0c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T07:48:04.887 INFO:teuthology.orchestra.run.smithi191.stdout:6 2024-04-26T07:48:04.900 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:04.899+0000 7fb3dca0c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T07:48:04.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 82fb2b9a-7a8d-4af8-ab0e-94da703625ef 7 2024-04-26T07:48:04.966 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:04.964+0000 7f963d898180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T07:48:04.978 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:04.975+0000 7fb3dca0c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T07:48:05.030 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:05.028+0000 7f963d898180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T07:48:05.032 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:05.031+0000 7fb3dca0c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T07:48:05.145 INFO:teuthology.orchestra.run.smithi191.stdout:7 2024-04-26T07:48:05.162 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T07:48:05.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T07:48:05.165 INFO:tasks.ceph.osd.0:Started 2024-04-26T07:48:05.165 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T07:48:05.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T07:48:05.168 INFO:tasks.ceph.osd.1:Started 2024-04-26T07:48:05.168 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T07:48:05.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T07:48:05.170 INFO:tasks.ceph.osd.2:Started 2024-04-26T07:48:05.170 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T07:48:05.171 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T07:48:05.173 INFO:tasks.ceph.osd.3:Started 2024-04-26T07:48:05.173 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T07:48:05.173 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T07:48:05.187 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:05.183+0000 7fb3dca0c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T07:48:05.189 INFO:tasks.ceph.osd.4:Started 2024-04-26T07:48:05.189 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T07:48:05.189 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T07:48:05.191 INFO:tasks.ceph.osd.5:Started 2024-04-26T07:48:05.191 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T07:48:05.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T07:48:05.193 INFO:tasks.ceph.osd.6:Started 2024-04-26T07:48:05.193 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T07:48:05.193 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T07:48:05.196 INFO:tasks.ceph.osd.7:Started 2024-04-26T07:48:05.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:48:05.277 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:05.275+0000 7fb3dca0c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T07:48:05.430 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:05.431 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","created":"2024-04-26T07:48:02.780799+0000","modified":"2024-04-26T07:48:05.145685+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T07:48:05.145685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6c19b301-d4c3-4075-aea7-ab2ee53aaf3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"639db176-ee73-4aa3-aa4b-e1e713fb0026","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2832add-3da3-4a41-b7eb-80c0b58a6166","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e532d54a-ed1f-4177-8289-2eea90fe5d27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"17337c8b-3ed8-41fb-900b-e7068a4cc2e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"99310d57-c1a3-4935-9bbf-908dd237036d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2fef5c6a-e83d-4ab2-b571-794295b6fe31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"82fb2b9a-7a8d-4af8-ab0e-94da703625ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:48:05.448 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T07:48:05.448 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T07:48:05.703 INFO:tasks.ceph.mgr.y.smithi053.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T07:48:05.703 INFO:tasks.ceph.mgr.y.smithi053.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T07:48:05.703 INFO:tasks.ceph.mgr.y.smithi053.stderr: from numpy import show_config as show_numpy_config 2024-04-26T07:48:05.771 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:05.768+0000 7f963d898180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T07:48:05.802 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:05.800+0000 7fd8f13777c0 -1 Falling back to public interface 2024-04-26T07:48:05.803 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:05.800+0000 7f0f820b37c0 -1 Falling back to public interface 2024-04-26T07:48:05.803 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:05.800+0000 7f0f81073640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-26T07:48:05.805 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:05.803+0000 7f50206b47c0 -1 Falling back to public interface 2024-04-26T07:48:05.806 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:05.803+0000 7f19dd59e7c0 -1 Falling back to public interface 2024-04-26T07:48:05.813 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:05.812+0000 7fda594af7c0 -1 Falling back to public interface 2024-04-26T07:48:05.813 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:05.812+0000 7f75e5e927c0 -1 Falling back to public interface 2024-04-26T07:48:05.825 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:05.823+0000 7fbd7e6107c0 -1 Falling back to public interface 2024-04-26T07:48:05.825 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:05.823+0000 7f2cef8127c0 -1 Falling back to public interface 2024-04-26T07:48:05.951 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:05.948+0000 7f963d898180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T07:48:05.953 INFO:tasks.ceph.mgr.x.smithi191.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T07:48:05.954 INFO:tasks.ceph.mgr.x.smithi191.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T07:48:05.954 INFO:tasks.ceph.mgr.x.smithi191.stderr: from numpy import show_config as show_numpy_config 2024-04-26T07:48:06.028 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:06.027+0000 7fb3dca0c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T07:48:06.126 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:06.124+0000 7f963d898180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T07:48:06.198 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:06.196+0000 7f963d898180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T07:48:06.204 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:06.203+0000 7fb3dca0c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T07:48:06.254 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T07:48:06.351 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:06.348+0000 7f963d898180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T07:48:06.382 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:06.379+0000 7fb3dca0c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T07:48:06.447 INFO:teuthology.misc.health.smithi053.stdout: 2024-04-26T07:48:06.448 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":10,"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","created":"2024-04-26T07:48:02.780799+0000","modified":"2024-04-26T07:48:05.145685+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T07:48:05.145685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6c19b301-d4c3-4075-aea7-ab2ee53aaf3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"639db176-ee73-4aa3-aa4b-e1e713fb0026","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2832add-3da3-4a41-b7eb-80c0b58a6166","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e532d54a-ed1f-4177-8289-2eea90fe5d27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"17337c8b-3ed8-41fb-900b-e7068a4cc2e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"99310d57-c1a3-4935-9bbf-908dd237036d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2fef5c6a-e83d-4ab2-b571-794295b6fe31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"82fb2b9a-7a8d-4af8-ab0e-94da703625ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:48:06.452 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:06.451+0000 7fb3dca0c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T07:48:06.464 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T07:48:06.600 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:06.595+0000 7fb3dca0c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T07:48:07.025 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:07.024+0000 7f963d898180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T07:48:07.104 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:07.104+0000 7f963d898180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T07:48:07.235 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:07.231+0000 7fb3dca0c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T07:48:07.294 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:07.292+0000 7f963d898180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T07:48:07.310 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:07.307+0000 7fb3dca0c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T07:48:07.372 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:07.372+0000 7f963d898180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T07:48:07.492 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:07.487+0000 7fb3dca0c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T07:48:07.565 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:07.563+0000 7fb3dca0c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T07:48:07.677 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:07.676+0000 7f963d898180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T07:48:07.742 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:07.740+0000 7f963d898180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T07:48:07.857 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:07.855+0000 7fb3dca0c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T07:48:07.919 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-26T07:48:07.915+0000 7fb3dca0c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T07:48:08.789 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:08.788+0000 7f95e4ce1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T07:48:08.789 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-04-26T07:48:08.788+0000 7f95e4ce1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T07:48:09.609 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:09.607+0000 7f50206b47c0 -1 osd.5 0 log_to_monitors true 2024-04-26T07:48:09.611 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:09.607+0000 7f19dd59e7c0 -1 osd.6 0 log_to_monitors true 2024-04-26T07:48:09.665 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:09.664+0000 7f0f820b37c0 -1 osd.3 0 log_to_monitors true 2024-04-26T07:48:09.719 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:09.716+0000 7fd8f13777c0 -1 osd.1 0 log_to_monitors true 2024-04-26T07:48:09.720 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:09.719+0000 7fbd7e6107c0 -1 osd.4 0 log_to_monitors true 2024-04-26T07:48:09.735 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:09.731+0000 7f2cef8127c0 -1 osd.7 0 log_to_monitors true 2024-04-26T07:48:09.744 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:09.744+0000 7fda594af7c0 -1 osd.0 0 log_to_monitors true 2024-04-26T07:48:09.755 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:09.752+0000 7f75e5e927c0 -1 osd.2 0 log_to_monitors true 2024-04-26T07:48:12.403 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:12.400+0000 7f0f7e05c640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T07:48:12.412 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:12.412+0000 7fd8ed320640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T07:48:12.421 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:12.420+0000 7f75e264d640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T07:48:12.428 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:12.428+0000 7f0f75e90640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:48:12.436 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:12.436+0000 7fd8e5154640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:48:12.460 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:12.460+0000 7f75d9c6f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:48:12.462 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:12.460+0000 7fda55458640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T07:48:12.496 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:12.496+0000 7fda4d28c640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:48:12.916 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:12.911+0000 7f2cebfcd640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T07:48:12.937 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:12.935+0000 7f2ce35ef640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:48:12.950 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:12.947+0000 7f501c65d640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T07:48:12.977 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:12.975+0000 7f5014491640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:48:12.987 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:12.983+0000 7fbd7adcb640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T07:48:12.994 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:12.991+0000 7f19d9547640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T07:48:13.013 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:13.011+0000 7fbd723ed640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:48:13.025 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:13.023+0000 7f19d137b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T07:48:13.270 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T07:48:13.575 INFO:teuthology.misc.health.smithi053.stdout: 2024-04-26T07:48:13.575 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":13,"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","created":"2024-04-26T07:48:02.780799+0000","modified":"2024-04-26T07:48:13.428691+0000","last_up_change":"2024-04-26T07:48:13.428691+0000","last_in_change":"2024-04-26T07:48:05.145685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6c19b301-d4c3-4075-aea7-ab2ee53aaf3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6818","nonce":3522703831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6822","nonce":3522703831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6831","nonce":3522703831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6827","nonce":3522703831}]},"public_addr":"172.21.15.53:6818/3522703831","cluster_addr":"172.21.15.53:6822/3522703831","heartbeat_back_addr":"172.21.15.53:6831/3522703831","heartbeat_front_addr":"172.21.15.53:6827/3522703831","state":["exists","up"]},{"osd":1,"uuid":"639db176-ee73-4aa3-aa4b-e1e713fb0026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6802","nonce":4143904497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6806","nonce":4143904497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6814","nonce":4143904497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6810","nonce":4143904497}]},"public_addr":"172.21.15.53:6802/4143904497","cluster_addr":"172.21.15.53:6806/4143904497","heartbeat_back_addr":"172.21.15.53:6814/4143904497","heartbeat_front_addr":"172.21.15.53:6810/4143904497","state":["exists","up"]},{"osd":2,"uuid":"f2832add-3da3-4a41-b7eb-80c0b58a6166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6819","nonce":2446521991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6823","nonce":2446521991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6829","nonce":2446521991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6826","nonce":2446521991}]},"public_addr":"172.21.15.53:6819/2446521991","cluster_addr":"172.21.15.53:6823/2446521991","heartbeat_back_addr":"172.21.15.53:6829/2446521991","heartbeat_front_addr":"172.21.15.53:6826/2446521991","state":["exists","up"]},{"osd":3,"uuid":"e532d54a-ed1f-4177-8289-2eea90fe5d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6803","nonce":3123753498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6807","nonce":3123753498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6813","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6815","nonce":3123753498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6811","nonce":3123753498}]},"public_addr":"172.21.15.53:6803/3123753498","cluster_addr":"172.21.15.53:6807/3123753498","heartbeat_back_addr":"172.21.15.53:6815/3123753498","heartbeat_front_addr":"172.21.15.53:6811/3123753498","state":["exists","up"]},{"osd":4,"uuid":"17337c8b-3ed8-41fb-900b-e7068a4cc2e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6817","nonce":4225192245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6820","nonce":4225192245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6827","nonce":4225192245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6823","nonce":4225192245}]},"public_addr":"172.21.15.191:6817/4225192245","cluster_addr":"172.21.15.191:6820/4225192245","heartbeat_back_addr":"172.21.15.191:6827/4225192245","heartbeat_front_addr":"172.21.15.191:6823/4225192245","state":["exists","up"]},{"osd":5,"uuid":"99310d57-c1a3-4935-9bbf-908dd237036d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6801","nonce":1158804178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6803","nonce":1158804178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6808","nonce":1158804178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6805","nonce":1158804178}]},"public_addr":"172.21.15.191:6801/1158804178","cluster_addr":"172.21.15.191:6803/1158804178","heartbeat_back_addr":"172.21.15.191:6808/1158804178","heartbeat_front_addr":"172.21.15.191:6805/1158804178","state":["exists","up"]},{"osd":6,"uuid":"2fef5c6a-e83d-4ab2-b571-794295b6fe31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6809","nonce":451207779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6811","nonce":451207779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6815","nonce":451207779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6813","nonce":451207779}]},"public_addr":"172.21.15.191:6809/451207779","cluster_addr":"172.21.15.191:6811/451207779","heartbeat_back_addr":"172.21.15.191:6815/451207779","heartbeat_front_addr":"172.21.15.191:6813/451207779","state":["exists","up"]},{"osd":7,"uuid":"82fb2b9a-7a8d-4af8-ab0e-94da703625ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6819","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6821","nonce":2025100830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6826","nonce":2025100830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6831","nonce":2025100830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6829","nonce":2025100830}]},"public_addr":"172.21.15.191:6821/2025100830","cluster_addr":"172.21.15.191:6826/2025100830","heartbeat_back_addr":"172.21.15.191:6831/2025100830","heartbeat_front_addr":"172.21.15.191:6829/2025100830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:48:13.592 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T07:48:13.592 INFO:tasks.ceph:Creating RBD pool 2024-04-26T07:48:13.592 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T07:48:14.436 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2024-04-26T07:48:14.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T07:48:15.433 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T07:48:15.462 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T07:48:15.463 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T07:48:15.463 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T07:48:15.463 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T07:48:15.464 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T07:48:15.842 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:15.863 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":4,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1806926965},{"type":"v1","addr":"172.21.15.53:6833","nonce":1806926965}]},"active_addr":"172.21.15.53:6833/1806926965","active_change":"2024-04-26T07:48:07.766188+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1496647225}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":3512341971}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":430193293}]}]} 2024-04-26T07:48:15.870 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T07:48:15.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T07:48:15.870 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:48:16.157 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:16.157 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":15,"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","created":"2024-04-26T07:48:02.780799+0000","modified":"2024-04-26T07:48:15.433412+0000","last_up_change":"2024-04-26T07:48:13.428691+0000","last_in_change":"2024-04-26T07:48:05.145685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T07:48:13.824353+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:48:13.909036+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c19b301-d4c3-4075-aea7-ab2ee53aaf3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6818","nonce":3522703831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6822","nonce":3522703831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6831","nonce":3522703831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6827","nonce":3522703831}]},"public_addr":"172.21.15.53:6818/3522703831","cluster_addr":"172.21.15.53:6822/3522703831","heartbeat_back_addr":"172.21.15.53:6831/3522703831","heartbeat_front_addr":"172.21.15.53:6827/3522703831","state":["exists","up"]},{"osd":1,"uuid":"639db176-ee73-4aa3-aa4b-e1e713fb0026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6802","nonce":4143904497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6806","nonce":4143904497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6814","nonce":4143904497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6810","nonce":4143904497}]},"public_addr":"172.21.15.53:6802/4143904497","cluster_addr":"172.21.15.53:6806/4143904497","heartbeat_back_addr":"172.21.15.53:6814/4143904497","heartbeat_front_addr":"172.21.15.53:6810/4143904497","state":["exists","up"]},{"osd":2,"uuid":"f2832add-3da3-4a41-b7eb-80c0b58a6166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6819","nonce":2446521991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6823","nonce":2446521991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6829","nonce":2446521991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6826","nonce":2446521991}]},"public_addr":"172.21.15.53:6819/2446521991","cluster_addr":"172.21.15.53:6823/2446521991","heartbeat_back_addr":"172.21.15.53:6829/2446521991","heartbeat_front_addr":"172.21.15.53:6826/2446521991","state":["exists","up"]},{"osd":3,"uuid":"e532d54a-ed1f-4177-8289-2eea90fe5d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6803","nonce":3123753498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6807","nonce":3123753498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6813","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6815","nonce":3123753498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6811","nonce":3123753498}]},"public_addr":"172.21.15.53:6803/3123753498","cluster_addr":"172.21.15.53:6807/3123753498","heartbeat_back_addr":"172.21.15.53:6815/3123753498","heartbeat_front_addr":"172.21.15.53:6811/3123753498","state":["exists","up"]},{"osd":4,"uuid":"17337c8b-3ed8-41fb-900b-e7068a4cc2e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6817","nonce":4225192245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6820","nonce":4225192245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6827","nonce":4225192245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6823","nonce":4225192245}]},"public_addr":"172.21.15.191:6817/4225192245","cluster_addr":"172.21.15.191:6820/4225192245","heartbeat_back_addr":"172.21.15.191:6827/4225192245","heartbeat_front_addr":"172.21.15.191:6823/4225192245","state":["exists","up"]},{"osd":5,"uuid":"99310d57-c1a3-4935-9bbf-908dd237036d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6801","nonce":1158804178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6803","nonce":1158804178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6808","nonce":1158804178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6805","nonce":1158804178}]},"public_addr":"172.21.15.191:6801/1158804178","cluster_addr":"172.21.15.191:6803/1158804178","heartbeat_back_addr":"172.21.15.191:6808/1158804178","heartbeat_front_addr":"172.21.15.191:6805/1158804178","state":["exists","up"]},{"osd":6,"uuid":"2fef5c6a-e83d-4ab2-b571-794295b6fe31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6809","nonce":451207779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6811","nonce":451207779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6815","nonce":451207779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6813","nonce":451207779}]},"public_addr":"172.21.15.191:6809/451207779","cluster_addr":"172.21.15.191:6811/451207779","heartbeat_back_addr":"172.21.15.191:6815/451207779","heartbeat_front_addr":"172.21.15.191:6813/451207779","state":["exists","up"]},{"osd":7,"uuid":"82fb2b9a-7a8d-4af8-ab0e-94da703625ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6819","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6821","nonce":2025100830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6826","nonce":2025100830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6831","nonce":2025100830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6829","nonce":2025100830}]},"public_addr":"172.21.15.191:6821/2025100830","cluster_addr":"172.21.15.191:6826/2025100830","heartbeat_back_addr":"172.21.15.191:6831/2025100830","heartbeat_front_addr":"172.21.15.191:6829/2025100830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.773775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751251+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.671594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.697516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.606898+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.566440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.783389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:48:16.177 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T07:48:16.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:48:16.467 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:16.467 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","created":"2024-04-26T07:48:02.780799+0000","modified":"2024-04-26T07:48:16.445455+0000","last_up_change":"2024-04-26T07:48:13.428691+0000","last_in_change":"2024-04-26T07:48:05.145685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T07:48:13.824353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:48:13.909036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c19b301-d4c3-4075-aea7-ab2ee53aaf3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6818","nonce":3522703831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6822","nonce":3522703831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6831","nonce":3522703831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6827","nonce":3522703831}]},"public_addr":"172.21.15.53:6818/3522703831","cluster_addr":"172.21.15.53:6822/3522703831","heartbeat_back_addr":"172.21.15.53:6831/3522703831","heartbeat_front_addr":"172.21.15.53:6827/3522703831","state":["exists","up"]},{"osd":1,"uuid":"639db176-ee73-4aa3-aa4b-e1e713fb0026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6802","nonce":4143904497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6806","nonce":4143904497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6814","nonce":4143904497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6810","nonce":4143904497}]},"public_addr":"172.21.15.53:6802/4143904497","cluster_addr":"172.21.15.53:6806/4143904497","heartbeat_back_addr":"172.21.15.53:6814/4143904497","heartbeat_front_addr":"172.21.15.53:6810/4143904497","state":["exists","up"]},{"osd":2,"uuid":"f2832add-3da3-4a41-b7eb-80c0b58a6166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6819","nonce":2446521991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6823","nonce":2446521991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6829","nonce":2446521991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6826","nonce":2446521991}]},"public_addr":"172.21.15.53:6819/2446521991","cluster_addr":"172.21.15.53:6823/2446521991","heartbeat_back_addr":"172.21.15.53:6829/2446521991","heartbeat_front_addr":"172.21.15.53:6826/2446521991","state":["exists","up"]},{"osd":3,"uuid":"e532d54a-ed1f-4177-8289-2eea90fe5d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6803","nonce":3123753498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6807","nonce":3123753498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6813","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6815","nonce":3123753498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6811","nonce":3123753498}]},"public_addr":"172.21.15.53:6803/3123753498","cluster_addr":"172.21.15.53:6807/3123753498","heartbeat_back_addr":"172.21.15.53:6815/3123753498","heartbeat_front_addr":"172.21.15.53:6811/3123753498","state":["exists","up"]},{"osd":4,"uuid":"17337c8b-3ed8-41fb-900b-e7068a4cc2e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6817","nonce":4225192245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6820","nonce":4225192245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6827","nonce":4225192245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6823","nonce":4225192245}]},"public_addr":"172.21.15.191:6817/4225192245","cluster_addr":"172.21.15.191:6820/4225192245","heartbeat_back_addr":"172.21.15.191:6827/4225192245","heartbeat_front_addr":"172.21.15.191:6823/4225192245","state":["exists","up"]},{"osd":5,"uuid":"99310d57-c1a3-4935-9bbf-908dd237036d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6801","nonce":1158804178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6803","nonce":1158804178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6808","nonce":1158804178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6805","nonce":1158804178}]},"public_addr":"172.21.15.191:6801/1158804178","cluster_addr":"172.21.15.191:6803/1158804178","heartbeat_back_addr":"172.21.15.191:6808/1158804178","heartbeat_front_addr":"172.21.15.191:6805/1158804178","state":["exists","up"]},{"osd":6,"uuid":"2fef5c6a-e83d-4ab2-b571-794295b6fe31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6809","nonce":451207779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6811","nonce":451207779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6815","nonce":451207779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6813","nonce":451207779}]},"public_addr":"172.21.15.191:6809/451207779","cluster_addr":"172.21.15.191:6811/451207779","heartbeat_back_addr":"172.21.15.191:6815/451207779","heartbeat_front_addr":"172.21.15.191:6813/451207779","state":["exists","up"]},{"osd":7,"uuid":"82fb2b9a-7a8d-4af8-ab0e-94da703625ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6819","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6821","nonce":2025100830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6826","nonce":2025100830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6831","nonce":2025100830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6829","nonce":2025100830}]},"public_addr":"172.21.15.191:6821/2025100830","cluster_addr":"172.21.15.191:6826/2025100830","heartbeat_back_addr":"172.21.15.191:6831/2025100830","heartbeat_front_addr":"172.21.15.191:6829/2025100830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.773775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751251+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.671594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.697516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.606898+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.566440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.783389+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:48:16.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T07:48:16.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T07:48:16.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T07:48:16.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T07:48:16.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T07:48:16.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T07:48:16.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T07:48:16.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T07:48:16.738 INFO:teuthology.orchestra.run.smithi053.stdout:55834574850 2024-04-26T07:48:16.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:48:16.755 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:16.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T07:48:16.756 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:16.756 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:48:16.760 INFO:teuthology.orchestra.run.smithi053.stdout:55834574852 2024-04-26T07:48:16.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:48:16.762 INFO:teuthology.orchestra.run.smithi053.stdout:55834574850 2024-04-26T07:48:16.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T07:48:16.765 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:16.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:48:16.767 INFO:teuthology.orchestra.run.smithi053.stdout:55834574852 2024-04-26T07:48:16.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T07:48:16.770 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:16.771 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T07:48:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:55834574849 2024-04-26T07:48:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:55834574850 2024-04-26T07:48:17.297 INFO:teuthology.orchestra.run.smithi053.stdout:55834574849 2024-04-26T07:48:17.300 INFO:teuthology.orchestra.run.smithi053.stdout:55834574850 2024-04-26T07:48:17.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.0 2024-04-26T07:48:17.303 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:17.312 INFO:teuthology.orchestra.run.smithi053.stdout:55834574850 2024-04-26T07:48:17.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.7 2024-04-26T07:48:17.328 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:17.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.6 2024-04-26T07:48:17.335 INFO:teuthology.orchestra.run.smithi053.stdout:55834574850 2024-04-26T07:48:17.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2024-04-26T07:48:17.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-04-26T07:48:17.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2024-04-26T07:48:17.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-04-26T07:48:17.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2024-04-26T07:48:18.303 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:48:18.327 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T07:48:18.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T07:48:18.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:48:18.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:48:18.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:48:18.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T07:48:18.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T07:48:18.863 INFO:teuthology.orchestra.run.smithi053.stdout:55834574850 2024-04-26T07:48:18.867 INFO:teuthology.orchestra.run.smithi053.stdout:55834574850 2024-04-26T07:48:18.887 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:18.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.0 2024-04-26T07:48:18.888 DEBUG:teuthology.parallel:result is None 2024-04-26T07:48:18.893 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:18.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.6 2024-04-26T07:48:18.898 DEBUG:teuthology.parallel:result is None 2024-04-26T07:48:18.898 INFO:teuthology.orchestra.run.smithi053.stdout:55834574852 2024-04-26T07:48:18.899 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:18.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.3 2024-04-26T07:48:18.920 DEBUG:teuthology.parallel:result is None 2024-04-26T07:48:18.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2024-04-26T07:48:18.923 DEBUG:teuthology.parallel:result is None 2024-04-26T07:48:18.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-04-26T07:48:18.924 DEBUG:teuthology.parallel:result is None 2024-04-26T07:48:18.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2024-04-26T07:48:18.925 DEBUG:teuthology.parallel:result is None 2024-04-26T07:48:18.939 INFO:teuthology.orchestra.run.smithi053.stdout:55834574852 2024-04-26T07:48:18.952 INFO:teuthology.orchestra.run.smithi053.stdout:55834574851 2024-04-26T07:48:18.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-04-26T07:48:18.956 DEBUG:teuthology.parallel:result is None 2024-04-26T07:48:18.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.4 2024-04-26T07:48:18.969 DEBUG:teuthology.parallel:result is None 2024-04-26T07:48:18.969 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T07:48:18.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:48:19.287 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:19.287 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:48:19.304 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-04-26T07:48:17.779706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235748,"kb_used_data":2252,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738972,"statfs":{"total":773094113280,"available":772852707328,"internally_reserved":0,"allocated":2306048,"data_stored":1467678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.458440+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:48:15.458440+0000","last_peered":"2024-04-26T07:48:15.458440+0000","last_clean":"2024-04-26T07:48:15.458440+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:48:15.458440+0000","last_undegraded":"2024-04-26T07:48:15.458440+0000","last_fullsized":"2024-04-26T07:48:15.458440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.454653+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:48:15.454653+0000","last_peered":"2024-04-26T07:48:15.454653+0000","last_clean":"2024-04-26T07:48:15.454653+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:48:15.454653+0000","last_undegraded":"2024-04-26T07:48:15.454653+0000","last_fullsized":"2024-04-26T07:48:15.454653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:12.237357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T07:48:16.642954+0000","last_change":"2024-04-26T07:48:15.517260+0000","last_active":"2024-04-26T07:48:16.642954+0000","last_peered":"2024-04-26T07:48:16.642954+0000","last_clean":"2024-04-26T07:48:16.642954+0000","last_became_active":"2024-04-26T07:48:15.516567+0000","last_became_peered":"2024-04-26T07:48:15.516567+0000","last_unstale":"2024-04-26T07:48:16.642954+0000","last_undegraded":"2024-04-26T07:48:16.642954+0000","last_fullsized":"2024-04-26T07:48:16.642954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:31.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.520039+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:48:15.520039+0000","last_peered":"2024-04-26T07:48:15.520039+0000","last_clean":"2024-04-26T07:48:15.520039+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:48:15.520039+0000","last_undegraded":"2024-04-26T07:48:15.520039+0000","last_fullsized":"2024-04-26T07:48:15.520039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:45.174394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.458477+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:48:15.458477+0000","last_peered":"2024-04-26T07:48:15.458477+0000","last_clean":"2024-04-26T07:48:15.458477+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:48:15.458477+0000","last_undegraded":"2024-04-26T07:48:15.458477+0000","last_fullsized":"2024-04-26T07:48:15.458477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:45.174394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T07:48:16.457532+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:48:16.457532+0000","last_peered":"2024-04-26T07:48:16.457532+0000","last_clean":"2024-04-26T07:48:16.457532+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:48:16.457532+0000","last_undegraded":"2024-04-26T07:48:16.457532+0000","last_fullsized":"2024-04-26T07:48:16.457532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T07:48:16.642837+0000","last_change":"2024-04-26T07:48:15.450172+0000","last_active":"2024-04-26T07:48:16.642837+0000","last_peered":"2024-04-26T07:48:16.642837+0000","last_clean":"2024-04-26T07:48:16.642837+0000","last_became_active":"2024-04-26T07:48:15.449113+0000","last_became_peered":"2024-04-26T07:48:15.449113+0000","last_unstale":"2024-04-26T07:48:16.642837+0000","last_undegraded":"2024-04-26T07:48:16.642837+0000","last_fullsized":"2024-04-26T07:48:16.642837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:51.283507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.453607+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:48:15.453607+0000","last_peered":"2024-04-26T07:48:15.453607+0000","last_clean":"2024-04-26T07:48:15.453607+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:48:15.453607+0000","last_undegraded":"2024-04-26T07:48:15.453607+0000","last_fullsized":"2024-04-26T07:48:15.453607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:12.237357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T07:48:16.643010+0000","last_change":"2024-04-26T07:48:15.519242+0000","last_active":"2024-04-26T07:48:16.643010+0000","last_peered":"2024-04-26T07:48:16.643010+0000","last_clean":"2024-04-26T07:48:16.643010+0000","last_became_active":"2024-04-26T07:48:15.516846+0000","last_became_peered":"2024-04-26T07:48:15.516846+0000","last_unstale":"2024-04-26T07:48:16.643010+0000","last_undegraded":"2024-04-26T07:48:16.643010+0000","last_fullsized":"2024-04-26T07:48:16.643010+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:20.666857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":671744,"data_stored":566587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":737280,"data_stored":632135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:48:19.304 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:48:19.589 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:48:19.605 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-04-26T07:48:17.779706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235748,"kb_used_data":2252,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738972,"statfs":{"total":773094113280,"available":772852707328,"internally_reserved":0,"allocated":2306048,"data_stored":1467678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.458440+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:48:15.458440+0000","last_peered":"2024-04-26T07:48:15.458440+0000","last_clean":"2024-04-26T07:48:15.458440+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:48:15.458440+0000","last_undegraded":"2024-04-26T07:48:15.458440+0000","last_fullsized":"2024-04-26T07:48:15.458440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.454653+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:48:15.454653+0000","last_peered":"2024-04-26T07:48:15.454653+0000","last_clean":"2024-04-26T07:48:15.454653+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:48:15.454653+0000","last_undegraded":"2024-04-26T07:48:15.454653+0000","last_fullsized":"2024-04-26T07:48:15.454653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:12.237357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T07:48:16.642954+0000","last_change":"2024-04-26T07:48:15.517260+0000","last_active":"2024-04-26T07:48:16.642954+0000","last_peered":"2024-04-26T07:48:16.642954+0000","last_clean":"2024-04-26T07:48:16.642954+0000","last_became_active":"2024-04-26T07:48:15.516567+0000","last_became_peered":"2024-04-26T07:48:15.516567+0000","last_unstale":"2024-04-26T07:48:16.642954+0000","last_undegraded":"2024-04-26T07:48:16.642954+0000","last_fullsized":"2024-04-26T07:48:16.642954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:31.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.520039+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:48:15.520039+0000","last_peered":"2024-04-26T07:48:15.520039+0000","last_clean":"2024-04-26T07:48:15.520039+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:48:15.520039+0000","last_undegraded":"2024-04-26T07:48:15.520039+0000","last_fullsized":"2024-04-26T07:48:15.520039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:45.174394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.458477+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:48:15.458477+0000","last_peered":"2024-04-26T07:48:15.458477+0000","last_clean":"2024-04-26T07:48:15.458477+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:48:15.458477+0000","last_undegraded":"2024-04-26T07:48:15.458477+0000","last_fullsized":"2024-04-26T07:48:15.458477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:45.174394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T07:48:16.457532+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:48:16.457532+0000","last_peered":"2024-04-26T07:48:16.457532+0000","last_clean":"2024-04-26T07:48:16.457532+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:48:16.457532+0000","last_undegraded":"2024-04-26T07:48:16.457532+0000","last_fullsized":"2024-04-26T07:48:16.457532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T07:48:16.642837+0000","last_change":"2024-04-26T07:48:15.450172+0000","last_active":"2024-04-26T07:48:16.642837+0000","last_peered":"2024-04-26T07:48:16.642837+0000","last_clean":"2024-04-26T07:48:16.642837+0000","last_became_active":"2024-04-26T07:48:15.449113+0000","last_became_peered":"2024-04-26T07:48:15.449113+0000","last_unstale":"2024-04-26T07:48:16.642837+0000","last_undegraded":"2024-04-26T07:48:16.642837+0000","last_fullsized":"2024-04-26T07:48:16.642837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:51.283507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T07:48:15.453607+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:48:15.453607+0000","last_peered":"2024-04-26T07:48:15.453607+0000","last_clean":"2024-04-26T07:48:15.453607+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:48:15.453607+0000","last_undegraded":"2024-04-26T07:48:15.453607+0000","last_fullsized":"2024-04-26T07:48:15.453607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:12.237357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T07:48:16.643010+0000","last_change":"2024-04-26T07:48:15.519242+0000","last_active":"2024-04-26T07:48:16.643010+0000","last_peered":"2024-04-26T07:48:16.643010+0000","last_clean":"2024-04-26T07:48:16.643010+0000","last_became_active":"2024-04-26T07:48:15.516846+0000","last_became_peered":"2024-04-26T07:48:15.516846+0000","last_unstale":"2024-04-26T07:48:16.643010+0000","last_undegraded":"2024-04-26T07:48:16.643010+0000","last_fullsized":"2024-04-26T07:48:16.643010+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:20.666857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":671744,"data_stored":566587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":737280,"data_stored":632135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:48:19.606 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T07:48:19.606 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T07:48:19.606 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T07:48:19.606 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T07:48:19.927 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:19.928 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T07:48:19.945 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T07:48:19.945 INFO:teuthology.run_tasks:Running task rgw... 2024-04-26T07:48:19.964 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-26T07:48:19.964 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-26T07:48:19.964 INFO:tasks.rgw:Creating data pools 2024-04-26T07:48:19.964 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-26T07:48:19.964 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-04-26T07:48:20.472 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'default.rgw.buckets.data' created 2024-04-26T07:48:20.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-26T07:48:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-26T07:48:21.525 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-26T07:48:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'default.rgw.buckets.index' created 2024-04-26T07:48:22.533 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-26T07:48:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-26T07:48:23.569 DEBUG:tasks.rgw:Pools created 2024-04-26T07:48:23.569 INFO:tasks.rgw:Starting rgw... 2024-04-26T07:48:23.570 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-26T07:48:23.570 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-26T07:48:23.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo echo -n http://smithi053.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-26T07:48:23.582 INFO:teuthology.orchestra.run.smithi053.stdout:http://smithi053.front.sepia.ceph.com:80 2024-04-26T07:48:23.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-26T07:48:23.633 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-26T07:48:23.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-26T07:48:23.677 INFO:tasks.rgw.client.0:Started 2024-04-26T07:48:23.677 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi053.front.sepia.ceph.com:80/ 2024-04-26T07:48:23.677 DEBUG:teuthology.orchestra.run.smithi053:> curl http://smithi053.front.sepia.ceph.com:80/ 2024-04-26T07:48:23.715 INFO:teuthology.orchestra.run.smithi053.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:48:23.715 INFO:teuthology.orchestra.run.smithi053.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:48:23.715 INFO:teuthology.orchestra.run.smithi053.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T07:48:23.716 INFO:teuthology.orchestra.run.smithi053.stderr:curl: (7) Failed to connect to smithi053.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T07:48:23.716 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T07:48:24.717 DEBUG:teuthology.orchestra.run.smithi053:> curl http://smithi053.front.sepia.ceph.com:80/ 2024-04-26T07:48:24.729 INFO:teuthology.orchestra.run.smithi053.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:48:24.729 INFO:teuthology.orchestra.run.smithi053.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:48:24.729 INFO:teuthology.orchestra.run.smithi053.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T07:48:24.729 INFO:teuthology.orchestra.run.smithi053.stderr:curl: (7) Failed to connect to smithi053.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T07:48:24.730 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T07:48:26.731 DEBUG:teuthology.orchestra.run.smithi053:> curl http://smithi053.front.sepia.ceph.com:80/ 2024-04-26T07:48:26.743 INFO:teuthology.orchestra.run.smithi053.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:48:26.743 INFO:teuthology.orchestra.run.smithi053.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:48:26.743 INFO:teuthology.orchestra.run.smithi053.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T07:48:26.743 INFO:teuthology.orchestra.run.smithi053.stderr:curl: (7) Failed to connect to smithi053.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T07:48:26.744 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T07:48:30.745 DEBUG:teuthology.orchestra.run.smithi053:> curl http://smithi053.front.sepia.ceph.com:80/ 2024-04-26T07:48:30.757 INFO:teuthology.orchestra.run.smithi053.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:48:30.757 INFO:teuthology.orchestra.run.smithi053.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:48:30.757 INFO:teuthology.orchestra.run.smithi053.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T07:48:30.757 INFO:teuthology.orchestra.run.smithi053.stderr:curl: (7) Failed to connect to smithi053.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T07:48:30.757 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T07:48:32.748 INFO:tasks.rgw.client.0.smithi053.stdout:2024-04-26T07:48:32.748+0000 7f2fb8956a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-26T07:48:38.759 DEBUG:teuthology.orchestra.run.smithi053:> curl http://smithi053.front.sepia.ceph.com:80/ 2024-04-26T07:48:38.771 INFO:teuthology.orchestra.run.smithi053.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T07:48:38.771 INFO:teuthology.orchestra.run.smithi053.stderr: Dload Upload Total Spent Left Speed 2024-04-26T07:48:38.774 INFO:teuthology.orchestra.run.smithi053.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 52351 0 --:--:-- --:--:-- --:--:-- 62333 2024-04-26T07:48:38.775 INFO:teuthology.orchestra.run.smithi053.stdout:anonymous 2024-04-26T07:48:38.775 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T07:48:38.807 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T07:48:38.807 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'fix_error_message_flow'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'fix_non_handled_error_resonse', 'git_remote': 'https://github.com/galsalomon66/'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'fix_error_message_flow', 'sha1': '5bfac0af933f1833ec096c3048e2c80e20507e52'}} 2024-04-26T07:48:38.807 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T07:48:38.807 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T07:48:39.157 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T07:48:39.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T07:48:39.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:48:39.476 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:39.484 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:48:39.494 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-26T07:48:37.786911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":504,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240880,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733840,"statfs":{"total":773094113280,"available":772847452160,"internally_reserved":0,"allocated":4038656,"data_stored":2332030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.225121"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614655+0000","last_change":"2024-04-26T07:48:21.522910+0000","last_active":"2024-04-26T07:48:32.614655+0000","last_peered":"2024-04-26T07:48:32.614655+0000","last_clean":"2024-04-26T07:48:32.614655+0000","last_became_active":"2024-04-26T07:48:21.522270+0000","last_became_peered":"2024-04-26T07:48:21.522270+0000","last_unstale":"2024-04-26T07:48:32.614655+0000","last_undegraded":"2024-04-26T07:48:32.614655+0000","last_fullsized":"2024-04-26T07:48:32.614655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616751+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:48:32.616751+0000","last_peered":"2024-04-26T07:48:32.616751+0000","last_clean":"2024-04-26T07:48:32.616751+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:48:32.616751+0000","last_undegraded":"2024-04-26T07:48:32.616751+0000","last_fullsized":"2024-04-26T07:48:32.616751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610853+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:48:32.610853+0000","last_peered":"2024-04-26T07:48:32.610853+0000","last_clean":"2024-04-26T07:48:32.610853+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:48:32.610853+0000","last_undegraded":"2024-04-26T07:48:32.610853+0000","last_fullsized":"2024-04-26T07:48:32.610853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612556+0000","last_change":"2024-04-26T07:48:23.546594+0000","last_active":"2024-04-26T07:48:32.612556+0000","last_peered":"2024-04-26T07:48:32.612556+0000","last_clean":"2024-04-26T07:48:32.612556+0000","last_became_active":"2024-04-26T07:48:23.545761+0000","last_became_peered":"2024-04-26T07:48:23.545761+0000","last_unstale":"2024-04-26T07:48:32.612556+0000","last_undegraded":"2024-04-26T07:48:32.612556+0000","last_fullsized":"2024-04-26T07:48:32.612556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595866+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:48:32.595866+0000","last_peered":"2024-04-26T07:48:32.595866+0000","last_clean":"2024-04-26T07:48:32.595866+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:48:32.595866+0000","last_undegraded":"2024-04-26T07:48:32.595866+0000","last_fullsized":"2024-04-26T07:48:32.595866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589370+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:48:32.589370+0000","last_peered":"2024-04-26T07:48:32.589370+0000","last_clean":"2024-04-26T07:48:32.589370+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:48:32.589370+0000","last_undegraded":"2024-04-26T07:48:32.589370+0000","last_fullsized":"2024-04-26T07:48:32.589370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.620096+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:48:32.620096+0000","last_peered":"2024-04-26T07:48:32.620096+0000","last_clean":"2024-04-26T07:48:32.620096+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:48:32.620096+0000","last_undegraded":"2024-04-26T07:48:32.620096+0000","last_fullsized":"2024-04-26T07:48:32.620096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594485+0000","last_change":"2024-04-26T07:48:23.549877+0000","last_active":"2024-04-26T07:48:32.594485+0000","last_peered":"2024-04-26T07:48:32.594485+0000","last_clean":"2024-04-26T07:48:32.594485+0000","last_became_active":"2024-04-26T07:48:23.549563+0000","last_became_peered":"2024-04-26T07:48:23.549563+0000","last_unstale":"2024-04-26T07:48:32.594485+0000","last_undegraded":"2024-04-26T07:48:32.594485+0000","last_fullsized":"2024-04-26T07:48:32.594485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614245+0000","last_change":"2024-04-26T07:48:21.523373+0000","last_active":"2024-04-26T07:48:32.614245+0000","last_peered":"2024-04-26T07:48:32.614245+0000","last_clean":"2024-04-26T07:48:32.614245+0000","last_became_active":"2024-04-26T07:48:21.522623+0000","last_became_peered":"2024-04-26T07:48:21.522623+0000","last_unstale":"2024-04-26T07:48:32.614245+0000","last_undegraded":"2024-04-26T07:48:32.614245+0000","last_fullsized":"2024-04-26T07:48:32.614245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621914+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:48:32.621914+0000","last_peered":"2024-04-26T07:48:32.621914+0000","last_clean":"2024-04-26T07:48:32.621914+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:48:32.621914+0000","last_undegraded":"2024-04-26T07:48:32.621914+0000","last_fullsized":"2024-04-26T07:48:32.621914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617728+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:48:32.617728+0000","last_peered":"2024-04-26T07:48:32.617728+0000","last_clean":"2024-04-26T07:48:32.617728+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:48:32.617728+0000","last_undegraded":"2024-04-26T07:48:32.617728+0000","last_fullsized":"2024-04-26T07:48:32.617728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590717+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:48:32.590717+0000","last_peered":"2024-04-26T07:48:32.590717+0000","last_clean":"2024-04-26T07:48:32.590717+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:48:32.590717+0000","last_undegraded":"2024-04-26T07:48:32.590717+0000","last_fullsized":"2024-04-26T07:48:32.590717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612793+0000","last_change":"2024-04-26T07:48:21.521442+0000","last_active":"2024-04-26T07:48:32.612793+0000","last_peered":"2024-04-26T07:48:32.612793+0000","last_clean":"2024-04-26T07:48:32.612793+0000","last_became_active":"2024-04-26T07:48:21.520835+0000","last_became_peered":"2024-04-26T07:48:21.520835+0000","last_unstale":"2024-04-26T07:48:32.612793+0000","last_undegraded":"2024-04-26T07:48:32.612793+0000","last_fullsized":"2024-04-26T07:48:32.612793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618576+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:48:32.618576+0000","last_peered":"2024-04-26T07:48:32.618576+0000","last_clean":"2024-04-26T07:48:32.618576+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:48:32.618576+0000","last_undegraded":"2024-04-26T07:48:32.618576+0000","last_fullsized":"2024-04-26T07:48:32.618576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593993+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:48:32.593993+0000","last_peered":"2024-04-26T07:48:32.593993+0000","last_clean":"2024-04-26T07:48:32.593993+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:48:32.593993+0000","last_undegraded":"2024-04-26T07:48:32.593993+0000","last_fullsized":"2024-04-26T07:48:32.593993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.641646+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:48:32.641646+0000","last_peered":"2024-04-26T07:48:32.641646+0000","last_clean":"2024-04-26T07:48:32.641646+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:48:32.641646+0000","last_undegraded":"2024-04-26T07:48:32.641646+0000","last_fullsized":"2024-04-26T07:48:32.641646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588726+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:48:32.588726+0000","last_peered":"2024-04-26T07:48:32.588726+0000","last_clean":"2024-04-26T07:48:32.588726+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:48:32.588726+0000","last_undegraded":"2024-04-26T07:48:32.588726+0000","last_fullsized":"2024-04-26T07:48:32.588726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614822+0000","last_change":"2024-04-26T07:48:21.530617+0000","last_active":"2024-04-26T07:48:32.614822+0000","last_peered":"2024-04-26T07:48:32.614822+0000","last_clean":"2024-04-26T07:48:32.614822+0000","last_became_active":"2024-04-26T07:48:21.529930+0000","last_became_peered":"2024-04-26T07:48:21.529930+0000","last_unstale":"2024-04-26T07:48:32.614822+0000","last_undegraded":"2024-04-26T07:48:32.614822+0000","last_fullsized":"2024-04-26T07:48:32.614822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.873875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612743+0000","last_change":"2024-04-26T07:48:23.553223+0000","last_active":"2024-04-26T07:48:32.612743+0000","last_peered":"2024-04-26T07:48:32.612743+0000","last_clean":"2024-04-26T07:48:32.612743+0000","last_became_active":"2024-04-26T07:48:23.547557+0000","last_became_peered":"2024-04-26T07:48:23.547557+0000","last_unstale":"2024-04-26T07:48:32.612743+0000","last_undegraded":"2024-04-26T07:48:32.612743+0000","last_fullsized":"2024-04-26T07:48:32.612743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622413+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:48:32.622413+0000","last_peered":"2024-04-26T07:48:32.622413+0000","last_clean":"2024-04-26T07:48:32.622413+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:48:32.622413+0000","last_undegraded":"2024-04-26T07:48:32.622413+0000","last_fullsized":"2024-04-26T07:48:32.622413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618073+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:48:32.618073+0000","last_peered":"2024-04-26T07:48:32.618073+0000","last_clean":"2024-04-26T07:48:32.618073+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:48:32.618073+0000","last_undegraded":"2024-04-26T07:48:32.618073+0000","last_fullsized":"2024-04-26T07:48:32.618073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622657+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:48:32.622657+0000","last_peered":"2024-04-26T07:48:32.622657+0000","last_clean":"2024-04-26T07:48:32.622657+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:48:32.622657+0000","last_undegraded":"2024-04-26T07:48:32.622657+0000","last_fullsized":"2024-04-26T07:48:32.622657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640324+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:48:32.640324+0000","last_peered":"2024-04-26T07:48:32.640324+0000","last_clean":"2024-04-26T07:48:32.640324+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:48:32.640324+0000","last_undegraded":"2024-04-26T07:48:32.640324+0000","last_fullsized":"2024-04-26T07:48:32.640324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590023+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:48:32.590023+0000","last_peered":"2024-04-26T07:48:32.590023+0000","last_clean":"2024-04-26T07:48:32.590023+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:48:32.590023+0000","last_undegraded":"2024-04-26T07:48:32.590023+0000","last_fullsized":"2024-04-26T07:48:32.590023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640642+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:48:32.640642+0000","last_peered":"2024-04-26T07:48:32.640642+0000","last_clean":"2024-04-26T07:48:32.640642+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:48:32.640642+0000","last_undegraded":"2024-04-26T07:48:32.640642+0000","last_fullsized":"2024-04-26T07:48:32.640642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593704+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:48:32.593704+0000","last_peered":"2024-04-26T07:48:32.593704+0000","last_clean":"2024-04-26T07:48:32.593704+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:48:32.593704+0000","last_undegraded":"2024-04-26T07:48:32.593704+0000","last_fullsized":"2024-04-26T07:48:32.593704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590820+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:48:32.590820+0000","last_peered":"2024-04-26T07:48:32.590820+0000","last_clean":"2024-04-26T07:48:32.590820+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:48:32.590820+0000","last_undegraded":"2024-04-26T07:48:32.590820+0000","last_fullsized":"2024-04-26T07:48:32.590820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594891+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:48:32.594891+0000","last_peered":"2024-04-26T07:48:32.594891+0000","last_clean":"2024-04-26T07:48:32.594891+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:48:32.594891+0000","last_undegraded":"2024-04-26T07:48:32.594891+0000","last_fullsized":"2024-04-26T07:48:32.594891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588689+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:48:32.588689+0000","last_peered":"2024-04-26T07:48:32.588689+0000","last_clean":"2024-04-26T07:48:32.588689+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:48:32.588689+0000","last_undegraded":"2024-04-26T07:48:32.588689+0000","last_fullsized":"2024-04-26T07:48:32.588689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598164+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:48:32.598164+0000","last_peered":"2024-04-26T07:48:32.598164+0000","last_clean":"2024-04-26T07:48:32.598164+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:48:32.598164+0000","last_undegraded":"2024-04-26T07:48:32.598164+0000","last_fullsized":"2024-04-26T07:48:32.598164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614662+0000","last_change":"2024-04-26T07:48:21.532476+0000","last_active":"2024-04-26T07:48:32.614662+0000","last_peered":"2024-04-26T07:48:32.614662+0000","last_clean":"2024-04-26T07:48:32.614662+0000","last_became_active":"2024-04-26T07:48:21.531890+0000","last_became_peered":"2024-04-26T07:48:21.531890+0000","last_unstale":"2024-04-26T07:48:32.614662+0000","last_undegraded":"2024-04-26T07:48:32.614662+0000","last_fullsized":"2024-04-26T07:48:32.614662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617734+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:48:32.617734+0000","last_peered":"2024-04-26T07:48:32.617734+0000","last_clean":"2024-04-26T07:48:32.617734+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:48:32.617734+0000","last_undegraded":"2024-04-26T07:48:32.617734+0000","last_fullsized":"2024-04-26T07:48:32.617734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.973091+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:48:32.973091+0000","last_peered":"2024-04-26T07:48:32.973091+0000","last_clean":"2024-04-26T07:48:32.973091+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:48:32.973091+0000","last_undegraded":"2024-04-26T07:48:32.973091+0000","last_fullsized":"2024-04-26T07:48:32.973091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614227+0000","last_change":"2024-04-26T07:48:29.585278+0000","last_active":"2024-04-26T07:48:32.614227+0000","last_peered":"2024-04-26T07:48:32.614227+0000","last_clean":"2024-04-26T07:48:32.614227+0000","last_became_active":"2024-04-26T07:48:29.584564+0000","last_became_peered":"2024-04-26T07:48:29.584564+0000","last_unstale":"2024-04-26T07:48:32.614227+0000","last_undegraded":"2024-04-26T07:48:32.614227+0000","last_fullsized":"2024-04-26T07:48:32.614227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616814+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:48:32.616814+0000","last_peered":"2024-04-26T07:48:32.616814+0000","last_clean":"2024-04-26T07:48:32.616814+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:48:32.616814+0000","last_undegraded":"2024-04-26T07:48:32.616814+0000","last_fullsized":"2024-04-26T07:48:32.616814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618710+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:48:32.618710+0000","last_peered":"2024-04-26T07:48:32.618710+0000","last_clean":"2024-04-26T07:48:32.618710+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:48:32.618710+0000","last_undegraded":"2024-04-26T07:48:32.618710+0000","last_fullsized":"2024-04-26T07:48:32.618710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595016+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:48:32.595016+0000","last_peered":"2024-04-26T07:48:32.595016+0000","last_clean":"2024-04-26T07:48:32.595016+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:48:32.595016+0000","last_undegraded":"2024-04-26T07:48:32.595016+0000","last_fullsized":"2024-04-26T07:48:32.595016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.597695+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:48:32.597695+0000","last_peered":"2024-04-26T07:48:32.597695+0000","last_clean":"2024-04-26T07:48:32.597695+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:48:32.597695+0000","last_undegraded":"2024-04-26T07:48:32.597695+0000","last_fullsized":"2024-04-26T07:48:32.597695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.371487+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:48:33.371487+0000","last_peered":"2024-04-26T07:48:33.371487+0000","last_clean":"2024-04-26T07:48:33.371487+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:48:33.371487+0000","last_undegraded":"2024-04-26T07:48:33.371487+0000","last_fullsized":"2024-04-26T07:48:33.371487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590510+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:48:32.590510+0000","last_peered":"2024-04-26T07:48:32.590510+0000","last_clean":"2024-04-26T07:48:32.590510+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:48:32.590510+0000","last_undegraded":"2024-04-26T07:48:32.590510+0000","last_fullsized":"2024-04-26T07:48:32.590510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593696+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:48:32.593696+0000","last_peered":"2024-04-26T07:48:32.593696+0000","last_clean":"2024-04-26T07:48:32.593696+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:48:32.593696+0000","last_undegraded":"2024-04-26T07:48:32.593696+0000","last_fullsized":"2024-04-26T07:48:32.593696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598308+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:48:32.598308+0000","last_peered":"2024-04-26T07:48:32.598308+0000","last_clean":"2024-04-26T07:48:32.598308+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:48:32.598308+0000","last_undegraded":"2024-04-26T07:48:32.598308+0000","last_fullsized":"2024-04-26T07:48:32.598308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613002+0000","last_change":"2024-04-26T07:48:21.532432+0000","last_active":"2024-04-26T07:48:32.613002+0000","last_peered":"2024-04-26T07:48:32.613002+0000","last_clean":"2024-04-26T07:48:32.613002+0000","last_became_active":"2024-04-26T07:48:21.531735+0000","last_became_peered":"2024-04-26T07:48:21.531735+0000","last_unstale":"2024-04-26T07:48:32.613002+0000","last_undegraded":"2024-04-26T07:48:32.613002+0000","last_fullsized":"2024-04-26T07:48:32.613002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:44.669301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.600506+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:48:32.600506+0000","last_peered":"2024-04-26T07:48:32.600506+0000","last_clean":"2024-04-26T07:48:32.600506+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:48:32.600506+0000","last_undegraded":"2024-04-26T07:48:32.600506+0000","last_fullsized":"2024-04-26T07:48:32.600506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.431402+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:48:33.431402+0000","last_peered":"2024-04-26T07:48:33.431402+0000","last_clean":"2024-04-26T07:48:33.431402+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:48:33.431402+0000","last_undegraded":"2024-04-26T07:48:33.431402+0000","last_fullsized":"2024-04-26T07:48:33.431402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613504+0000","last_change":"2024-04-26T07:48:29.580319+0000","last_active":"2024-04-26T07:48:32.613504+0000","last_peered":"2024-04-26T07:48:32.613504+0000","last_clean":"2024-04-26T07:48:32.613504+0000","last_became_active":"2024-04-26T07:48:29.579332+0000","last_became_peered":"2024-04-26T07:48:29.579332+0000","last_unstale":"2024-04-26T07:48:32.613504+0000","last_undegraded":"2024-04-26T07:48:32.613504+0000","last_fullsized":"2024-04-26T07:48:32.613504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589836+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:48:32.589836+0000","last_peered":"2024-04-26T07:48:32.589836+0000","last_clean":"2024-04-26T07:48:32.589836+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:48:32.589836+0000","last_undegraded":"2024-04-26T07:48:32.589836+0000","last_fullsized":"2024-04-26T07:48:32.589836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599980+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:48:32.599980+0000","last_peered":"2024-04-26T07:48:32.599980+0000","last_clean":"2024-04-26T07:48:32.599980+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:48:32.599980+0000","last_undegraded":"2024-04-26T07:48:32.599980+0000","last_fullsized":"2024-04-26T07:48:32.599980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621266+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:48:32.621266+0000","last_peered":"2024-04-26T07:48:32.621266+0000","last_clean":"2024-04-26T07:48:32.621266+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:48:32.621266+0000","last_undegraded":"2024-04-26T07:48:32.621266+0000","last_fullsized":"2024-04-26T07:48:32.621266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618324+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:48:32.618324+0000","last_peered":"2024-04-26T07:48:32.618324+0000","last_clean":"2024-04-26T07:48:32.618324+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:48:32.618324+0000","last_undegraded":"2024-04-26T07:48:32.618324+0000","last_fullsized":"2024-04-26T07:48:32.618324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.435760+0000","last_change":"2024-04-26T07:48:27.656615+0000","last_active":"2024-04-26T07:48:33.435760+0000","last_peered":"2024-04-26T07:48:33.435760+0000","last_clean":"2024-04-26T07:48:33.435760+0000","last_became_active":"2024-04-26T07:48:27.655900+0000","last_became_peered":"2024-04-26T07:48:27.655900+0000","last_unstale":"2024-04-26T07:48:33.435760+0000","last_undegraded":"2024-04-26T07:48:33.435760+0000","last_fullsized":"2024-04-26T07:48:33.435760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596314+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:48:32.596314+0000","last_peered":"2024-04-26T07:48:32.596314+0000","last_clean":"2024-04-26T07:48:32.596314+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:48:32.596314+0000","last_undegraded":"2024-04-26T07:48:32.596314+0000","last_fullsized":"2024-04-26T07:48:32.596314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617421+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:48:32.617421+0000","last_peered":"2024-04-26T07:48:32.617421+0000","last_clean":"2024-04-26T07:48:32.617421+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:48:32.617421+0000","last_undegraded":"2024-04-26T07:48:32.617421+0000","last_fullsized":"2024-04-26T07:48:32.617421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614904+0000","last_change":"2024-04-26T07:48:21.532535+0000","last_active":"2024-04-26T07:48:32.614904+0000","last_peered":"2024-04-26T07:48:32.614904+0000","last_clean":"2024-04-26T07:48:32.614904+0000","last_became_active":"2024-04-26T07:48:21.531870+0000","last_became_peered":"2024-04-26T07:48:21.531870+0000","last_unstale":"2024-04-26T07:48:32.614904+0000","last_undegraded":"2024-04-26T07:48:32.614904+0000","last_fullsized":"2024-04-26T07:48:32.614904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:53.041052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611794+0000","last_change":"2024-04-26T07:48:25.580567+0000","last_active":"2024-04-26T07:48:32.611794+0000","last_peered":"2024-04-26T07:48:32.611794+0000","last_clean":"2024-04-26T07:48:32.611794+0000","last_became_active":"2024-04-26T07:48:25.579735+0000","last_became_peered":"2024-04-26T07:48:25.579735+0000","last_unstale":"2024-04-26T07:48:32.611794+0000","last_undegraded":"2024-04-26T07:48:32.611794+0000","last_fullsized":"2024-04-26T07:48:32.611794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.532551+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:48:33.532551+0000","last_peered":"2024-04-26T07:48:33.532551+0000","last_clean":"2024-04-26T07:48:33.532551+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:48:33.532551+0000","last_undegraded":"2024-04-26T07:48:33.532551+0000","last_fullsized":"2024-04-26T07:48:33.532551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609575+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:48:32.609575+0000","last_peered":"2024-04-26T07:48:32.609575+0000","last_clean":"2024-04-26T07:48:32.609575+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:48:32.609575+0000","last_undegraded":"2024-04-26T07:48:32.609575+0000","last_fullsized":"2024-04-26T07:48:32.609575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619960+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:48:32.619960+0000","last_peered":"2024-04-26T07:48:32.619960+0000","last_clean":"2024-04-26T07:48:32.619960+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:48:32.619960+0000","last_undegraded":"2024-04-26T07:48:32.619960+0000","last_fullsized":"2024-04-26T07:48:32.619960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589122+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:48:32.589122+0000","last_peered":"2024-04-26T07:48:32.589122+0000","last_clean":"2024-04-26T07:48:32.589122+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:48:32.589122+0000","last_undegraded":"2024-04-26T07:48:32.589122+0000","last_fullsized":"2024-04-26T07:48:32.589122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613891+0000","last_change":"2024-04-26T07:48:21.531367+0000","last_active":"2024-04-26T07:48:32.613891+0000","last_peered":"2024-04-26T07:48:32.613891+0000","last_clean":"2024-04-26T07:48:32.613891+0000","last_became_active":"2024-04-26T07:48:21.530818+0000","last_became_peered":"2024-04-26T07:48:21.530818+0000","last_unstale":"2024-04-26T07:48:32.613891+0000","last_undegraded":"2024-04-26T07:48:32.613891+0000","last_fullsized":"2024-04-26T07:48:32.613891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.639686+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:48:32.639686+0000","last_peered":"2024-04-26T07:48:32.639686+0000","last_clean":"2024-04-26T07:48:32.639686+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:48:32.639686+0000","last_undegraded":"2024-04-26T07:48:32.639686+0000","last_fullsized":"2024-04-26T07:48:32.639686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.408665+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:48:33.408665+0000","last_peered":"2024-04-26T07:48:33.408665+0000","last_clean":"2024-04-26T07:48:33.408665+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:48:33.408665+0000","last_undegraded":"2024-04-26T07:48:33.408665+0000","last_fullsized":"2024-04-26T07:48:33.408665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594020+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:48:32.594020+0000","last_peered":"2024-04-26T07:48:32.594020+0000","last_clean":"2024-04-26T07:48:32.594020+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:48:32.594020+0000","last_undegraded":"2024-04-26T07:48:32.594020+0000","last_fullsized":"2024-04-26T07:48:32.594020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621907+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:48:32.621907+0000","last_peered":"2024-04-26T07:48:32.621907+0000","last_clean":"2024-04-26T07:48:32.621907+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:48:32.621907+0000","last_undegraded":"2024-04-26T07:48:32.621907+0000","last_fullsized":"2024-04-26T07:48:32.621907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623110+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:48:32.623110+0000","last_peered":"2024-04-26T07:48:32.623110+0000","last_clean":"2024-04-26T07:48:32.623110+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:48:32.623110+0000","last_undegraded":"2024-04-26T07:48:32.623110+0000","last_fullsized":"2024-04-26T07:48:32.623110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614688+0000","last_change":"2024-04-26T07:48:21.528922+0000","last_active":"2024-04-26T07:48:32.614688+0000","last_peered":"2024-04-26T07:48:32.614688+0000","last_clean":"2024-04-26T07:48:32.614688+0000","last_became_active":"2024-04-26T07:48:21.528409+0000","last_became_peered":"2024-04-26T07:48:21.528409+0000","last_unstale":"2024-04-26T07:48:32.614688+0000","last_undegraded":"2024-04-26T07:48:32.614688+0000","last_fullsized":"2024-04-26T07:48:32.614688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640985+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:48:32.640985+0000","last_peered":"2024-04-26T07:48:32.640985+0000","last_clean":"2024-04-26T07:48:32.640985+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:48:32.640985+0000","last_undegraded":"2024-04-26T07:48:32.640985+0000","last_fullsized":"2024-04-26T07:48:32.640985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.321518+0000","last_change":"2024-04-26T07:48:27.575739+0000","last_active":"2024-04-26T07:48:33.321518+0000","last_peered":"2024-04-26T07:48:33.321518+0000","last_clean":"2024-04-26T07:48:33.321518+0000","last_became_active":"2024-04-26T07:48:27.574665+0000","last_became_peered":"2024-04-26T07:48:27.574665+0000","last_unstale":"2024-04-26T07:48:33.321518+0000","last_undegraded":"2024-04-26T07:48:33.321518+0000","last_fullsized":"2024-04-26T07:48:33.321518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591336+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:48:32.591336+0000","last_peered":"2024-04-26T07:48:32.591336+0000","last_clean":"2024-04-26T07:48:32.591336+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:48:32.591336+0000","last_undegraded":"2024-04-26T07:48:32.591336+0000","last_fullsized":"2024-04-26T07:48:32.591336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596153+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:48:32.596153+0000","last_peered":"2024-04-26T07:48:32.596153+0000","last_clean":"2024-04-26T07:48:32.596153+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:48:32.596153+0000","last_undegraded":"2024-04-26T07:48:32.596153+0000","last_fullsized":"2024-04-26T07:48:32.596153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598381+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:48:32.598381+0000","last_peered":"2024-04-26T07:48:32.598381+0000","last_clean":"2024-04-26T07:48:32.598381+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:48:32.598381+0000","last_undegraded":"2024-04-26T07:48:32.598381+0000","last_fullsized":"2024-04-26T07:48:32.598381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.620387+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:48:32.620387+0000","last_peered":"2024-04-26T07:48:32.620387+0000","last_clean":"2024-04-26T07:48:32.620387+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:48:32.620387+0000","last_undegraded":"2024-04-26T07:48:32.620387+0000","last_fullsized":"2024-04-26T07:48:32.620387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640029+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:48:32.640029+0000","last_peered":"2024-04-26T07:48:32.640029+0000","last_clean":"2024-04-26T07:48:32.640029+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:48:32.640029+0000","last_undegraded":"2024-04-26T07:48:32.640029+0000","last_fullsized":"2024-04-26T07:48:32.640029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.941198+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:48:32.941198+0000","last_peered":"2024-04-26T07:48:32.941198+0000","last_clean":"2024-04-26T07:48:32.941198+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:48:32.941198+0000","last_undegraded":"2024-04-26T07:48:32.941198+0000","last_fullsized":"2024-04-26T07:48:32.941198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.639544+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:48:32.639544+0000","last_peered":"2024-04-26T07:48:32.639544+0000","last_clean":"2024-04-26T07:48:32.639544+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:48:32.639544+0000","last_undegraded":"2024-04-26T07:48:32.639544+0000","last_fullsized":"2024-04-26T07:48:32.639544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611305+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:48:32.611305+0000","last_peered":"2024-04-26T07:48:32.611305+0000","last_clean":"2024-04-26T07:48:32.611305+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:48:32.611305+0000","last_undegraded":"2024-04-26T07:48:32.611305+0000","last_fullsized":"2024-04-26T07:48:32.611305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590483+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:48:32.590483+0000","last_peered":"2024-04-26T07:48:32.590483+0000","last_clean":"2024-04-26T07:48:32.590483+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:48:32.590483+0000","last_undegraded":"2024-04-26T07:48:32.590483+0000","last_fullsized":"2024-04-26T07:48:32.590483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593051+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:48:32.593051+0000","last_peered":"2024-04-26T07:48:32.593051+0000","last_clean":"2024-04-26T07:48:32.593051+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:48:32.593051+0000","last_undegraded":"2024-04-26T07:48:32.593051+0000","last_fullsized":"2024-04-26T07:48:32.593051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640590+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:48:32.640590+0000","last_peered":"2024-04-26T07:48:32.640590+0000","last_clean":"2024-04-26T07:48:32.640590+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:48:32.640590+0000","last_undegraded":"2024-04-26T07:48:32.640590+0000","last_fullsized":"2024-04-26T07:48:32.640590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.470080+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:48:33.470080+0000","last_peered":"2024-04-26T07:48:33.470080+0000","last_clean":"2024-04-26T07:48:33.470080+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:48:33.470080+0000","last_undegraded":"2024-04-26T07:48:33.470080+0000","last_fullsized":"2024-04-26T07:48:33.470080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596037+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:48:32.596037+0000","last_peered":"2024-04-26T07:48:32.596037+0000","last_clean":"2024-04-26T07:48:32.596037+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:48:32.596037+0000","last_undegraded":"2024-04-26T07:48:32.596037+0000","last_fullsized":"2024-04-26T07:48:32.596037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595040+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:48:32.595040+0000","last_peered":"2024-04-26T07:48:32.595040+0000","last_clean":"2024-04-26T07:48:32.595040+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:48:32.595040+0000","last_undegraded":"2024-04-26T07:48:32.595040+0000","last_fullsized":"2024-04-26T07:48:32.595040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590987+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:48:32.590987+0000","last_peered":"2024-04-26T07:48:32.590987+0000","last_clean":"2024-04-26T07:48:32.590987+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:48:32.590987+0000","last_undegraded":"2024-04-26T07:48:32.590987+0000","last_fullsized":"2024-04-26T07:48:32.590987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623189+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:48:32.623189+0000","last_peered":"2024-04-26T07:48:32.623189+0000","last_clean":"2024-04-26T07:48:32.623189+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:48:32.623189+0000","last_undegraded":"2024-04-26T07:48:32.623189+0000","last_fullsized":"2024-04-26T07:48:32.623189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610858+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:48:32.610858+0000","last_peered":"2024-04-26T07:48:32.610858+0000","last_clean":"2024-04-26T07:48:32.610858+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:48:32.610858+0000","last_undegraded":"2024-04-26T07:48:32.610858+0000","last_fullsized":"2024-04-26T07:48:32.610858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.545785+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:48:33.545785+0000","last_peered":"2024-04-26T07:48:33.545785+0000","last_clean":"2024-04-26T07:48:33.545785+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:48:33.545785+0000","last_undegraded":"2024-04-26T07:48:33.545785+0000","last_fullsized":"2024-04-26T07:48:33.545785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640996+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:48:32.640996+0000","last_peered":"2024-04-26T07:48:32.640996+0000","last_clean":"2024-04-26T07:48:32.640996+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:48:32.640996+0000","last_undegraded":"2024-04-26T07:48:32.640996+0000","last_fullsized":"2024-04-26T07:48:32.640996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609816+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:48:32.609816+0000","last_peered":"2024-04-26T07:48:32.609816+0000","last_clean":"2024-04-26T07:48:32.609816+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:48:32.609816+0000","last_undegraded":"2024-04-26T07:48:32.609816+0000","last_fullsized":"2024-04-26T07:48:32.609816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591349+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:48:32.591349+0000","last_peered":"2024-04-26T07:48:32.591349+0000","last_clean":"2024-04-26T07:48:32.591349+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:48:32.591349+0000","last_undegraded":"2024-04-26T07:48:32.591349+0000","last_fullsized":"2024-04-26T07:48:32.591349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589741+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:48:32.589741+0000","last_peered":"2024-04-26T07:48:32.589741+0000","last_clean":"2024-04-26T07:48:32.589741+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:48:32.589741+0000","last_undegraded":"2024-04-26T07:48:32.589741+0000","last_fullsized":"2024-04-26T07:48:32.589741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618300+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:48:32.618300+0000","last_peered":"2024-04-26T07:48:32.618300+0000","last_clean":"2024-04-26T07:48:32.618300+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:48:32.618300+0000","last_undegraded":"2024-04-26T07:48:32.618300+0000","last_fullsized":"2024-04-26T07:48:32.618300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.330966+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:48:33.330966+0000","last_peered":"2024-04-26T07:48:33.330966+0000","last_clean":"2024-04-26T07:48:33.330966+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:48:33.330966+0000","last_undegraded":"2024-04-26T07:48:33.330966+0000","last_fullsized":"2024-04-26T07:48:33.330966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622058+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:48:32.622058+0000","last_peered":"2024-04-26T07:48:32.622058+0000","last_clean":"2024-04-26T07:48:32.622058+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:48:32.622058+0000","last_undegraded":"2024-04-26T07:48:32.622058+0000","last_fullsized":"2024-04-26T07:48:32.622058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589693+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:48:32.589693+0000","last_peered":"2024-04-26T07:48:32.589693+0000","last_clean":"2024-04-26T07:48:32.589693+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:48:32.589693+0000","last_undegraded":"2024-04-26T07:48:32.589693+0000","last_fullsized":"2024-04-26T07:48:32.589693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611734+0000","last_change":"2024-04-26T07:48:23.549303+0000","last_active":"2024-04-26T07:48:32.611734+0000","last_peered":"2024-04-26T07:48:32.611734+0000","last_clean":"2024-04-26T07:48:32.611734+0000","last_became_active":"2024-04-26T07:48:23.548989+0000","last_became_peered":"2024-04-26T07:48:23.548989+0000","last_unstale":"2024-04-26T07:48:32.611734+0000","last_undegraded":"2024-04-26T07:48:32.611734+0000","last_fullsized":"2024-04-26T07:48:32.611734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594463+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:48:32.594463+0000","last_peered":"2024-04-26T07:48:32.594463+0000","last_clean":"2024-04-26T07:48:32.594463+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:48:32.594463+0000","last_undegraded":"2024-04-26T07:48:32.594463+0000","last_fullsized":"2024-04-26T07:48:32.594463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591038+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:48:32.591038+0000","last_peered":"2024-04-26T07:48:32.591038+0000","last_clean":"2024-04-26T07:48:32.591038+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:48:32.591038+0000","last_undegraded":"2024-04-26T07:48:32.591038+0000","last_fullsized":"2024-04-26T07:48:32.591038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.462690+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:48:33.462690+0000","last_peered":"2024-04-26T07:48:33.462690+0000","last_clean":"2024-04-26T07:48:33.462690+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:48:33.462690+0000","last_undegraded":"2024-04-26T07:48:33.462690+0000","last_fullsized":"2024-04-26T07:48:33.462690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621427+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:48:32.621427+0000","last_peered":"2024-04-26T07:48:32.621427+0000","last_clean":"2024-04-26T07:48:32.621427+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:48:32.621427+0000","last_undegraded":"2024-04-26T07:48:32.621427+0000","last_fullsized":"2024-04-26T07:48:32.621427+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609817+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:48:32.609817+0000","last_peered":"2024-04-26T07:48:32.609817+0000","last_clean":"2024-04-26T07:48:32.609817+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:48:32.609817+0000","last_undegraded":"2024-04-26T07:48:32.609817+0000","last_fullsized":"2024-04-26T07:48:32.609817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622426+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:48:32.622426+0000","last_peered":"2024-04-26T07:48:32.622426+0000","last_clean":"2024-04-26T07:48:32.622426+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:48:32.622426+0000","last_undegraded":"2024-04-26T07:48:32.622426+0000","last_fullsized":"2024-04-26T07:48:32.622426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612197+0000","last_change":"2024-04-26T07:48:15.519242+0000","last_active":"2024-04-26T07:48:32.612197+0000","last_peered":"2024-04-26T07:48:32.612197+0000","last_clean":"2024-04-26T07:48:32.612197+0000","last_became_active":"2024-04-26T07:48:15.516846+0000","last_became_peered":"2024-04-26T07:48:15.516846+0000","last_unstale":"2024-04-26T07:48:32.612197+0000","last_undegraded":"2024-04-26T07:48:32.612197+0000","last_fullsized":"2024-04-26T07:48:32.612197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:20.666857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618206+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:48:32.618206+0000","last_peered":"2024-04-26T07:48:32.618206+0000","last_clean":"2024-04-26T07:48:32.618206+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:48:32.618206+0000","last_undegraded":"2024-04-26T07:48:32.618206+0000","last_fullsized":"2024-04-26T07:48:32.618206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594888+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:48:32.594888+0000","last_peered":"2024-04-26T07:48:32.594888+0000","last_clean":"2024-04-26T07:48:32.594888+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:48:32.594888+0000","last_undegraded":"2024-04-26T07:48:32.594888+0000","last_fullsized":"2024-04-26T07:48:32.594888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613937+0000","last_change":"2024-04-26T07:48:25.573125+0000","last_active":"2024-04-26T07:48:32.613937+0000","last_peered":"2024-04-26T07:48:32.613937+0000","last_clean":"2024-04-26T07:48:32.613937+0000","last_became_active":"2024-04-26T07:48:25.572200+0000","last_became_peered":"2024-04-26T07:48:25.572200+0000","last_unstale":"2024-04-26T07:48:32.613937+0000","last_undegraded":"2024-04-26T07:48:32.613937+0000","last_fullsized":"2024-04-26T07:48:32.613937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.257855+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:48:33.257855+0000","last_peered":"2024-04-26T07:48:33.257855+0000","last_clean":"2024-04-26T07:48:33.257855+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:48:33.257855+0000","last_undegraded":"2024-04-26T07:48:33.257855+0000","last_fullsized":"2024-04-26T07:48:33.257855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596447+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:48:32.596447+0000","last_peered":"2024-04-26T07:48:32.596447+0000","last_clean":"2024-04-26T07:48:32.596447+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:48:32.596447+0000","last_undegraded":"2024-04-26T07:48:32.596447+0000","last_fullsized":"2024-04-26T07:48:32.596447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621290+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:48:32.621290+0000","last_peered":"2024-04-26T07:48:32.621290+0000","last_clean":"2024-04-26T07:48:32.621290+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:48:32.621290+0000","last_undegraded":"2024-04-26T07:48:32.621290+0000","last_fullsized":"2024-04-26T07:48:32.621290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.597944+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:48:32.597944+0000","last_peered":"2024-04-26T07:48:32.597944+0000","last_clean":"2024-04-26T07:48:32.597944+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:48:32.597944+0000","last_undegraded":"2024-04-26T07:48:32.597944+0000","last_fullsized":"2024-04-26T07:48:32.597944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612020+0000","last_change":"2024-04-26T07:48:15.450172+0000","last_active":"2024-04-26T07:48:32.612020+0000","last_peered":"2024-04-26T07:48:32.612020+0000","last_clean":"2024-04-26T07:48:32.612020+0000","last_became_active":"2024-04-26T07:48:15.449113+0000","last_became_peered":"2024-04-26T07:48:15.449113+0000","last_unstale":"2024-04-26T07:48:32.612020+0000","last_undegraded":"2024-04-26T07:48:32.612020+0000","last_fullsized":"2024-04-26T07:48:32.612020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:51.283507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592453+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:48:32.592453+0000","last_peered":"2024-04-26T07:48:32.592453+0000","last_clean":"2024-04-26T07:48:32.592453+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:48:32.592453+0000","last_undegraded":"2024-04-26T07:48:32.592453+0000","last_fullsized":"2024-04-26T07:48:32.592453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619412+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:48:32.619412+0000","last_peered":"2024-04-26T07:48:32.619412+0000","last_clean":"2024-04-26T07:48:32.619412+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:48:32.619412+0000","last_undegraded":"2024-04-26T07:48:32.619412+0000","last_fullsized":"2024-04-26T07:48:32.619412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.452172+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:48:33.452172+0000","last_peered":"2024-04-26T07:48:33.452172+0000","last_clean":"2024-04-26T07:48:33.452172+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:48:33.452172+0000","last_undegraded":"2024-04-26T07:48:33.452172+0000","last_fullsized":"2024-04-26T07:48:33.452172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613673+0000","last_change":"2024-04-26T07:48:29.582371+0000","last_active":"2024-04-26T07:48:32.613673+0000","last_peered":"2024-04-26T07:48:32.613673+0000","last_clean":"2024-04-26T07:48:32.613673+0000","last_became_active":"2024-04-26T07:48:29.581770+0000","last_became_peered":"2024-04-26T07:48:29.581770+0000","last_unstale":"2024-04-26T07:48:32.613673+0000","last_undegraded":"2024-04-26T07:48:32.613673+0000","last_fullsized":"2024-04-26T07:48:32.613673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609792+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:48:32.609792+0000","last_peered":"2024-04-26T07:48:32.609792+0000","last_clean":"2024-04-26T07:48:32.609792+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:48:32.609792+0000","last_undegraded":"2024-04-26T07:48:32.609792+0000","last_fullsized":"2024-04-26T07:48:32.609792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611806+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:48:32.611806+0000","last_peered":"2024-04-26T07:48:32.611806+0000","last_clean":"2024-04-26T07:48:32.611806+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:48:32.611806+0000","last_undegraded":"2024-04-26T07:48:32.611806+0000","last_fullsized":"2024-04-26T07:48:32.611806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640096+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:48:32.640096+0000","last_peered":"2024-04-26T07:48:32.640096+0000","last_clean":"2024-04-26T07:48:32.640096+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:48:32.640096+0000","last_undegraded":"2024-04-26T07:48:32.640096+0000","last_fullsized":"2024-04-26T07:48:32.640096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609142+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:48:32.609142+0000","last_peered":"2024-04-26T07:48:32.609142+0000","last_clean":"2024-04-26T07:48:32.609142+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:48:32.609142+0000","last_undegraded":"2024-04-26T07:48:32.609142+0000","last_fullsized":"2024-04-26T07:48:32.609142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.641270+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:48:32.641270+0000","last_peered":"2024-04-26T07:48:32.641270+0000","last_clean":"2024-04-26T07:48:32.641270+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:48:32.641270+0000","last_undegraded":"2024-04-26T07:48:32.641270+0000","last_fullsized":"2024-04-26T07:48:32.641270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.455845+0000","last_change":"2024-04-26T07:48:27.651812+0000","last_active":"2024-04-26T07:48:33.455845+0000","last_peered":"2024-04-26T07:48:33.455845+0000","last_clean":"2024-04-26T07:48:33.455845+0000","last_became_active":"2024-04-26T07:48:27.651073+0000","last_became_peered":"2024-04-26T07:48:27.651073+0000","last_unstale":"2024-04-26T07:48:33.455845+0000","last_undegraded":"2024-04-26T07:48:33.455845+0000","last_fullsized":"2024-04-26T07:48:33.455845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594956+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:48:32.594956+0000","last_peered":"2024-04-26T07:48:32.594956+0000","last_clean":"2024-04-26T07:48:32.594956+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:48:32.594956+0000","last_undegraded":"2024-04-26T07:48:32.594956+0000","last_fullsized":"2024-04-26T07:48:32.594956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594348+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:48:32.594348+0000","last_peered":"2024-04-26T07:48:32.594348+0000","last_clean":"2024-04-26T07:48:32.594348+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:48:32.594348+0000","last_undegraded":"2024-04-26T07:48:32.594348+0000","last_fullsized":"2024-04-26T07:48:32.594348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611335+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:48:32.611335+0000","last_peered":"2024-04-26T07:48:32.611335+0000","last_clean":"2024-04-26T07:48:32.611335+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:48:32.611335+0000","last_undegraded":"2024-04-26T07:48:32.611335+0000","last_fullsized":"2024-04-26T07:48:32.611335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618650+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:48:32.618650+0000","last_peered":"2024-04-26T07:48:32.618650+0000","last_clean":"2024-04-26T07:48:32.618650+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:48:32.618650+0000","last_undegraded":"2024-04-26T07:48:32.618650+0000","last_fullsized":"2024-04-26T07:48:32.618650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590781+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:48:32.590781+0000","last_peered":"2024-04-26T07:48:32.590781+0000","last_clean":"2024-04-26T07:48:32.590781+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:48:32.590781+0000","last_undegraded":"2024-04-26T07:48:32.590781+0000","last_fullsized":"2024-04-26T07:48:32.590781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594445+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:48:32.594445+0000","last_peered":"2024-04-26T07:48:32.594445+0000","last_clean":"2024-04-26T07:48:32.594445+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:48:32.594445+0000","last_undegraded":"2024-04-26T07:48:32.594445+0000","last_fullsized":"2024-04-26T07:48:32.594445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.296197+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:48:33.296197+0000","last_peered":"2024-04-26T07:48:33.296197+0000","last_clean":"2024-04-26T07:48:33.296197+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:48:33.296197+0000","last_undegraded":"2024-04-26T07:48:33.296197+0000","last_fullsized":"2024-04-26T07:48:33.296197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623318+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:48:32.623318+0000","last_peered":"2024-04-26T07:48:32.623318+0000","last_clean":"2024-04-26T07:48:32.623318+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:48:32.623318+0000","last_undegraded":"2024-04-26T07:48:32.623318+0000","last_fullsized":"2024-04-26T07:48:32.623318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616586+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:48:32.616586+0000","last_peered":"2024-04-26T07:48:32.616586+0000","last_clean":"2024-04-26T07:48:32.616586+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:48:32.616586+0000","last_undegraded":"2024-04-26T07:48:32.616586+0000","last_fullsized":"2024-04-26T07:48:32.616586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610723+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:48:32.610723+0000","last_peered":"2024-04-26T07:48:32.610723+0000","last_clean":"2024-04-26T07:48:32.610723+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:48:32.610723+0000","last_undegraded":"2024-04-26T07:48:32.610723+0000","last_fullsized":"2024-04-26T07:48:32.610723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619702+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:48:32.619702+0000","last_peered":"2024-04-26T07:48:32.619702+0000","last_clean":"2024-04-26T07:48:32.619702+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:48:32.619702+0000","last_undegraded":"2024-04-26T07:48:32.619702+0000","last_fullsized":"2024-04-26T07:48:32.619702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611983+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:48:32.611983+0000","last_peered":"2024-04-26T07:48:32.611983+0000","last_clean":"2024-04-26T07:48:32.611983+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:48:32.611983+0000","last_undegraded":"2024-04-26T07:48:32.611983+0000","last_fullsized":"2024-04-26T07:48:32.611983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595835+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:48:32.595835+0000","last_peered":"2024-04-26T07:48:32.595835+0000","last_clean":"2024-04-26T07:48:32.595835+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:48:32.595835+0000","last_undegraded":"2024-04-26T07:48:32.595835+0000","last_fullsized":"2024-04-26T07:48:32.595835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.387016+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:48:33.387016+0000","last_peered":"2024-04-26T07:48:33.387016+0000","last_clean":"2024-04-26T07:48:33.387016+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:48:33.387016+0000","last_undegraded":"2024-04-26T07:48:33.387016+0000","last_fullsized":"2024-04-26T07:48:33.387016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588510+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:48:32.588510+0000","last_peered":"2024-04-26T07:48:32.588510+0000","last_clean":"2024-04-26T07:48:32.588510+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:48:32.588510+0000","last_undegraded":"2024-04-26T07:48:32.588510+0000","last_fullsized":"2024-04-26T07:48:32.588510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594361+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:48:32.594361+0000","last_peered":"2024-04-26T07:48:32.594361+0000","last_clean":"2024-04-26T07:48:32.594361+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:48:32.594361+0000","last_undegraded":"2024-04-26T07:48:32.594361+0000","last_fullsized":"2024-04-26T07:48:32.594361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598057+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:48:32.598057+0000","last_peered":"2024-04-26T07:48:32.598057+0000","last_clean":"2024-04-26T07:48:32.598057+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:48:32.598057+0000","last_undegraded":"2024-04-26T07:48:32.598057+0000","last_fullsized":"2024-04-26T07:48:32.598057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611736+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:48:32.611736+0000","last_peered":"2024-04-26T07:48:32.611736+0000","last_clean":"2024-04-26T07:48:32.611736+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:48:32.611736+0000","last_undegraded":"2024-04-26T07:48:32.611736+0000","last_fullsized":"2024-04-26T07:48:32.611736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614960+0000","last_change":"2024-04-26T07:48:15.517260+0000","last_active":"2024-04-26T07:48:32.614960+0000","last_peered":"2024-04-26T07:48:32.614960+0000","last_clean":"2024-04-26T07:48:32.614960+0000","last_became_active":"2024-04-26T07:48:15.516567+0000","last_became_peered":"2024-04-26T07:48:15.516567+0000","last_unstale":"2024-04-26T07:48:32.614960+0000","last_undegraded":"2024-04-26T07:48:32.614960+0000","last_fullsized":"2024-04-26T07:48:32.614960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:31.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622260+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:48:32.622260+0000","last_peered":"2024-04-26T07:48:32.622260+0000","last_clean":"2024-04-26T07:48:32.622260+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:48:32.622260+0000","last_undegraded":"2024-04-26T07:48:32.622260+0000","last_fullsized":"2024-04-26T07:48:32.622260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.485485+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:48:33.485485+0000","last_peered":"2024-04-26T07:48:33.485485+0000","last_clean":"2024-04-26T07:48:33.485485+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:48:33.485485+0000","last_undegraded":"2024-04-26T07:48:33.485485+0000","last_fullsized":"2024-04-26T07:48:33.485485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616954+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:48:32.616954+0000","last_peered":"2024-04-26T07:48:32.616954+0000","last_clean":"2024-04-26T07:48:32.616954+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:48:32.616954+0000","last_undegraded":"2024-04-26T07:48:32.616954+0000","last_fullsized":"2024-04-26T07:48:32.616954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.600535+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:48:32.600535+0000","last_peered":"2024-04-26T07:48:32.600535+0000","last_clean":"2024-04-26T07:48:32.600535+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:48:32.600535+0000","last_undegraded":"2024-04-26T07:48:32.600535+0000","last_fullsized":"2024-04-26T07:48:32.600535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593361+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:48:32.593361+0000","last_peered":"2024-04-26T07:48:32.593361+0000","last_clean":"2024-04-26T07:48:32.593361+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:48:32.593361+0000","last_undegraded":"2024-04-26T07:48:32.593361+0000","last_fullsized":"2024-04-26T07:48:32.593361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598953+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:48:32.598953+0000","last_peered":"2024-04-26T07:48:32.598953+0000","last_clean":"2024-04-26T07:48:32.598953+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:48:32.598953+0000","last_undegraded":"2024-04-26T07:48:32.598953+0000","last_fullsized":"2024-04-26T07:48:32.598953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611332+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:48:32.611332+0000","last_peered":"2024-04-26T07:48:32.611332+0000","last_clean":"2024-04-26T07:48:32.611332+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:48:32.611332+0000","last_undegraded":"2024-04-26T07:48:32.611332+0000","last_fullsized":"2024-04-26T07:48:32.611332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588829+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:48:32.588829+0000","last_peered":"2024-04-26T07:48:32.588829+0000","last_clean":"2024-04-26T07:48:32.588829+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:48:32.588829+0000","last_undegraded":"2024-04-26T07:48:32.588829+0000","last_fullsized":"2024-04-26T07:48:32.588829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.442697+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:48:33.442697+0000","last_peered":"2024-04-26T07:48:33.442697+0000","last_clean":"2024-04-26T07:48:33.442697+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:48:33.442697+0000","last_undegraded":"2024-04-26T07:48:33.442697+0000","last_fullsized":"2024-04-26T07:48:33.442697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598315+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:48:32.598315+0000","last_peered":"2024-04-26T07:48:32.598315+0000","last_clean":"2024-04-26T07:48:32.598315+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:48:32.598315+0000","last_undegraded":"2024-04-26T07:48:32.598315+0000","last_fullsized":"2024-04-26T07:48:32.598315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595862+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:48:32.595862+0000","last_peered":"2024-04-26T07:48:32.595862+0000","last_clean":"2024-04-26T07:48:32.595862+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:48:32.595862+0000","last_undegraded":"2024-04-26T07:48:32.595862+0000","last_fullsized":"2024-04-26T07:48:32.595862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589130+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:48:32.589130+0000","last_peered":"2024-04-26T07:48:32.589130+0000","last_clean":"2024-04-26T07:48:32.589130+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:48:32.589130+0000","last_undegraded":"2024-04-26T07:48:32.589130+0000","last_fullsized":"2024-04-26T07:48:32.589130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598881+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:48:32.598881+0000","last_peered":"2024-04-26T07:48:32.598881+0000","last_clean":"2024-04-26T07:48:32.598881+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:48:32.598881+0000","last_undegraded":"2024-04-26T07:48:32.598881+0000","last_fullsized":"2024-04-26T07:48:32.598881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623631+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:48:32.623631+0000","last_peered":"2024-04-26T07:48:32.623631+0000","last_clean":"2024-04-26T07:48:32.623631+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:48:32.623631+0000","last_undegraded":"2024-04-26T07:48:32.623631+0000","last_fullsized":"2024-04-26T07:48:32.623631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592905+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:48:32.592905+0000","last_peered":"2024-04-26T07:48:32.592905+0000","last_clean":"2024-04-26T07:48:32.592905+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:48:32.592905+0000","last_undegraded":"2024-04-26T07:48:32.592905+0000","last_fullsized":"2024-04-26T07:48:32.592905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.421205+0000","last_change":"2024-04-26T07:48:27.655376+0000","last_active":"2024-04-26T07:48:33.421205+0000","last_peered":"2024-04-26T07:48:33.421205+0000","last_clean":"2024-04-26T07:48:33.421205+0000","last_became_active":"2024-04-26T07:48:27.654669+0000","last_became_peered":"2024-04-26T07:48:27.654669+0000","last_unstale":"2024-04-26T07:48:33.421205+0000","last_undegraded":"2024-04-26T07:48:33.421205+0000","last_fullsized":"2024-04-26T07:48:33.421205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594256+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:48:32.594256+0000","last_peered":"2024-04-26T07:48:32.594256+0000","last_clean":"2024-04-26T07:48:32.594256+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:48:32.594256+0000","last_undegraded":"2024-04-26T07:48:32.594256+0000","last_fullsized":"2024-04-26T07:48:32.594256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617350+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:48:32.617350+0000","last_peered":"2024-04-26T07:48:32.617350+0000","last_clean":"2024-04-26T07:48:32.617350+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:48:32.617350+0000","last_undegraded":"2024-04-26T07:48:32.617350+0000","last_fullsized":"2024-04-26T07:48:32.617350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596348+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:48:32.596348+0000","last_peered":"2024-04-26T07:48:32.596348+0000","last_clean":"2024-04-26T07:48:32.596348+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:48:32.596348+0000","last_undegraded":"2024-04-26T07:48:32.596348+0000","last_fullsized":"2024-04-26T07:48:32.596348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590359+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:48:32.590359+0000","last_peered":"2024-04-26T07:48:32.590359+0000","last_clean":"2024-04-26T07:48:32.590359+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:48:32.590359+0000","last_undegraded":"2024-04-26T07:48:32.590359+0000","last_fullsized":"2024-04-26T07:48:32.590359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590033+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:48:32.590033+0000","last_peered":"2024-04-26T07:48:32.590033+0000","last_clean":"2024-04-26T07:48:32.590033+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:48:32.590033+0000","last_undegraded":"2024-04-26T07:48:32.590033+0000","last_fullsized":"2024-04-26T07:48:32.590033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610973+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:48:32.610973+0000","last_peered":"2024-04-26T07:48:32.610973+0000","last_clean":"2024-04-26T07:48:32.610973+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:48:32.610973+0000","last_undegraded":"2024-04-26T07:48:32.610973+0000","last_fullsized":"2024-04-26T07:48:32.610973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.492489+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:48:33.492489+0000","last_peered":"2024-04-26T07:48:33.492489+0000","last_clean":"2024-04-26T07:48:33.492489+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:48:33.492489+0000","last_undegraded":"2024-04-26T07:48:33.492489+0000","last_fullsized":"2024-04-26T07:48:33.492489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592484+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:48:32.592484+0000","last_peered":"2024-04-26T07:48:32.592484+0000","last_clean":"2024-04-26T07:48:32.592484+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:48:32.592484+0000","last_undegraded":"2024-04-26T07:48:32.592484+0000","last_fullsized":"2024-04-26T07:48:32.592484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599168+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:48:32.599168+0000","last_peered":"2024-04-26T07:48:32.599168+0000","last_clean":"2024-04-26T07:48:32.599168+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:48:32.599168+0000","last_undegraded":"2024-04-26T07:48:32.599168+0000","last_fullsized":"2024-04-26T07:48:32.599168+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610279+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:48:32.610279+0000","last_peered":"2024-04-26T07:48:32.610279+0000","last_clean":"2024-04-26T07:48:32.610279+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:48:32.610279+0000","last_undegraded":"2024-04-26T07:48:32.610279+0000","last_fullsized":"2024-04-26T07:48:32.610279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614618+0000","last_change":"2024-04-26T07:48:21.522429+0000","last_active":"2024-04-26T07:48:32.614618+0000","last_peered":"2024-04-26T07:48:32.614618+0000","last_clean":"2024-04-26T07:48:32.614618+0000","last_became_active":"2024-04-26T07:48:21.521246+0000","last_became_peered":"2024-04-26T07:48:21.521246+0000","last_unstale":"2024-04-26T07:48:32.614618+0000","last_undegraded":"2024-04-26T07:48:32.614618+0000","last_fullsized":"2024-04-26T07:48:32.614618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593818+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:48:32.593818+0000","last_peered":"2024-04-26T07:48:32.593818+0000","last_clean":"2024-04-26T07:48:32.593818+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:48:32.593818+0000","last_undegraded":"2024-04-26T07:48:32.593818+0000","last_fullsized":"2024-04-26T07:48:32.593818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.945787+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:48:32.945787+0000","last_peered":"2024-04-26T07:48:32.945787+0000","last_clean":"2024-04-26T07:48:32.945787+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:48:32.945787+0000","last_undegraded":"2024-04-26T07:48:32.945787+0000","last_fullsized":"2024-04-26T07:48:32.945787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612480+0000","last_change":"2024-04-26T07:48:29.582765+0000","last_active":"2024-04-26T07:48:32.612480+0000","last_peered":"2024-04-26T07:48:32.612480+0000","last_clean":"2024-04-26T07:48:32.612480+0000","last_became_active":"2024-04-26T07:48:29.581836+0000","last_became_peered":"2024-04-26T07:48:29.581836+0000","last_unstale":"2024-04-26T07:48:32.612480+0000","last_undegraded":"2024-04-26T07:48:32.612480+0000","last_fullsized":"2024-04-26T07:48:32.612480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594143+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:48:32.594143+0000","last_peered":"2024-04-26T07:48:32.594143+0000","last_clean":"2024-04-26T07:48:32.594143+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:48:32.594143+0000","last_undegraded":"2024-04-26T07:48:32.594143+0000","last_fullsized":"2024-04-26T07:48:32.594143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593017+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:48:32.593017+0000","last_peered":"2024-04-26T07:48:32.593017+0000","last_clean":"2024-04-26T07:48:32.593017+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:48:32.593017+0000","last_undegraded":"2024-04-26T07:48:32.593017+0000","last_fullsized":"2024-04-26T07:48:32.593017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619540+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:48:32.619540+0000","last_peered":"2024-04-26T07:48:32.619540+0000","last_clean":"2024-04-26T07:48:32.619540+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:48:32.619540+0000","last_undegraded":"2024-04-26T07:48:32.619540+0000","last_fullsized":"2024-04-26T07:48:32.619540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611367+0000","last_change":"2024-04-26T07:48:25.575678+0000","last_active":"2024-04-26T07:48:32.611367+0000","last_peered":"2024-04-26T07:48:32.611367+0000","last_clean":"2024-04-26T07:48:32.611367+0000","last_became_active":"2024-04-26T07:48:25.574985+0000","last_became_peered":"2024-04-26T07:48:25.574985+0000","last_unstale":"2024-04-26T07:48:32.611367+0000","last_undegraded":"2024-04-26T07:48:32.611367+0000","last_fullsized":"2024-04-26T07:48:32.611367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.401856+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:48:33.401856+0000","last_peered":"2024-04-26T07:48:33.401856+0000","last_clean":"2024-04-26T07:48:33.401856+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:48:33.401856+0000","last_undegraded":"2024-04-26T07:48:33.401856+0000","last_fullsized":"2024-04-26T07:48:33.401856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622031+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:48:32.622031+0000","last_peered":"2024-04-26T07:48:32.622031+0000","last_clean":"2024-04-26T07:48:32.622031+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:48:32.622031+0000","last_undegraded":"2024-04-26T07:48:32.622031+0000","last_fullsized":"2024-04-26T07:48:32.622031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619689+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:48:32.619689+0000","last_peered":"2024-04-26T07:48:32.619689+0000","last_clean":"2024-04-26T07:48:32.619689+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:48:32.619689+0000","last_undegraded":"2024-04-26T07:48:32.619689+0000","last_fullsized":"2024-04-26T07:48:32.619689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593757+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:48:32.593757+0000","last_peered":"2024-04-26T07:48:32.593757+0000","last_clean":"2024-04-26T07:48:32.593757+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:48:32.593757+0000","last_undegraded":"2024-04-26T07:48:32.593757+0000","last_fullsized":"2024-04-26T07:48:32.593757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.597201+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:48:32.597201+0000","last_peered":"2024-04-26T07:48:32.597201+0000","last_clean":"2024-04-26T07:48:32.597201+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:48:32.597201+0000","last_undegraded":"2024-04-26T07:48:32.597201+0000","last_fullsized":"2024-04-26T07:48:32.597201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621631+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:48:32.621631+0000","last_peered":"2024-04-26T07:48:32.621631+0000","last_clean":"2024-04-26T07:48:32.621631+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:48:32.621631+0000","last_undegraded":"2024-04-26T07:48:32.621631+0000","last_fullsized":"2024-04-26T07:48:32.621631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.171654+0000","last_change":"2024-04-26T07:48:27.575530+0000","last_active":"2024-04-26T07:48:33.171654+0000","last_peered":"2024-04-26T07:48:33.171654+0000","last_clean":"2024-04-26T07:48:33.171654+0000","last_became_active":"2024-04-26T07:48:27.574659+0000","last_became_peered":"2024-04-26T07:48:27.574659+0000","last_unstale":"2024-04-26T07:48:33.171654+0000","last_undegraded":"2024-04-26T07:48:33.171654+0000","last_fullsized":"2024-04-26T07:48:33.171654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593499+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:48:32.593499+0000","last_peered":"2024-04-26T07:48:32.593499+0000","last_clean":"2024-04-26T07:48:32.593499+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:48:32.593499+0000","last_undegraded":"2024-04-26T07:48:32.593499+0000","last_fullsized":"2024-04-26T07:48:32.593499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623425+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:48:32.623425+0000","last_peered":"2024-04-26T07:48:32.623425+0000","last_clean":"2024-04-26T07:48:32.623425+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:48:32.623425+0000","last_undegraded":"2024-04-26T07:48:32.623425+0000","last_fullsized":"2024-04-26T07:48:32.623425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594228+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:48:32.594228+0000","last_peered":"2024-04-26T07:48:32.594228+0000","last_clean":"2024-04-26T07:48:32.594228+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:48:32.594228+0000","last_undegraded":"2024-04-26T07:48:32.594228+0000","last_fullsized":"2024-04-26T07:48:32.594228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596808+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:48:32.596808+0000","last_peered":"2024-04-26T07:48:32.596808+0000","last_clean":"2024-04-26T07:48:32.596808+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:48:32.596808+0000","last_undegraded":"2024-04-26T07:48:32.596808+0000","last_fullsized":"2024-04-26T07:48:32.596808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.521486+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:48:33.521486+0000","last_peered":"2024-04-26T07:48:33.521486+0000","last_clean":"2024-04-26T07:48:33.521486+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:48:33.521486+0000","last_undegraded":"2024-04-26T07:48:33.521486+0000","last_fullsized":"2024-04-26T07:48:33.521486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619799+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:48:32.619799+0000","last_peered":"2024-04-26T07:48:32.619799+0000","last_clean":"2024-04-26T07:48:32.619799+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:48:32.619799+0000","last_undegraded":"2024-04-26T07:48:32.619799+0000","last_fullsized":"2024-04-26T07:48:32.619799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592915+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:48:32.592915+0000","last_peered":"2024-04-26T07:48:32.592915+0000","last_clean":"2024-04-26T07:48:32.592915+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:48:32.592915+0000","last_undegraded":"2024-04-26T07:48:32.592915+0000","last_fullsized":"2024-04-26T07:48:32.592915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.597605+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:48:32.597605+0000","last_peered":"2024-04-26T07:48:32.597605+0000","last_clean":"2024-04-26T07:48:32.597605+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:48:32.597605+0000","last_undegraded":"2024-04-26T07:48:32.597605+0000","last_fullsized":"2024-04-26T07:48:32.597605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610841+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:48:32.610841+0000","last_peered":"2024-04-26T07:48:32.610841+0000","last_clean":"2024-04-26T07:48:32.610841+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:48:32.610841+0000","last_undegraded":"2024-04-26T07:48:32.610841+0000","last_fullsized":"2024-04-26T07:48:32.610841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622594+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:48:32.622594+0000","last_peered":"2024-04-26T07:48:32.622594+0000","last_clean":"2024-04-26T07:48:32.622594+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:48:32.622594+0000","last_undegraded":"2024-04-26T07:48:32.622594+0000","last_fullsized":"2024-04-26T07:48:32.622594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.300822+0000","last_change":"2024-04-26T07:48:27.578601+0000","last_active":"2024-04-26T07:48:33.300822+0000","last_peered":"2024-04-26T07:48:33.300822+0000","last_clean":"2024-04-26T07:48:33.300822+0000","last_became_active":"2024-04-26T07:48:27.577870+0000","last_became_peered":"2024-04-26T07:48:27.577870+0000","last_unstale":"2024-04-26T07:48:33.300822+0000","last_undegraded":"2024-04-26T07:48:33.300822+0000","last_fullsized":"2024-04-26T07:48:33.300822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610532+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:48:32.610532+0000","last_peered":"2024-04-26T07:48:32.610532+0000","last_clean":"2024-04-26T07:48:32.610532+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:48:32.610532+0000","last_undegraded":"2024-04-26T07:48:32.610532+0000","last_fullsized":"2024-04-26T07:48:32.610532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621726+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:48:32.621726+0000","last_peered":"2024-04-26T07:48:32.621726+0000","last_clean":"2024-04-26T07:48:32.621726+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:48:32.621726+0000","last_undegraded":"2024-04-26T07:48:32.621726+0000","last_fullsized":"2024-04-26T07:48:32.621726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599793+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:48:32.599793+0000","last_peered":"2024-04-26T07:48:32.599793+0000","last_clean":"2024-04-26T07:48:32.599793+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:48:32.599793+0000","last_undegraded":"2024-04-26T07:48:32.599793+0000","last_fullsized":"2024-04-26T07:48:32.599793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590114+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:48:32.590114+0000","last_peered":"2024-04-26T07:48:32.590114+0000","last_clean":"2024-04-26T07:48:32.590114+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:48:32.590114+0000","last_undegraded":"2024-04-26T07:48:32.590114+0000","last_fullsized":"2024-04-26T07:48:32.590114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591513+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:48:32.591513+0000","last_peered":"2024-04-26T07:48:32.591513+0000","last_clean":"2024-04-26T07:48:32.591513+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:48:32.591513+0000","last_undegraded":"2024-04-26T07:48:32.591513+0000","last_fullsized":"2024-04-26T07:48:32.591513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.499524+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:48:33.499524+0000","last_peered":"2024-04-26T07:48:33.499524+0000","last_clean":"2024-04-26T07:48:33.499524+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:48:33.499524+0000","last_undegraded":"2024-04-26T07:48:33.499524+0000","last_fullsized":"2024-04-26T07:48:33.499524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610039+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:48:32.610039+0000","last_peered":"2024-04-26T07:48:32.610039+0000","last_clean":"2024-04-26T07:48:32.610039+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:48:32.610039+0000","last_undegraded":"2024-04-26T07:48:32.610039+0000","last_fullsized":"2024-04-26T07:48:32.610039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616922+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:48:32.616922+0000","last_peered":"2024-04-26T07:48:32.616922+0000","last_clean":"2024-04-26T07:48:32.616922+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:48:32.616922+0000","last_undegraded":"2024-04-26T07:48:32.616922+0000","last_fullsized":"2024-04-26T07:48:32.616922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640769+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:48:32.640769+0000","last_peered":"2024-04-26T07:48:32.640769+0000","last_clean":"2024-04-26T07:48:32.640769+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:48:32.640769+0000","last_undegraded":"2024-04-26T07:48:32.640769+0000","last_fullsized":"2024-04-26T07:48:32.640769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593960+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:48:32.593960+0000","last_peered":"2024-04-26T07:48:32.593960+0000","last_clean":"2024-04-26T07:48:32.593960+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:48:32.593960+0000","last_undegraded":"2024-04-26T07:48:32.593960+0000","last_fullsized":"2024-04-26T07:48:32.593960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610928+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:48:32.610928+0000","last_peered":"2024-04-26T07:48:32.610928+0000","last_clean":"2024-04-26T07:48:32.610928+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:48:32.610928+0000","last_undegraded":"2024-04-26T07:48:32.610928+0000","last_fullsized":"2024-04-26T07:48:32.610928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.476275+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:48:33.476275+0000","last_peered":"2024-04-26T07:48:33.476275+0000","last_clean":"2024-04-26T07:48:33.476275+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:48:33.476275+0000","last_undegraded":"2024-04-26T07:48:33.476275+0000","last_fullsized":"2024-04-26T07:48:33.476275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622282+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:48:32.622282+0000","last_peered":"2024-04-26T07:48:32.622282+0000","last_clean":"2024-04-26T07:48:32.622282+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:48:32.622282+0000","last_undegraded":"2024-04-26T07:48:32.622282+0000","last_fullsized":"2024-04-26T07:48:32.622282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611619+0000","last_change":"2024-04-26T07:48:31.605556+0000","last_active":"2024-04-26T07:48:32.611619+0000","last_peered":"2024-04-26T07:48:32.611619+0000","last_clean":"2024-04-26T07:48:32.611619+0000","last_became_active":"2024-04-26T07:48:31.604886+0000","last_became_peered":"2024-04-26T07:48:31.604886+0000","last_unstale":"2024-04-26T07:48:32.611619+0000","last_undegraded":"2024-04-26T07:48:32.611619+0000","last_fullsized":"2024-04-26T07:48:32.611619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589419+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:48:32.589419+0000","last_peered":"2024-04-26T07:48:32.589419+0000","last_clean":"2024-04-26T07:48:32.589419+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:48:32.589419+0000","last_undegraded":"2024-04-26T07:48:32.589419+0000","last_fullsized":"2024-04-26T07:48:32.589419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.620159+0000","last_change":"2024-04-26T07:48:21.523345+0000","last_active":"2024-04-26T07:48:32.620159+0000","last_peered":"2024-04-26T07:48:32.620159+0000","last_clean":"2024-04-26T07:48:32.620159+0000","last_became_active":"2024-04-26T07:48:21.521160+0000","last_became_peered":"2024-04-26T07:48:21.521160+0000","last_unstale":"2024-04-26T07:48:32.620159+0000","last_undegraded":"2024-04-26T07:48:32.620159+0000","last_fullsized":"2024-04-26T07:48:32.620159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612783+0000","last_change":"2024-04-26T07:48:25.576286+0000","last_active":"2024-04-26T07:48:32.612783+0000","last_peered":"2024-04-26T07:48:32.612783+0000","last_clean":"2024-04-26T07:48:32.612783+0000","last_became_active":"2024-04-26T07:48:25.575505+0000","last_became_peered":"2024-04-26T07:48:25.575505+0000","last_unstale":"2024-04-26T07:48:32.612783+0000","last_undegraded":"2024-04-26T07:48:32.612783+0000","last_fullsized":"2024-04-26T07:48:32.612783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.511270+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:48:33.511270+0000","last_peered":"2024-04-26T07:48:33.511270+0000","last_clean":"2024-04-26T07:48:33.511270+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:48:33.511270+0000","last_undegraded":"2024-04-26T07:48:33.511270+0000","last_fullsized":"2024-04-26T07:48:33.511270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590708+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:48:32.590708+0000","last_peered":"2024-04-26T07:48:32.590708+0000","last_clean":"2024-04-26T07:48:32.590708+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:48:32.590708+0000","last_undegraded":"2024-04-26T07:48:32.590708+0000","last_fullsized":"2024-04-26T07:48:32.590708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.615315+0000","last_change":"2024-04-26T07:48:31.598704+0000","last_active":"2024-04-26T07:48:32.615315+0000","last_peered":"2024-04-26T07:48:32.615315+0000","last_clean":"2024-04-26T07:48:32.615315+0000","last_became_active":"2024-04-26T07:48:31.597882+0000","last_became_peered":"2024-04-26T07:48:31.597882+0000","last_unstale":"2024-04-26T07:48:32.615315+0000","last_undegraded":"2024-04-26T07:48:32.615315+0000","last_fullsized":"2024-04-26T07:48:32.615315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589839+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:48:32.589839+0000","last_peered":"2024-04-26T07:48:32.589839+0000","last_clean":"2024-04-26T07:48:32.589839+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:48:32.589839+0000","last_undegraded":"2024-04-26T07:48:32.589839+0000","last_fullsized":"2024-04-26T07:48:32.589839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619300+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:48:32.619300+0000","last_peered":"2024-04-26T07:48:32.619300+0000","last_clean":"2024-04-26T07:48:32.619300+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:48:32.619300+0000","last_undegraded":"2024-04-26T07:48:32.619300+0000","last_fullsized":"2024-04-26T07:48:32.619300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617834+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:48:32.617834+0000","last_peered":"2024-04-26T07:48:32.617834+0000","last_clean":"2024-04-26T07:48:32.617834+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:48:32.617834+0000","last_undegraded":"2024-04-26T07:48:32.617834+0000","last_fullsized":"2024-04-26T07:48:32.617834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.936575+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:48:32.936575+0000","last_peered":"2024-04-26T07:48:32.936575+0000","last_clean":"2024-04-26T07:48:32.936575+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:48:32.936575+0000","last_undegraded":"2024-04-26T07:48:32.936575+0000","last_fullsized":"2024-04-26T07:48:32.936575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621238+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:48:32.621238+0000","last_peered":"2024-04-26T07:48:32.621238+0000","last_clean":"2024-04-26T07:48:32.621238+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:48:32.621238+0000","last_undegraded":"2024-04-26T07:48:32.621238+0000","last_fullsized":"2024-04-26T07:48:32.621238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599239+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:48:32.599239+0000","last_peered":"2024-04-26T07:48:32.599239+0000","last_clean":"2024-04-26T07:48:32.599239+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:48:32.599239+0000","last_undegraded":"2024-04-26T07:48:32.599239+0000","last_fullsized":"2024-04-26T07:48:32.599239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593383+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:48:32.593383+0000","last_peered":"2024-04-26T07:48:32.593383+0000","last_clean":"2024-04-26T07:48:32.593383+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:48:32.593383+0000","last_undegraded":"2024-04-26T07:48:32.593383+0000","last_fullsized":"2024-04-26T07:48:32.593383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599629+0000","last_change":"2024-04-26T07:48:21.503786+0000","last_active":"2024-04-26T07:48:32.599629+0000","last_peered":"2024-04-26T07:48:32.599629+0000","last_clean":"2024-04-26T07:48:32.599629+0000","last_became_active":"2024-04-26T07:48:21.503422+0000","last_became_peered":"2024-04-26T07:48:21.503422+0000","last_unstale":"2024-04-26T07:48:32.599629+0000","last_undegraded":"2024-04-26T07:48:32.599629+0000","last_fullsized":"2024-04-26T07:48:32.599629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588378+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:48:32.588378+0000","last_peered":"2024-04-26T07:48:32.588378+0000","last_clean":"2024-04-26T07:48:32.588378+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:48:32.588378+0000","last_undegraded":"2024-04-26T07:48:32.588378+0000","last_fullsized":"2024-04-26T07:48:32.588378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.124402+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:48:33.124402+0000","last_peered":"2024-04-26T07:48:33.124402+0000","last_clean":"2024-04-26T07:48:33.124402+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:48:33.124402+0000","last_undegraded":"2024-04-26T07:48:33.124402+0000","last_fullsized":"2024-04-26T07:48:33.124402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588892+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:48:32.588892+0000","last_peered":"2024-04-26T07:48:32.588892+0000","last_clean":"2024-04-26T07:48:32.588892+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:48:32.588892+0000","last_undegraded":"2024-04-26T07:48:32.588892+0000","last_fullsized":"2024-04-26T07:48:32.588892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614267+0000","last_change":"2024-04-26T07:48:31.591594+0000","last_active":"2024-04-26T07:48:32.614267+0000","last_peered":"2024-04-26T07:48:32.614267+0000","last_clean":"2024-04-26T07:48:32.614267+0000","last_became_active":"2024-04-26T07:48:31.590889+0000","last_became_peered":"2024-04-26T07:48:31.590889+0000","last_unstale":"2024-04-26T07:48:32.614267+0000","last_undegraded":"2024-04-26T07:48:32.614267+0000","last_fullsized":"2024-04-26T07:48:32.614267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588839+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:48:32.588839+0000","last_peered":"2024-04-26T07:48:32.588839+0000","last_clean":"2024-04-26T07:48:32.588839+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:48:32.588839+0000","last_undegraded":"2024-04-26T07:48:32.588839+0000","last_fullsized":"2024-04-26T07:48:32.588839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596852+0000","last_change":"2024-04-26T07:48:21.506013+0000","last_active":"2024-04-26T07:48:32.596852+0000","last_peered":"2024-04-26T07:48:32.596852+0000","last_clean":"2024-04-26T07:48:32.596852+0000","last_became_active":"2024-04-26T07:48:21.505104+0000","last_became_peered":"2024-04-26T07:48:21.505104+0000","last_unstale":"2024-04-26T07:48:32.596852+0000","last_undegraded":"2024-04-26T07:48:32.596852+0000","last_fullsized":"2024-04-26T07:48:32.596852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609158+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:48:32.609158+0000","last_peered":"2024-04-26T07:48:32.609158+0000","last_clean":"2024-04-26T07:48:32.609158+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:48:32.609158+0000","last_undegraded":"2024-04-26T07:48:32.609158+0000","last_fullsized":"2024-04-26T07:48:32.609158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.193324+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:48:33.193324+0000","last_peered":"2024-04-26T07:48:33.193324+0000","last_clean":"2024-04-26T07:48:33.193324+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:48:33.193324+0000","last_undegraded":"2024-04-26T07:48:33.193324+0000","last_fullsized":"2024-04-26T07:48:33.193324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593109+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:48:32.593109+0000","last_peered":"2024-04-26T07:48:32.593109+0000","last_clean":"2024-04-26T07:48:32.593109+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:48:32.593109+0000","last_undegraded":"2024-04-26T07:48:32.593109+0000","last_fullsized":"2024-04-26T07:48:32.593109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591741+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:48:32.591741+0000","last_peered":"2024-04-26T07:48:32.591741+0000","last_clean":"2024-04-26T07:48:32.591741+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:48:32.591741+0000","last_undegraded":"2024-04-26T07:48:32.591741+0000","last_fullsized":"2024-04-26T07:48:32.591741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611127+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:48:32.611127+0000","last_peered":"2024-04-26T07:48:32.611127+0000","last_clean":"2024-04-26T07:48:32.611127+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:48:32.611127+0000","last_undegraded":"2024-04-26T07:48:32.611127+0000","last_fullsized":"2024-04-26T07:48:32.611127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621107+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:48:32.621107+0000","last_peered":"2024-04-26T07:48:32.621107+0000","last_clean":"2024-04-26T07:48:32.621107+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:48:32.621107+0000","last_undegraded":"2024-04-26T07:48:32.621107+0000","last_fullsized":"2024-04-26T07:48:32.621107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611076+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:48:32.611076+0000","last_peered":"2024-04-26T07:48:32.611076+0000","last_clean":"2024-04-26T07:48:32.611076+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:48:32.611076+0000","last_undegraded":"2024-04-26T07:48:32.611076+0000","last_fullsized":"2024-04-26T07:48:32.611076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.639741+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:48:32.639741+0000","last_peered":"2024-04-26T07:48:32.639741+0000","last_clean":"2024-04-26T07:48:32.639741+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:48:32.639741+0000","last_undegraded":"2024-04-26T07:48:32.639741+0000","last_fullsized":"2024-04-26T07:48:32.639741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617830+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:48:32.617830+0000","last_peered":"2024-04-26T07:48:32.617830+0000","last_clean":"2024-04-26T07:48:32.617830+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:48:32.617830+0000","last_undegraded":"2024-04-26T07:48:32.617830+0000","last_fullsized":"2024-04-26T07:48:32.617830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618414+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:48:32.618414+0000","last_peered":"2024-04-26T07:48:32.618414+0000","last_clean":"2024-04-26T07:48:32.618414+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:48:32.618414+0000","last_undegraded":"2024-04-26T07:48:32.618414+0000","last_fullsized":"2024-04-26T07:48:32.618414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611806+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:48:32.611806+0000","last_peered":"2024-04-26T07:48:32.611806+0000","last_clean":"2024-04-26T07:48:32.611806+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:48:32.611806+0000","last_undegraded":"2024-04-26T07:48:32.611806+0000","last_fullsized":"2024-04-26T07:48:32.611806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595435+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:48:32.595435+0000","last_peered":"2024-04-26T07:48:32.595435+0000","last_clean":"2024-04-26T07:48:32.595435+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:48:32.595435+0000","last_undegraded":"2024-04-26T07:48:32.595435+0000","last_fullsized":"2024-04-26T07:48:32.595435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596319+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:48:32.596319+0000","last_peered":"2024-04-26T07:48:32.596319+0000","last_clean":"2024-04-26T07:48:32.596319+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:48:32.596319+0000","last_undegraded":"2024-04-26T07:48:32.596319+0000","last_fullsized":"2024-04-26T07:48:32.596319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598592+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:48:32.598592+0000","last_peered":"2024-04-26T07:48:32.598592+0000","last_clean":"2024-04-26T07:48:32.598592+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:48:32.598592+0000","last_undegraded":"2024-04-26T07:48:32.598592+0000","last_fullsized":"2024-04-26T07:48:32.598592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590055+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:48:32.590055+0000","last_peered":"2024-04-26T07:48:32.590055+0000","last_clean":"2024-04-26T07:48:32.590055+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:48:32.590055+0000","last_undegraded":"2024-04-26T07:48:32.590055+0000","last_fullsized":"2024-04-26T07:48:32.590055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611505+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:48:32.611505+0000","last_peered":"2024-04-26T07:48:32.611505+0000","last_clean":"2024-04-26T07:48:32.611505+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:48:32.611505+0000","last_undegraded":"2024-04-26T07:48:32.611505+0000","last_fullsized":"2024-04-26T07:48:32.611505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592808+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:48:32.592808+0000","last_peered":"2024-04-26T07:48:32.592808+0000","last_clean":"2024-04-26T07:48:32.592808+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:48:32.592808+0000","last_undegraded":"2024-04-26T07:48:32.592808+0000","last_fullsized":"2024-04-26T07:48:32.592808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622687+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:48:32.622687+0000","last_peered":"2024-04-26T07:48:32.622687+0000","last_clean":"2024-04-26T07:48:32.622687+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:48:32.622687+0000","last_undegraded":"2024-04-26T07:48:32.622687+0000","last_fullsized":"2024-04-26T07:48:32.622687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.620978+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:48:32.620978+0000","last_peered":"2024-04-26T07:48:32.620978+0000","last_clean":"2024-04-26T07:48:32.620978+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:48:32.620978+0000","last_undegraded":"2024-04-26T07:48:32.620978+0000","last_fullsized":"2024-04-26T07:48:32.620978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.600079+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:48:32.600079+0000","last_peered":"2024-04-26T07:48:32.600079+0000","last_clean":"2024-04-26T07:48:32.600079+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:48:32.600079+0000","last_undegraded":"2024-04-26T07:48:32.600079+0000","last_fullsized":"2024-04-26T07:48:32.600079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596517+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:48:32.596517+0000","last_peered":"2024-04-26T07:48:32.596517+0000","last_clean":"2024-04-26T07:48:32.596517+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:48:32.596517+0000","last_undegraded":"2024-04-26T07:48:32.596517+0000","last_fullsized":"2024-04-26T07:48:32.596517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617940+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:48:32.617940+0000","last_peered":"2024-04-26T07:48:32.617940+0000","last_clean":"2024-04-26T07:48:32.617940+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:48:32.617940+0000","last_undegraded":"2024-04-26T07:48:32.617940+0000","last_fullsized":"2024-04-26T07:48:32.617940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591008+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:48:32.591008+0000","last_peered":"2024-04-26T07:48:32.591008+0000","last_clean":"2024-04-26T07:48:32.591008+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:48:32.591008+0000","last_undegraded":"2024-04-26T07:48:32.591008+0000","last_fullsized":"2024-04-26T07:48:32.591008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593587+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:48:32.593587+0000","last_peered":"2024-04-26T07:48:32.593587+0000","last_clean":"2024-04-26T07:48:32.593587+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:48:32.593587+0000","last_undegraded":"2024-04-26T07:48:32.593587+0000","last_fullsized":"2024-04-26T07:48:32.593587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640863+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:48:32.640863+0000","last_peered":"2024-04-26T07:48:32.640863+0000","last_clean":"2024-04-26T07:48:32.640863+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:48:32.640863+0000","last_undegraded":"2024-04-26T07:48:32.640863+0000","last_fullsized":"2024-04-26T07:48:32.640863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618861+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:48:32.618861+0000","last_peered":"2024-04-26T07:48:32.618861+0000","last_clean":"2024-04-26T07:48:32.618861+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:48:32.618861+0000","last_undegraded":"2024-04-26T07:48:32.618861+0000","last_fullsized":"2024-04-26T07:48:32.618861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591134+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:48:32.591134+0000","last_peered":"2024-04-26T07:48:32.591134+0000","last_clean":"2024-04-26T07:48:32.591134+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:48:32.591134+0000","last_undegraded":"2024-04-26T07:48:32.591134+0000","last_fullsized":"2024-04-26T07:48:32.591134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596316+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:48:32.596316+0000","last_peered":"2024-04-26T07:48:32.596316+0000","last_clean":"2024-04-26T07:48:32.596316+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:48:32.596316+0000","last_undegraded":"2024-04-26T07:48:32.596316+0000","last_fullsized":"2024-04-26T07:48:32.596316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613812+0000","last_change":"2024-04-26T07:48:23.552189+0000","last_active":"2024-04-26T07:48:32.613812+0000","last_peered":"2024-04-26T07:48:32.613812+0000","last_clean":"2024-04-26T07:48:32.613812+0000","last_became_active":"2024-04-26T07:48:23.547277+0000","last_became_peered":"2024-04-26T07:48:23.547277+0000","last_unstale":"2024-04-26T07:48:32.613812+0000","last_undegraded":"2024-04-26T07:48:32.613812+0000","last_fullsized":"2024-04-26T07:48:32.613812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622175+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:48:32.622175+0000","last_peered":"2024-04-26T07:48:32.622175+0000","last_clean":"2024-04-26T07:48:32.622175+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:48:32.622175+0000","last_undegraded":"2024-04-26T07:48:32.622175+0000","last_fullsized":"2024-04-26T07:48:32.622175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593015+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:48:32.593015+0000","last_peered":"2024-04-26T07:48:32.593015+0000","last_clean":"2024-04-26T07:48:32.593015+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:48:32.593015+0000","last_undegraded":"2024-04-26T07:48:32.593015+0000","last_fullsized":"2024-04-26T07:48:32.593015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614924+0000","last_change":"2024-04-26T07:48:21.521908+0000","last_active":"2024-04-26T07:48:32.614924+0000","last_peered":"2024-04-26T07:48:32.614924+0000","last_clean":"2024-04-26T07:48:32.614924+0000","last_became_active":"2024-04-26T07:48:21.520599+0000","last_became_peered":"2024-04-26T07:48:21.520599+0000","last_unstale":"2024-04-26T07:48:32.614924+0000","last_undegraded":"2024-04-26T07:48:32.614924+0000","last_fullsized":"2024-04-26T07:48:32.614924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592541+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:48:32.592541+0000","last_peered":"2024-04-26T07:48:32.592541+0000","last_clean":"2024-04-26T07:48:32.592541+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:48:32.592541+0000","last_undegraded":"2024-04-26T07:48:32.592541+0000","last_fullsized":"2024-04-26T07:48:32.592541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.641446+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:48:32.641446+0000","last_peered":"2024-04-26T07:48:32.641446+0000","last_clean":"2024-04-26T07:48:32.641446+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:48:32.641446+0000","last_undegraded":"2024-04-26T07:48:32.641446+0000","last_fullsized":"2024-04-26T07:48:32.641446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611749+0000","last_change":"2024-04-26T07:48:23.557177+0000","last_active":"2024-04-26T07:48:32.611749+0000","last_peered":"2024-04-26T07:48:32.611749+0000","last_clean":"2024-04-26T07:48:32.611749+0000","last_became_active":"2024-04-26T07:48:23.556564+0000","last_became_peered":"2024-04-26T07:48:23.556564+0000","last_unstale":"2024-04-26T07:48:32.611749+0000","last_undegraded":"2024-04-26T07:48:32.611749+0000","last_fullsized":"2024-04-26T07:48:32.611749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619852+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:48:32.619852+0000","last_peered":"2024-04-26T07:48:32.619852+0000","last_clean":"2024-04-26T07:48:32.619852+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:48:32.619852+0000","last_undegraded":"2024-04-26T07:48:32.619852+0000","last_fullsized":"2024-04-26T07:48:32.619852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617686+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:48:32.617686+0000","last_peered":"2024-04-26T07:48:32.617686+0000","last_clean":"2024-04-26T07:48:32.617686+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:48:32.617686+0000","last_undegraded":"2024-04-26T07:48:32.617686+0000","last_fullsized":"2024-04-26T07:48:32.617686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596263+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:48:32.596263+0000","last_peered":"2024-04-26T07:48:32.596263+0000","last_clean":"2024-04-26T07:48:32.596263+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:48:32.596263+0000","last_undegraded":"2024-04-26T07:48:32.596263+0000","last_fullsized":"2024-04-26T07:48:32.596263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610449+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:48:32.610449+0000","last_peered":"2024-04-26T07:48:32.610449+0000","last_clean":"2024-04-26T07:48:32.610449+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:48:32.610449+0000","last_undegraded":"2024-04-26T07:48:32.610449+0000","last_fullsized":"2024-04-26T07:48:32.610449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619472+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:48:32.619472+0000","last_peered":"2024-04-26T07:48:32.619472+0000","last_clean":"2024-04-26T07:48:32.619472+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:48:32.619472+0000","last_undegraded":"2024-04-26T07:48:32.619472+0000","last_fullsized":"2024-04-26T07:48:32.619472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":734425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":143397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":144225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":142895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":145222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":142959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":144083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36264,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335576,"statfs":{"total":96636764160,"available":96599629824,"internally_reserved":0,"allocated":946176,"data_stored":734824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:48:39.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:48:39.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:39.892 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:48:39.903 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-26T07:48:39.787596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240880,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733840,"statfs":{"total":773094113280,"available":772847452160,"internally_reserved":0,"allocated":4038656,"data_stored":2332030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.223400"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614655+0000","last_change":"2024-04-26T07:48:21.522910+0000","last_active":"2024-04-26T07:48:32.614655+0000","last_peered":"2024-04-26T07:48:32.614655+0000","last_clean":"2024-04-26T07:48:32.614655+0000","last_became_active":"2024-04-26T07:48:21.522270+0000","last_became_peered":"2024-04-26T07:48:21.522270+0000","last_unstale":"2024-04-26T07:48:32.614655+0000","last_undegraded":"2024-04-26T07:48:32.614655+0000","last_fullsized":"2024-04-26T07:48:32.614655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616751+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:48:32.616751+0000","last_peered":"2024-04-26T07:48:32.616751+0000","last_clean":"2024-04-26T07:48:32.616751+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:48:32.616751+0000","last_undegraded":"2024-04-26T07:48:32.616751+0000","last_fullsized":"2024-04-26T07:48:32.616751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610853+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:48:32.610853+0000","last_peered":"2024-04-26T07:48:32.610853+0000","last_clean":"2024-04-26T07:48:32.610853+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:48:32.610853+0000","last_undegraded":"2024-04-26T07:48:32.610853+0000","last_fullsized":"2024-04-26T07:48:32.610853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612556+0000","last_change":"2024-04-26T07:48:23.546594+0000","last_active":"2024-04-26T07:48:32.612556+0000","last_peered":"2024-04-26T07:48:32.612556+0000","last_clean":"2024-04-26T07:48:32.612556+0000","last_became_active":"2024-04-26T07:48:23.545761+0000","last_became_peered":"2024-04-26T07:48:23.545761+0000","last_unstale":"2024-04-26T07:48:32.612556+0000","last_undegraded":"2024-04-26T07:48:32.612556+0000","last_fullsized":"2024-04-26T07:48:32.612556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595866+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:48:32.595866+0000","last_peered":"2024-04-26T07:48:32.595866+0000","last_clean":"2024-04-26T07:48:32.595866+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:48:32.595866+0000","last_undegraded":"2024-04-26T07:48:32.595866+0000","last_fullsized":"2024-04-26T07:48:32.595866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589370+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:48:32.589370+0000","last_peered":"2024-04-26T07:48:32.589370+0000","last_clean":"2024-04-26T07:48:32.589370+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:48:32.589370+0000","last_undegraded":"2024-04-26T07:48:32.589370+0000","last_fullsized":"2024-04-26T07:48:32.589370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.620096+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:48:32.620096+0000","last_peered":"2024-04-26T07:48:32.620096+0000","last_clean":"2024-04-26T07:48:32.620096+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:48:32.620096+0000","last_undegraded":"2024-04-26T07:48:32.620096+0000","last_fullsized":"2024-04-26T07:48:32.620096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594485+0000","last_change":"2024-04-26T07:48:23.549877+0000","last_active":"2024-04-26T07:48:32.594485+0000","last_peered":"2024-04-26T07:48:32.594485+0000","last_clean":"2024-04-26T07:48:32.594485+0000","last_became_active":"2024-04-26T07:48:23.549563+0000","last_became_peered":"2024-04-26T07:48:23.549563+0000","last_unstale":"2024-04-26T07:48:32.594485+0000","last_undegraded":"2024-04-26T07:48:32.594485+0000","last_fullsized":"2024-04-26T07:48:32.594485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614245+0000","last_change":"2024-04-26T07:48:21.523373+0000","last_active":"2024-04-26T07:48:32.614245+0000","last_peered":"2024-04-26T07:48:32.614245+0000","last_clean":"2024-04-26T07:48:32.614245+0000","last_became_active":"2024-04-26T07:48:21.522623+0000","last_became_peered":"2024-04-26T07:48:21.522623+0000","last_unstale":"2024-04-26T07:48:32.614245+0000","last_undegraded":"2024-04-26T07:48:32.614245+0000","last_fullsized":"2024-04-26T07:48:32.614245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621914+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:48:32.621914+0000","last_peered":"2024-04-26T07:48:32.621914+0000","last_clean":"2024-04-26T07:48:32.621914+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:48:32.621914+0000","last_undegraded":"2024-04-26T07:48:32.621914+0000","last_fullsized":"2024-04-26T07:48:32.621914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617728+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:48:32.617728+0000","last_peered":"2024-04-26T07:48:32.617728+0000","last_clean":"2024-04-26T07:48:32.617728+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:48:32.617728+0000","last_undegraded":"2024-04-26T07:48:32.617728+0000","last_fullsized":"2024-04-26T07:48:32.617728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590717+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:48:32.590717+0000","last_peered":"2024-04-26T07:48:32.590717+0000","last_clean":"2024-04-26T07:48:32.590717+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:48:32.590717+0000","last_undegraded":"2024-04-26T07:48:32.590717+0000","last_fullsized":"2024-04-26T07:48:32.590717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612793+0000","last_change":"2024-04-26T07:48:21.521442+0000","last_active":"2024-04-26T07:48:32.612793+0000","last_peered":"2024-04-26T07:48:32.612793+0000","last_clean":"2024-04-26T07:48:32.612793+0000","last_became_active":"2024-04-26T07:48:21.520835+0000","last_became_peered":"2024-04-26T07:48:21.520835+0000","last_unstale":"2024-04-26T07:48:32.612793+0000","last_undegraded":"2024-04-26T07:48:32.612793+0000","last_fullsized":"2024-04-26T07:48:32.612793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618576+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:48:32.618576+0000","last_peered":"2024-04-26T07:48:32.618576+0000","last_clean":"2024-04-26T07:48:32.618576+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:48:32.618576+0000","last_undegraded":"2024-04-26T07:48:32.618576+0000","last_fullsized":"2024-04-26T07:48:32.618576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593993+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:48:32.593993+0000","last_peered":"2024-04-26T07:48:32.593993+0000","last_clean":"2024-04-26T07:48:32.593993+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:48:32.593993+0000","last_undegraded":"2024-04-26T07:48:32.593993+0000","last_fullsized":"2024-04-26T07:48:32.593993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.641646+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:48:32.641646+0000","last_peered":"2024-04-26T07:48:32.641646+0000","last_clean":"2024-04-26T07:48:32.641646+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:48:32.641646+0000","last_undegraded":"2024-04-26T07:48:32.641646+0000","last_fullsized":"2024-04-26T07:48:32.641646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588726+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:48:32.588726+0000","last_peered":"2024-04-26T07:48:32.588726+0000","last_clean":"2024-04-26T07:48:32.588726+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:48:32.588726+0000","last_undegraded":"2024-04-26T07:48:32.588726+0000","last_fullsized":"2024-04-26T07:48:32.588726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614822+0000","last_change":"2024-04-26T07:48:21.530617+0000","last_active":"2024-04-26T07:48:32.614822+0000","last_peered":"2024-04-26T07:48:32.614822+0000","last_clean":"2024-04-26T07:48:32.614822+0000","last_became_active":"2024-04-26T07:48:21.529930+0000","last_became_peered":"2024-04-26T07:48:21.529930+0000","last_unstale":"2024-04-26T07:48:32.614822+0000","last_undegraded":"2024-04-26T07:48:32.614822+0000","last_fullsized":"2024-04-26T07:48:32.614822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.873875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612743+0000","last_change":"2024-04-26T07:48:23.553223+0000","last_active":"2024-04-26T07:48:32.612743+0000","last_peered":"2024-04-26T07:48:32.612743+0000","last_clean":"2024-04-26T07:48:32.612743+0000","last_became_active":"2024-04-26T07:48:23.547557+0000","last_became_peered":"2024-04-26T07:48:23.547557+0000","last_unstale":"2024-04-26T07:48:32.612743+0000","last_undegraded":"2024-04-26T07:48:32.612743+0000","last_fullsized":"2024-04-26T07:48:32.612743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622413+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:48:32.622413+0000","last_peered":"2024-04-26T07:48:32.622413+0000","last_clean":"2024-04-26T07:48:32.622413+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:48:32.622413+0000","last_undegraded":"2024-04-26T07:48:32.622413+0000","last_fullsized":"2024-04-26T07:48:32.622413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618073+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:48:32.618073+0000","last_peered":"2024-04-26T07:48:32.618073+0000","last_clean":"2024-04-26T07:48:32.618073+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:48:32.618073+0000","last_undegraded":"2024-04-26T07:48:32.618073+0000","last_fullsized":"2024-04-26T07:48:32.618073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622657+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:48:32.622657+0000","last_peered":"2024-04-26T07:48:32.622657+0000","last_clean":"2024-04-26T07:48:32.622657+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:48:32.622657+0000","last_undegraded":"2024-04-26T07:48:32.622657+0000","last_fullsized":"2024-04-26T07:48:32.622657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640324+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:48:32.640324+0000","last_peered":"2024-04-26T07:48:32.640324+0000","last_clean":"2024-04-26T07:48:32.640324+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:48:32.640324+0000","last_undegraded":"2024-04-26T07:48:32.640324+0000","last_fullsized":"2024-04-26T07:48:32.640324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590023+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:48:32.590023+0000","last_peered":"2024-04-26T07:48:32.590023+0000","last_clean":"2024-04-26T07:48:32.590023+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:48:32.590023+0000","last_undegraded":"2024-04-26T07:48:32.590023+0000","last_fullsized":"2024-04-26T07:48:32.590023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640642+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:48:32.640642+0000","last_peered":"2024-04-26T07:48:32.640642+0000","last_clean":"2024-04-26T07:48:32.640642+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:48:32.640642+0000","last_undegraded":"2024-04-26T07:48:32.640642+0000","last_fullsized":"2024-04-26T07:48:32.640642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593704+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:48:32.593704+0000","last_peered":"2024-04-26T07:48:32.593704+0000","last_clean":"2024-04-26T07:48:32.593704+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:48:32.593704+0000","last_undegraded":"2024-04-26T07:48:32.593704+0000","last_fullsized":"2024-04-26T07:48:32.593704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590820+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:48:32.590820+0000","last_peered":"2024-04-26T07:48:32.590820+0000","last_clean":"2024-04-26T07:48:32.590820+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:48:32.590820+0000","last_undegraded":"2024-04-26T07:48:32.590820+0000","last_fullsized":"2024-04-26T07:48:32.590820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594891+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:48:32.594891+0000","last_peered":"2024-04-26T07:48:32.594891+0000","last_clean":"2024-04-26T07:48:32.594891+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:48:32.594891+0000","last_undegraded":"2024-04-26T07:48:32.594891+0000","last_fullsized":"2024-04-26T07:48:32.594891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588689+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:48:32.588689+0000","last_peered":"2024-04-26T07:48:32.588689+0000","last_clean":"2024-04-26T07:48:32.588689+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:48:32.588689+0000","last_undegraded":"2024-04-26T07:48:32.588689+0000","last_fullsized":"2024-04-26T07:48:32.588689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598164+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:48:32.598164+0000","last_peered":"2024-04-26T07:48:32.598164+0000","last_clean":"2024-04-26T07:48:32.598164+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:48:32.598164+0000","last_undegraded":"2024-04-26T07:48:32.598164+0000","last_fullsized":"2024-04-26T07:48:32.598164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614662+0000","last_change":"2024-04-26T07:48:21.532476+0000","last_active":"2024-04-26T07:48:32.614662+0000","last_peered":"2024-04-26T07:48:32.614662+0000","last_clean":"2024-04-26T07:48:32.614662+0000","last_became_active":"2024-04-26T07:48:21.531890+0000","last_became_peered":"2024-04-26T07:48:21.531890+0000","last_unstale":"2024-04-26T07:48:32.614662+0000","last_undegraded":"2024-04-26T07:48:32.614662+0000","last_fullsized":"2024-04-26T07:48:32.614662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617734+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:48:32.617734+0000","last_peered":"2024-04-26T07:48:32.617734+0000","last_clean":"2024-04-26T07:48:32.617734+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:48:32.617734+0000","last_undegraded":"2024-04-26T07:48:32.617734+0000","last_fullsized":"2024-04-26T07:48:32.617734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.973091+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:48:32.973091+0000","last_peered":"2024-04-26T07:48:32.973091+0000","last_clean":"2024-04-26T07:48:32.973091+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:48:32.973091+0000","last_undegraded":"2024-04-26T07:48:32.973091+0000","last_fullsized":"2024-04-26T07:48:32.973091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614227+0000","last_change":"2024-04-26T07:48:29.585278+0000","last_active":"2024-04-26T07:48:32.614227+0000","last_peered":"2024-04-26T07:48:32.614227+0000","last_clean":"2024-04-26T07:48:32.614227+0000","last_became_active":"2024-04-26T07:48:29.584564+0000","last_became_peered":"2024-04-26T07:48:29.584564+0000","last_unstale":"2024-04-26T07:48:32.614227+0000","last_undegraded":"2024-04-26T07:48:32.614227+0000","last_fullsized":"2024-04-26T07:48:32.614227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616814+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:48:32.616814+0000","last_peered":"2024-04-26T07:48:32.616814+0000","last_clean":"2024-04-26T07:48:32.616814+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:48:32.616814+0000","last_undegraded":"2024-04-26T07:48:32.616814+0000","last_fullsized":"2024-04-26T07:48:32.616814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618710+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:48:32.618710+0000","last_peered":"2024-04-26T07:48:32.618710+0000","last_clean":"2024-04-26T07:48:32.618710+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:48:32.618710+0000","last_undegraded":"2024-04-26T07:48:32.618710+0000","last_fullsized":"2024-04-26T07:48:32.618710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595016+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:48:32.595016+0000","last_peered":"2024-04-26T07:48:32.595016+0000","last_clean":"2024-04-26T07:48:32.595016+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:48:32.595016+0000","last_undegraded":"2024-04-26T07:48:32.595016+0000","last_fullsized":"2024-04-26T07:48:32.595016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.597695+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:48:32.597695+0000","last_peered":"2024-04-26T07:48:32.597695+0000","last_clean":"2024-04-26T07:48:32.597695+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:48:32.597695+0000","last_undegraded":"2024-04-26T07:48:32.597695+0000","last_fullsized":"2024-04-26T07:48:32.597695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.371487+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:48:33.371487+0000","last_peered":"2024-04-26T07:48:33.371487+0000","last_clean":"2024-04-26T07:48:33.371487+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:48:33.371487+0000","last_undegraded":"2024-04-26T07:48:33.371487+0000","last_fullsized":"2024-04-26T07:48:33.371487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590510+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:48:32.590510+0000","last_peered":"2024-04-26T07:48:32.590510+0000","last_clean":"2024-04-26T07:48:32.590510+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:48:32.590510+0000","last_undegraded":"2024-04-26T07:48:32.590510+0000","last_fullsized":"2024-04-26T07:48:32.590510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593696+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:48:32.593696+0000","last_peered":"2024-04-26T07:48:32.593696+0000","last_clean":"2024-04-26T07:48:32.593696+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:48:32.593696+0000","last_undegraded":"2024-04-26T07:48:32.593696+0000","last_fullsized":"2024-04-26T07:48:32.593696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598308+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:48:32.598308+0000","last_peered":"2024-04-26T07:48:32.598308+0000","last_clean":"2024-04-26T07:48:32.598308+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:48:32.598308+0000","last_undegraded":"2024-04-26T07:48:32.598308+0000","last_fullsized":"2024-04-26T07:48:32.598308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613002+0000","last_change":"2024-04-26T07:48:21.532432+0000","last_active":"2024-04-26T07:48:32.613002+0000","last_peered":"2024-04-26T07:48:32.613002+0000","last_clean":"2024-04-26T07:48:32.613002+0000","last_became_active":"2024-04-26T07:48:21.531735+0000","last_became_peered":"2024-04-26T07:48:21.531735+0000","last_unstale":"2024-04-26T07:48:32.613002+0000","last_undegraded":"2024-04-26T07:48:32.613002+0000","last_fullsized":"2024-04-26T07:48:32.613002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:44.669301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.600506+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:48:32.600506+0000","last_peered":"2024-04-26T07:48:32.600506+0000","last_clean":"2024-04-26T07:48:32.600506+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:48:32.600506+0000","last_undegraded":"2024-04-26T07:48:32.600506+0000","last_fullsized":"2024-04-26T07:48:32.600506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.431402+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:48:33.431402+0000","last_peered":"2024-04-26T07:48:33.431402+0000","last_clean":"2024-04-26T07:48:33.431402+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:48:33.431402+0000","last_undegraded":"2024-04-26T07:48:33.431402+0000","last_fullsized":"2024-04-26T07:48:33.431402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613592+0000","last_change":"2024-04-26T07:48:29.580319+0000","last_active":"2024-04-26T07:48:32.613592+0000","last_peered":"2024-04-26T07:48:32.613592+0000","last_clean":"2024-04-26T07:48:32.613592+0000","last_became_active":"2024-04-26T07:48:29.579332+0000","last_became_peered":"2024-04-26T07:48:29.579332+0000","last_unstale":"2024-04-26T07:48:32.613592+0000","last_undegraded":"2024-04-26T07:48:32.613592+0000","last_fullsized":"2024-04-26T07:48:32.613592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589836+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:48:32.589836+0000","last_peered":"2024-04-26T07:48:32.589836+0000","last_clean":"2024-04-26T07:48:32.589836+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:48:32.589836+0000","last_undegraded":"2024-04-26T07:48:32.589836+0000","last_fullsized":"2024-04-26T07:48:32.589836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599980+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:48:32.599980+0000","last_peered":"2024-04-26T07:48:32.599980+0000","last_clean":"2024-04-26T07:48:32.599980+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:48:32.599980+0000","last_undegraded":"2024-04-26T07:48:32.599980+0000","last_fullsized":"2024-04-26T07:48:32.599980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621266+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:48:32.621266+0000","last_peered":"2024-04-26T07:48:32.621266+0000","last_clean":"2024-04-26T07:48:32.621266+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:48:32.621266+0000","last_undegraded":"2024-04-26T07:48:32.621266+0000","last_fullsized":"2024-04-26T07:48:32.621266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618324+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:48:32.618324+0000","last_peered":"2024-04-26T07:48:32.618324+0000","last_clean":"2024-04-26T07:48:32.618324+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:48:32.618324+0000","last_undegraded":"2024-04-26T07:48:32.618324+0000","last_fullsized":"2024-04-26T07:48:32.618324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.435760+0000","last_change":"2024-04-26T07:48:27.656615+0000","last_active":"2024-04-26T07:48:33.435760+0000","last_peered":"2024-04-26T07:48:33.435760+0000","last_clean":"2024-04-26T07:48:33.435760+0000","last_became_active":"2024-04-26T07:48:27.655900+0000","last_became_peered":"2024-04-26T07:48:27.655900+0000","last_unstale":"2024-04-26T07:48:33.435760+0000","last_undegraded":"2024-04-26T07:48:33.435760+0000","last_fullsized":"2024-04-26T07:48:33.435760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596446+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:48:32.596446+0000","last_peered":"2024-04-26T07:48:32.596446+0000","last_clean":"2024-04-26T07:48:32.596446+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:48:32.596446+0000","last_undegraded":"2024-04-26T07:48:32.596446+0000","last_fullsized":"2024-04-26T07:48:32.596446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617421+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:48:32.617421+0000","last_peered":"2024-04-26T07:48:32.617421+0000","last_clean":"2024-04-26T07:48:32.617421+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:48:32.617421+0000","last_undegraded":"2024-04-26T07:48:32.617421+0000","last_fullsized":"2024-04-26T07:48:32.617421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614904+0000","last_change":"2024-04-26T07:48:21.532535+0000","last_active":"2024-04-26T07:48:32.614904+0000","last_peered":"2024-04-26T07:48:32.614904+0000","last_clean":"2024-04-26T07:48:32.614904+0000","last_became_active":"2024-04-26T07:48:21.531870+0000","last_became_peered":"2024-04-26T07:48:21.531870+0000","last_unstale":"2024-04-26T07:48:32.614904+0000","last_undegraded":"2024-04-26T07:48:32.614904+0000","last_fullsized":"2024-04-26T07:48:32.614904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:53.041052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611794+0000","last_change":"2024-04-26T07:48:25.580567+0000","last_active":"2024-04-26T07:48:32.611794+0000","last_peered":"2024-04-26T07:48:32.611794+0000","last_clean":"2024-04-26T07:48:32.611794+0000","last_became_active":"2024-04-26T07:48:25.579735+0000","last_became_peered":"2024-04-26T07:48:25.579735+0000","last_unstale":"2024-04-26T07:48:32.611794+0000","last_undegraded":"2024-04-26T07:48:32.611794+0000","last_fullsized":"2024-04-26T07:48:32.611794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.532551+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:48:33.532551+0000","last_peered":"2024-04-26T07:48:33.532551+0000","last_clean":"2024-04-26T07:48:33.532551+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:48:33.532551+0000","last_undegraded":"2024-04-26T07:48:33.532551+0000","last_fullsized":"2024-04-26T07:48:33.532551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609575+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:48:32.609575+0000","last_peered":"2024-04-26T07:48:32.609575+0000","last_clean":"2024-04-26T07:48:32.609575+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:48:32.609575+0000","last_undegraded":"2024-04-26T07:48:32.609575+0000","last_fullsized":"2024-04-26T07:48:32.609575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619960+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:48:32.619960+0000","last_peered":"2024-04-26T07:48:32.619960+0000","last_clean":"2024-04-26T07:48:32.619960+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:48:32.619960+0000","last_undegraded":"2024-04-26T07:48:32.619960+0000","last_fullsized":"2024-04-26T07:48:32.619960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589122+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:48:32.589122+0000","last_peered":"2024-04-26T07:48:32.589122+0000","last_clean":"2024-04-26T07:48:32.589122+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:48:32.589122+0000","last_undegraded":"2024-04-26T07:48:32.589122+0000","last_fullsized":"2024-04-26T07:48:32.589122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613891+0000","last_change":"2024-04-26T07:48:21.531367+0000","last_active":"2024-04-26T07:48:32.613891+0000","last_peered":"2024-04-26T07:48:32.613891+0000","last_clean":"2024-04-26T07:48:32.613891+0000","last_became_active":"2024-04-26T07:48:21.530818+0000","last_became_peered":"2024-04-26T07:48:21.530818+0000","last_unstale":"2024-04-26T07:48:32.613891+0000","last_undegraded":"2024-04-26T07:48:32.613891+0000","last_fullsized":"2024-04-26T07:48:32.613891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.639686+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:48:32.639686+0000","last_peered":"2024-04-26T07:48:32.639686+0000","last_clean":"2024-04-26T07:48:32.639686+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:48:32.639686+0000","last_undegraded":"2024-04-26T07:48:32.639686+0000","last_fullsized":"2024-04-26T07:48:32.639686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.408665+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:48:33.408665+0000","last_peered":"2024-04-26T07:48:33.408665+0000","last_clean":"2024-04-26T07:48:33.408665+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:48:33.408665+0000","last_undegraded":"2024-04-26T07:48:33.408665+0000","last_fullsized":"2024-04-26T07:48:33.408665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594020+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:48:32.594020+0000","last_peered":"2024-04-26T07:48:32.594020+0000","last_clean":"2024-04-26T07:48:32.594020+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:48:32.594020+0000","last_undegraded":"2024-04-26T07:48:32.594020+0000","last_fullsized":"2024-04-26T07:48:32.594020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621907+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:48:32.621907+0000","last_peered":"2024-04-26T07:48:32.621907+0000","last_clean":"2024-04-26T07:48:32.621907+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:48:32.621907+0000","last_undegraded":"2024-04-26T07:48:32.621907+0000","last_fullsized":"2024-04-26T07:48:32.621907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623110+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:48:32.623110+0000","last_peered":"2024-04-26T07:48:32.623110+0000","last_clean":"2024-04-26T07:48:32.623110+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:48:32.623110+0000","last_undegraded":"2024-04-26T07:48:32.623110+0000","last_fullsized":"2024-04-26T07:48:32.623110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614688+0000","last_change":"2024-04-26T07:48:21.528922+0000","last_active":"2024-04-26T07:48:32.614688+0000","last_peered":"2024-04-26T07:48:32.614688+0000","last_clean":"2024-04-26T07:48:32.614688+0000","last_became_active":"2024-04-26T07:48:21.528409+0000","last_became_peered":"2024-04-26T07:48:21.528409+0000","last_unstale":"2024-04-26T07:48:32.614688+0000","last_undegraded":"2024-04-26T07:48:32.614688+0000","last_fullsized":"2024-04-26T07:48:32.614688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640985+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:48:32.640985+0000","last_peered":"2024-04-26T07:48:32.640985+0000","last_clean":"2024-04-26T07:48:32.640985+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:48:32.640985+0000","last_undegraded":"2024-04-26T07:48:32.640985+0000","last_fullsized":"2024-04-26T07:48:32.640985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.321518+0000","last_change":"2024-04-26T07:48:27.575739+0000","last_active":"2024-04-26T07:48:33.321518+0000","last_peered":"2024-04-26T07:48:33.321518+0000","last_clean":"2024-04-26T07:48:33.321518+0000","last_became_active":"2024-04-26T07:48:27.574665+0000","last_became_peered":"2024-04-26T07:48:27.574665+0000","last_unstale":"2024-04-26T07:48:33.321518+0000","last_undegraded":"2024-04-26T07:48:33.321518+0000","last_fullsized":"2024-04-26T07:48:33.321518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591459+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:48:32.591459+0000","last_peered":"2024-04-26T07:48:32.591459+0000","last_clean":"2024-04-26T07:48:32.591459+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:48:32.591459+0000","last_undegraded":"2024-04-26T07:48:32.591459+0000","last_fullsized":"2024-04-26T07:48:32.591459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596153+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:48:32.596153+0000","last_peered":"2024-04-26T07:48:32.596153+0000","last_clean":"2024-04-26T07:48:32.596153+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:48:32.596153+0000","last_undegraded":"2024-04-26T07:48:32.596153+0000","last_fullsized":"2024-04-26T07:48:32.596153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598381+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:48:32.598381+0000","last_peered":"2024-04-26T07:48:32.598381+0000","last_clean":"2024-04-26T07:48:32.598381+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:48:32.598381+0000","last_undegraded":"2024-04-26T07:48:32.598381+0000","last_fullsized":"2024-04-26T07:48:32.598381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.620387+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:48:32.620387+0000","last_peered":"2024-04-26T07:48:32.620387+0000","last_clean":"2024-04-26T07:48:32.620387+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:48:32.620387+0000","last_undegraded":"2024-04-26T07:48:32.620387+0000","last_fullsized":"2024-04-26T07:48:32.620387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640029+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:48:32.640029+0000","last_peered":"2024-04-26T07:48:32.640029+0000","last_clean":"2024-04-26T07:48:32.640029+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:48:32.640029+0000","last_undegraded":"2024-04-26T07:48:32.640029+0000","last_fullsized":"2024-04-26T07:48:32.640029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.941198+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:48:32.941198+0000","last_peered":"2024-04-26T07:48:32.941198+0000","last_clean":"2024-04-26T07:48:32.941198+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:48:32.941198+0000","last_undegraded":"2024-04-26T07:48:32.941198+0000","last_fullsized":"2024-04-26T07:48:32.941198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.639544+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:48:32.639544+0000","last_peered":"2024-04-26T07:48:32.639544+0000","last_clean":"2024-04-26T07:48:32.639544+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:48:32.639544+0000","last_undegraded":"2024-04-26T07:48:32.639544+0000","last_fullsized":"2024-04-26T07:48:32.639544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611305+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:48:32.611305+0000","last_peered":"2024-04-26T07:48:32.611305+0000","last_clean":"2024-04-26T07:48:32.611305+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:48:32.611305+0000","last_undegraded":"2024-04-26T07:48:32.611305+0000","last_fullsized":"2024-04-26T07:48:32.611305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590483+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:48:32.590483+0000","last_peered":"2024-04-26T07:48:32.590483+0000","last_clean":"2024-04-26T07:48:32.590483+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:48:32.590483+0000","last_undegraded":"2024-04-26T07:48:32.590483+0000","last_fullsized":"2024-04-26T07:48:32.590483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593051+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:48:32.593051+0000","last_peered":"2024-04-26T07:48:32.593051+0000","last_clean":"2024-04-26T07:48:32.593051+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:48:32.593051+0000","last_undegraded":"2024-04-26T07:48:32.593051+0000","last_fullsized":"2024-04-26T07:48:32.593051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640590+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:48:32.640590+0000","last_peered":"2024-04-26T07:48:32.640590+0000","last_clean":"2024-04-26T07:48:32.640590+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:48:32.640590+0000","last_undegraded":"2024-04-26T07:48:32.640590+0000","last_fullsized":"2024-04-26T07:48:32.640590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.470080+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:48:33.470080+0000","last_peered":"2024-04-26T07:48:33.470080+0000","last_clean":"2024-04-26T07:48:33.470080+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:48:33.470080+0000","last_undegraded":"2024-04-26T07:48:33.470080+0000","last_fullsized":"2024-04-26T07:48:33.470080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596037+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:48:32.596037+0000","last_peered":"2024-04-26T07:48:32.596037+0000","last_clean":"2024-04-26T07:48:32.596037+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:48:32.596037+0000","last_undegraded":"2024-04-26T07:48:32.596037+0000","last_fullsized":"2024-04-26T07:48:32.596037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595040+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:48:32.595040+0000","last_peered":"2024-04-26T07:48:32.595040+0000","last_clean":"2024-04-26T07:48:32.595040+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:48:32.595040+0000","last_undegraded":"2024-04-26T07:48:32.595040+0000","last_fullsized":"2024-04-26T07:48:32.595040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590987+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:48:32.590987+0000","last_peered":"2024-04-26T07:48:32.590987+0000","last_clean":"2024-04-26T07:48:32.590987+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:48:32.590987+0000","last_undegraded":"2024-04-26T07:48:32.590987+0000","last_fullsized":"2024-04-26T07:48:32.590987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623189+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:48:32.623189+0000","last_peered":"2024-04-26T07:48:32.623189+0000","last_clean":"2024-04-26T07:48:32.623189+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:48:32.623189+0000","last_undegraded":"2024-04-26T07:48:32.623189+0000","last_fullsized":"2024-04-26T07:48:32.623189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610858+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:48:32.610858+0000","last_peered":"2024-04-26T07:48:32.610858+0000","last_clean":"2024-04-26T07:48:32.610858+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:48:32.610858+0000","last_undegraded":"2024-04-26T07:48:32.610858+0000","last_fullsized":"2024-04-26T07:48:32.610858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.545785+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:48:33.545785+0000","last_peered":"2024-04-26T07:48:33.545785+0000","last_clean":"2024-04-26T07:48:33.545785+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:48:33.545785+0000","last_undegraded":"2024-04-26T07:48:33.545785+0000","last_fullsized":"2024-04-26T07:48:33.545785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.641116+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:48:32.641116+0000","last_peered":"2024-04-26T07:48:32.641116+0000","last_clean":"2024-04-26T07:48:32.641116+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:48:32.641116+0000","last_undegraded":"2024-04-26T07:48:32.641116+0000","last_fullsized":"2024-04-26T07:48:32.641116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609816+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:48:32.609816+0000","last_peered":"2024-04-26T07:48:32.609816+0000","last_clean":"2024-04-26T07:48:32.609816+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:48:32.609816+0000","last_undegraded":"2024-04-26T07:48:32.609816+0000","last_fullsized":"2024-04-26T07:48:32.609816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591349+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:48:32.591349+0000","last_peered":"2024-04-26T07:48:32.591349+0000","last_clean":"2024-04-26T07:48:32.591349+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:48:32.591349+0000","last_undegraded":"2024-04-26T07:48:32.591349+0000","last_fullsized":"2024-04-26T07:48:32.591349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589741+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:48:32.589741+0000","last_peered":"2024-04-26T07:48:32.589741+0000","last_clean":"2024-04-26T07:48:32.589741+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:48:32.589741+0000","last_undegraded":"2024-04-26T07:48:32.589741+0000","last_fullsized":"2024-04-26T07:48:32.589741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618300+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:48:32.618300+0000","last_peered":"2024-04-26T07:48:32.618300+0000","last_clean":"2024-04-26T07:48:32.618300+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:48:32.618300+0000","last_undegraded":"2024-04-26T07:48:32.618300+0000","last_fullsized":"2024-04-26T07:48:32.618300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.330966+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:48:33.330966+0000","last_peered":"2024-04-26T07:48:33.330966+0000","last_clean":"2024-04-26T07:48:33.330966+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:48:33.330966+0000","last_undegraded":"2024-04-26T07:48:33.330966+0000","last_fullsized":"2024-04-26T07:48:33.330966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622191+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:48:32.622191+0000","last_peered":"2024-04-26T07:48:32.622191+0000","last_clean":"2024-04-26T07:48:32.622191+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:48:32.622191+0000","last_undegraded":"2024-04-26T07:48:32.622191+0000","last_fullsized":"2024-04-26T07:48:32.622191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589693+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:48:32.589693+0000","last_peered":"2024-04-26T07:48:32.589693+0000","last_clean":"2024-04-26T07:48:32.589693+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:48:32.589693+0000","last_undegraded":"2024-04-26T07:48:32.589693+0000","last_fullsized":"2024-04-26T07:48:32.589693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611734+0000","last_change":"2024-04-26T07:48:23.549303+0000","last_active":"2024-04-26T07:48:32.611734+0000","last_peered":"2024-04-26T07:48:32.611734+0000","last_clean":"2024-04-26T07:48:32.611734+0000","last_became_active":"2024-04-26T07:48:23.548989+0000","last_became_peered":"2024-04-26T07:48:23.548989+0000","last_unstale":"2024-04-26T07:48:32.611734+0000","last_undegraded":"2024-04-26T07:48:32.611734+0000","last_fullsized":"2024-04-26T07:48:32.611734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594463+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:48:32.594463+0000","last_peered":"2024-04-26T07:48:32.594463+0000","last_clean":"2024-04-26T07:48:32.594463+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:48:32.594463+0000","last_undegraded":"2024-04-26T07:48:32.594463+0000","last_fullsized":"2024-04-26T07:48:32.594463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591038+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:48:32.591038+0000","last_peered":"2024-04-26T07:48:32.591038+0000","last_clean":"2024-04-26T07:48:32.591038+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:48:32.591038+0000","last_undegraded":"2024-04-26T07:48:32.591038+0000","last_fullsized":"2024-04-26T07:48:32.591038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.462690+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:48:33.462690+0000","last_peered":"2024-04-26T07:48:33.462690+0000","last_clean":"2024-04-26T07:48:33.462690+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:48:33.462690+0000","last_undegraded":"2024-04-26T07:48:33.462690+0000","last_fullsized":"2024-04-26T07:48:33.462690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621427+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:48:32.621427+0000","last_peered":"2024-04-26T07:48:32.621427+0000","last_clean":"2024-04-26T07:48:32.621427+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:48:32.621427+0000","last_undegraded":"2024-04-26T07:48:32.621427+0000","last_fullsized":"2024-04-26T07:48:32.621427+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609817+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:48:32.609817+0000","last_peered":"2024-04-26T07:48:32.609817+0000","last_clean":"2024-04-26T07:48:32.609817+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:48:32.609817+0000","last_undegraded":"2024-04-26T07:48:32.609817+0000","last_fullsized":"2024-04-26T07:48:32.609817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622426+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:48:32.622426+0000","last_peered":"2024-04-26T07:48:32.622426+0000","last_clean":"2024-04-26T07:48:32.622426+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:48:32.622426+0000","last_undegraded":"2024-04-26T07:48:32.622426+0000","last_fullsized":"2024-04-26T07:48:32.622426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612197+0000","last_change":"2024-04-26T07:48:15.519242+0000","last_active":"2024-04-26T07:48:32.612197+0000","last_peered":"2024-04-26T07:48:32.612197+0000","last_clean":"2024-04-26T07:48:32.612197+0000","last_became_active":"2024-04-26T07:48:15.516846+0000","last_became_peered":"2024-04-26T07:48:15.516846+0000","last_unstale":"2024-04-26T07:48:32.612197+0000","last_undegraded":"2024-04-26T07:48:32.612197+0000","last_fullsized":"2024-04-26T07:48:32.612197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:20.666857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618206+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:48:32.618206+0000","last_peered":"2024-04-26T07:48:32.618206+0000","last_clean":"2024-04-26T07:48:32.618206+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:48:32.618206+0000","last_undegraded":"2024-04-26T07:48:32.618206+0000","last_fullsized":"2024-04-26T07:48:32.618206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594888+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:48:32.594888+0000","last_peered":"2024-04-26T07:48:32.594888+0000","last_clean":"2024-04-26T07:48:32.594888+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:48:32.594888+0000","last_undegraded":"2024-04-26T07:48:32.594888+0000","last_fullsized":"2024-04-26T07:48:32.594888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613937+0000","last_change":"2024-04-26T07:48:25.573125+0000","last_active":"2024-04-26T07:48:32.613937+0000","last_peered":"2024-04-26T07:48:32.613937+0000","last_clean":"2024-04-26T07:48:32.613937+0000","last_became_active":"2024-04-26T07:48:25.572200+0000","last_became_peered":"2024-04-26T07:48:25.572200+0000","last_unstale":"2024-04-26T07:48:32.613937+0000","last_undegraded":"2024-04-26T07:48:32.613937+0000","last_fullsized":"2024-04-26T07:48:32.613937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.257855+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:48:33.257855+0000","last_peered":"2024-04-26T07:48:33.257855+0000","last_clean":"2024-04-26T07:48:33.257855+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:48:33.257855+0000","last_undegraded":"2024-04-26T07:48:33.257855+0000","last_fullsized":"2024-04-26T07:48:33.257855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596447+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:48:32.596447+0000","last_peered":"2024-04-26T07:48:32.596447+0000","last_clean":"2024-04-26T07:48:32.596447+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:48:32.596447+0000","last_undegraded":"2024-04-26T07:48:32.596447+0000","last_fullsized":"2024-04-26T07:48:32.596447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621290+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:48:32.621290+0000","last_peered":"2024-04-26T07:48:32.621290+0000","last_clean":"2024-04-26T07:48:32.621290+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:48:32.621290+0000","last_undegraded":"2024-04-26T07:48:32.621290+0000","last_fullsized":"2024-04-26T07:48:32.621290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.597944+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:48:32.597944+0000","last_peered":"2024-04-26T07:48:32.597944+0000","last_clean":"2024-04-26T07:48:32.597944+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:48:32.597944+0000","last_undegraded":"2024-04-26T07:48:32.597944+0000","last_fullsized":"2024-04-26T07:48:32.597944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612020+0000","last_change":"2024-04-26T07:48:15.450172+0000","last_active":"2024-04-26T07:48:32.612020+0000","last_peered":"2024-04-26T07:48:32.612020+0000","last_clean":"2024-04-26T07:48:32.612020+0000","last_became_active":"2024-04-26T07:48:15.449113+0000","last_became_peered":"2024-04-26T07:48:15.449113+0000","last_unstale":"2024-04-26T07:48:32.612020+0000","last_undegraded":"2024-04-26T07:48:32.612020+0000","last_fullsized":"2024-04-26T07:48:32.612020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:51.283507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592453+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:48:32.592453+0000","last_peered":"2024-04-26T07:48:32.592453+0000","last_clean":"2024-04-26T07:48:32.592453+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:48:32.592453+0000","last_undegraded":"2024-04-26T07:48:32.592453+0000","last_fullsized":"2024-04-26T07:48:32.592453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619412+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:48:32.619412+0000","last_peered":"2024-04-26T07:48:32.619412+0000","last_clean":"2024-04-26T07:48:32.619412+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:48:32.619412+0000","last_undegraded":"2024-04-26T07:48:32.619412+0000","last_fullsized":"2024-04-26T07:48:32.619412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.454739+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:48:33.454739+0000","last_peered":"2024-04-26T07:48:33.454739+0000","last_clean":"2024-04-26T07:48:33.454739+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:48:33.454739+0000","last_undegraded":"2024-04-26T07:48:33.454739+0000","last_fullsized":"2024-04-26T07:48:33.454739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613673+0000","last_change":"2024-04-26T07:48:29.582371+0000","last_active":"2024-04-26T07:48:32.613673+0000","last_peered":"2024-04-26T07:48:32.613673+0000","last_clean":"2024-04-26T07:48:32.613673+0000","last_became_active":"2024-04-26T07:48:29.581770+0000","last_became_peered":"2024-04-26T07:48:29.581770+0000","last_unstale":"2024-04-26T07:48:32.613673+0000","last_undegraded":"2024-04-26T07:48:32.613673+0000","last_fullsized":"2024-04-26T07:48:32.613673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609792+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:48:32.609792+0000","last_peered":"2024-04-26T07:48:32.609792+0000","last_clean":"2024-04-26T07:48:32.609792+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:48:32.609792+0000","last_undegraded":"2024-04-26T07:48:32.609792+0000","last_fullsized":"2024-04-26T07:48:32.609792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611806+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:48:32.611806+0000","last_peered":"2024-04-26T07:48:32.611806+0000","last_clean":"2024-04-26T07:48:32.611806+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:48:32.611806+0000","last_undegraded":"2024-04-26T07:48:32.611806+0000","last_fullsized":"2024-04-26T07:48:32.611806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640096+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:48:32.640096+0000","last_peered":"2024-04-26T07:48:32.640096+0000","last_clean":"2024-04-26T07:48:32.640096+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:48:32.640096+0000","last_undegraded":"2024-04-26T07:48:32.640096+0000","last_fullsized":"2024-04-26T07:48:32.640096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609142+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:48:32.609142+0000","last_peered":"2024-04-26T07:48:32.609142+0000","last_clean":"2024-04-26T07:48:32.609142+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:48:32.609142+0000","last_undegraded":"2024-04-26T07:48:32.609142+0000","last_fullsized":"2024-04-26T07:48:32.609142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.641270+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:48:32.641270+0000","last_peered":"2024-04-26T07:48:32.641270+0000","last_clean":"2024-04-26T07:48:32.641270+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:48:32.641270+0000","last_undegraded":"2024-04-26T07:48:32.641270+0000","last_fullsized":"2024-04-26T07:48:32.641270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.458352+0000","last_change":"2024-04-26T07:48:27.651812+0000","last_active":"2024-04-26T07:48:33.458352+0000","last_peered":"2024-04-26T07:48:33.458352+0000","last_clean":"2024-04-26T07:48:33.458352+0000","last_became_active":"2024-04-26T07:48:27.651073+0000","last_became_peered":"2024-04-26T07:48:27.651073+0000","last_unstale":"2024-04-26T07:48:33.458352+0000","last_undegraded":"2024-04-26T07:48:33.458352+0000","last_fullsized":"2024-04-26T07:48:33.458352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594956+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:48:32.594956+0000","last_peered":"2024-04-26T07:48:32.594956+0000","last_clean":"2024-04-26T07:48:32.594956+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:48:32.594956+0000","last_undegraded":"2024-04-26T07:48:32.594956+0000","last_fullsized":"2024-04-26T07:48:32.594956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594348+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:48:32.594348+0000","last_peered":"2024-04-26T07:48:32.594348+0000","last_clean":"2024-04-26T07:48:32.594348+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:48:32.594348+0000","last_undegraded":"2024-04-26T07:48:32.594348+0000","last_fullsized":"2024-04-26T07:48:32.594348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611335+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:48:32.611335+0000","last_peered":"2024-04-26T07:48:32.611335+0000","last_clean":"2024-04-26T07:48:32.611335+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:48:32.611335+0000","last_undegraded":"2024-04-26T07:48:32.611335+0000","last_fullsized":"2024-04-26T07:48:32.611335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618650+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:48:32.618650+0000","last_peered":"2024-04-26T07:48:32.618650+0000","last_clean":"2024-04-26T07:48:32.618650+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:48:32.618650+0000","last_undegraded":"2024-04-26T07:48:32.618650+0000","last_fullsized":"2024-04-26T07:48:32.618650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590781+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:48:32.590781+0000","last_peered":"2024-04-26T07:48:32.590781+0000","last_clean":"2024-04-26T07:48:32.590781+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:48:32.590781+0000","last_undegraded":"2024-04-26T07:48:32.590781+0000","last_fullsized":"2024-04-26T07:48:32.590781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594445+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:48:32.594445+0000","last_peered":"2024-04-26T07:48:32.594445+0000","last_clean":"2024-04-26T07:48:32.594445+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:48:32.594445+0000","last_undegraded":"2024-04-26T07:48:32.594445+0000","last_fullsized":"2024-04-26T07:48:32.594445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.296197+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:48:33.296197+0000","last_peered":"2024-04-26T07:48:33.296197+0000","last_clean":"2024-04-26T07:48:33.296197+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:48:33.296197+0000","last_undegraded":"2024-04-26T07:48:33.296197+0000","last_fullsized":"2024-04-26T07:48:33.296197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623318+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:48:32.623318+0000","last_peered":"2024-04-26T07:48:32.623318+0000","last_clean":"2024-04-26T07:48:32.623318+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:48:32.623318+0000","last_undegraded":"2024-04-26T07:48:32.623318+0000","last_fullsized":"2024-04-26T07:48:32.623318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616586+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:48:32.616586+0000","last_peered":"2024-04-26T07:48:32.616586+0000","last_clean":"2024-04-26T07:48:32.616586+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:48:32.616586+0000","last_undegraded":"2024-04-26T07:48:32.616586+0000","last_fullsized":"2024-04-26T07:48:32.616586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610723+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:48:32.610723+0000","last_peered":"2024-04-26T07:48:32.610723+0000","last_clean":"2024-04-26T07:48:32.610723+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:48:32.610723+0000","last_undegraded":"2024-04-26T07:48:32.610723+0000","last_fullsized":"2024-04-26T07:48:32.610723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619702+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:48:32.619702+0000","last_peered":"2024-04-26T07:48:32.619702+0000","last_clean":"2024-04-26T07:48:32.619702+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:48:32.619702+0000","last_undegraded":"2024-04-26T07:48:32.619702+0000","last_fullsized":"2024-04-26T07:48:32.619702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611983+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:48:32.611983+0000","last_peered":"2024-04-26T07:48:32.611983+0000","last_clean":"2024-04-26T07:48:32.611983+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:48:32.611983+0000","last_undegraded":"2024-04-26T07:48:32.611983+0000","last_fullsized":"2024-04-26T07:48:32.611983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595835+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:48:32.595835+0000","last_peered":"2024-04-26T07:48:32.595835+0000","last_clean":"2024-04-26T07:48:32.595835+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:48:32.595835+0000","last_undegraded":"2024-04-26T07:48:32.595835+0000","last_fullsized":"2024-04-26T07:48:32.595835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.387016+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:48:33.387016+0000","last_peered":"2024-04-26T07:48:33.387016+0000","last_clean":"2024-04-26T07:48:33.387016+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:48:33.387016+0000","last_undegraded":"2024-04-26T07:48:33.387016+0000","last_fullsized":"2024-04-26T07:48:33.387016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588510+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:48:32.588510+0000","last_peered":"2024-04-26T07:48:32.588510+0000","last_clean":"2024-04-26T07:48:32.588510+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:48:32.588510+0000","last_undegraded":"2024-04-26T07:48:32.588510+0000","last_fullsized":"2024-04-26T07:48:32.588510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594361+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:48:32.594361+0000","last_peered":"2024-04-26T07:48:32.594361+0000","last_clean":"2024-04-26T07:48:32.594361+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:48:32.594361+0000","last_undegraded":"2024-04-26T07:48:32.594361+0000","last_fullsized":"2024-04-26T07:48:32.594361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598057+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:48:32.598057+0000","last_peered":"2024-04-26T07:48:32.598057+0000","last_clean":"2024-04-26T07:48:32.598057+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:48:32.598057+0000","last_undegraded":"2024-04-26T07:48:32.598057+0000","last_fullsized":"2024-04-26T07:48:32.598057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611736+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:48:32.611736+0000","last_peered":"2024-04-26T07:48:32.611736+0000","last_clean":"2024-04-26T07:48:32.611736+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:48:32.611736+0000","last_undegraded":"2024-04-26T07:48:32.611736+0000","last_fullsized":"2024-04-26T07:48:32.611736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614960+0000","last_change":"2024-04-26T07:48:15.517260+0000","last_active":"2024-04-26T07:48:32.614960+0000","last_peered":"2024-04-26T07:48:32.614960+0000","last_clean":"2024-04-26T07:48:32.614960+0000","last_became_active":"2024-04-26T07:48:15.516567+0000","last_became_peered":"2024-04-26T07:48:15.516567+0000","last_unstale":"2024-04-26T07:48:32.614960+0000","last_undegraded":"2024-04-26T07:48:32.614960+0000","last_fullsized":"2024-04-26T07:48:32.614960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:31.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622260+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:48:32.622260+0000","last_peered":"2024-04-26T07:48:32.622260+0000","last_clean":"2024-04-26T07:48:32.622260+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:48:32.622260+0000","last_undegraded":"2024-04-26T07:48:32.622260+0000","last_fullsized":"2024-04-26T07:48:32.622260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.485485+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:48:33.485485+0000","last_peered":"2024-04-26T07:48:33.485485+0000","last_clean":"2024-04-26T07:48:33.485485+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:48:33.485485+0000","last_undegraded":"2024-04-26T07:48:33.485485+0000","last_fullsized":"2024-04-26T07:48:33.485485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617089+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:48:32.617089+0000","last_peered":"2024-04-26T07:48:32.617089+0000","last_clean":"2024-04-26T07:48:32.617089+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:48:32.617089+0000","last_undegraded":"2024-04-26T07:48:32.617089+0000","last_fullsized":"2024-04-26T07:48:32.617089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.600535+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:48:32.600535+0000","last_peered":"2024-04-26T07:48:32.600535+0000","last_clean":"2024-04-26T07:48:32.600535+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:48:32.600535+0000","last_undegraded":"2024-04-26T07:48:32.600535+0000","last_fullsized":"2024-04-26T07:48:32.600535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593361+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:48:32.593361+0000","last_peered":"2024-04-26T07:48:32.593361+0000","last_clean":"2024-04-26T07:48:32.593361+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:48:32.593361+0000","last_undegraded":"2024-04-26T07:48:32.593361+0000","last_fullsized":"2024-04-26T07:48:32.593361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598953+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:48:32.598953+0000","last_peered":"2024-04-26T07:48:32.598953+0000","last_clean":"2024-04-26T07:48:32.598953+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:48:32.598953+0000","last_undegraded":"2024-04-26T07:48:32.598953+0000","last_fullsized":"2024-04-26T07:48:32.598953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611332+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:48:32.611332+0000","last_peered":"2024-04-26T07:48:32.611332+0000","last_clean":"2024-04-26T07:48:32.611332+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:48:32.611332+0000","last_undegraded":"2024-04-26T07:48:32.611332+0000","last_fullsized":"2024-04-26T07:48:32.611332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588829+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:48:32.588829+0000","last_peered":"2024-04-26T07:48:32.588829+0000","last_clean":"2024-04-26T07:48:32.588829+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:48:32.588829+0000","last_undegraded":"2024-04-26T07:48:32.588829+0000","last_fullsized":"2024-04-26T07:48:32.588829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.442697+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:48:33.442697+0000","last_peered":"2024-04-26T07:48:33.442697+0000","last_clean":"2024-04-26T07:48:33.442697+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:48:33.442697+0000","last_undegraded":"2024-04-26T07:48:33.442697+0000","last_fullsized":"2024-04-26T07:48:33.442697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598449+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:48:32.598449+0000","last_peered":"2024-04-26T07:48:32.598449+0000","last_clean":"2024-04-26T07:48:32.598449+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:48:32.598449+0000","last_undegraded":"2024-04-26T07:48:32.598449+0000","last_fullsized":"2024-04-26T07:48:32.598449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595862+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:48:32.595862+0000","last_peered":"2024-04-26T07:48:32.595862+0000","last_clean":"2024-04-26T07:48:32.595862+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:48:32.595862+0000","last_undegraded":"2024-04-26T07:48:32.595862+0000","last_fullsized":"2024-04-26T07:48:32.595862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589130+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:48:32.589130+0000","last_peered":"2024-04-26T07:48:32.589130+0000","last_clean":"2024-04-26T07:48:32.589130+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:48:32.589130+0000","last_undegraded":"2024-04-26T07:48:32.589130+0000","last_fullsized":"2024-04-26T07:48:32.589130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598881+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:48:32.598881+0000","last_peered":"2024-04-26T07:48:32.598881+0000","last_clean":"2024-04-26T07:48:32.598881+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:48:32.598881+0000","last_undegraded":"2024-04-26T07:48:32.598881+0000","last_fullsized":"2024-04-26T07:48:32.598881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623631+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:48:32.623631+0000","last_peered":"2024-04-26T07:48:32.623631+0000","last_clean":"2024-04-26T07:48:32.623631+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:48:32.623631+0000","last_undegraded":"2024-04-26T07:48:32.623631+0000","last_fullsized":"2024-04-26T07:48:32.623631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592905+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:48:32.592905+0000","last_peered":"2024-04-26T07:48:32.592905+0000","last_clean":"2024-04-26T07:48:32.592905+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:48:32.592905+0000","last_undegraded":"2024-04-26T07:48:32.592905+0000","last_fullsized":"2024-04-26T07:48:32.592905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.421205+0000","last_change":"2024-04-26T07:48:27.655376+0000","last_active":"2024-04-26T07:48:33.421205+0000","last_peered":"2024-04-26T07:48:33.421205+0000","last_clean":"2024-04-26T07:48:33.421205+0000","last_became_active":"2024-04-26T07:48:27.654669+0000","last_became_peered":"2024-04-26T07:48:27.654669+0000","last_unstale":"2024-04-26T07:48:33.421205+0000","last_undegraded":"2024-04-26T07:48:33.421205+0000","last_fullsized":"2024-04-26T07:48:33.421205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594256+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:48:32.594256+0000","last_peered":"2024-04-26T07:48:32.594256+0000","last_clean":"2024-04-26T07:48:32.594256+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:48:32.594256+0000","last_undegraded":"2024-04-26T07:48:32.594256+0000","last_fullsized":"2024-04-26T07:48:32.594256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617350+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:48:32.617350+0000","last_peered":"2024-04-26T07:48:32.617350+0000","last_clean":"2024-04-26T07:48:32.617350+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:48:32.617350+0000","last_undegraded":"2024-04-26T07:48:32.617350+0000","last_fullsized":"2024-04-26T07:48:32.617350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596348+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:48:32.596348+0000","last_peered":"2024-04-26T07:48:32.596348+0000","last_clean":"2024-04-26T07:48:32.596348+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:48:32.596348+0000","last_undegraded":"2024-04-26T07:48:32.596348+0000","last_fullsized":"2024-04-26T07:48:32.596348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590359+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:48:32.590359+0000","last_peered":"2024-04-26T07:48:32.590359+0000","last_clean":"2024-04-26T07:48:32.590359+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:48:32.590359+0000","last_undegraded":"2024-04-26T07:48:32.590359+0000","last_fullsized":"2024-04-26T07:48:32.590359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590033+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:48:32.590033+0000","last_peered":"2024-04-26T07:48:32.590033+0000","last_clean":"2024-04-26T07:48:32.590033+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:48:32.590033+0000","last_undegraded":"2024-04-26T07:48:32.590033+0000","last_fullsized":"2024-04-26T07:48:32.590033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610973+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:48:32.610973+0000","last_peered":"2024-04-26T07:48:32.610973+0000","last_clean":"2024-04-26T07:48:32.610973+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:48:32.610973+0000","last_undegraded":"2024-04-26T07:48:32.610973+0000","last_fullsized":"2024-04-26T07:48:32.610973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.492489+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:48:33.492489+0000","last_peered":"2024-04-26T07:48:33.492489+0000","last_clean":"2024-04-26T07:48:33.492489+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:48:33.492489+0000","last_undegraded":"2024-04-26T07:48:33.492489+0000","last_fullsized":"2024-04-26T07:48:33.492489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592484+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:48:32.592484+0000","last_peered":"2024-04-26T07:48:32.592484+0000","last_clean":"2024-04-26T07:48:32.592484+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:48:32.592484+0000","last_undegraded":"2024-04-26T07:48:32.592484+0000","last_fullsized":"2024-04-26T07:48:32.592484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599168+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:48:32.599168+0000","last_peered":"2024-04-26T07:48:32.599168+0000","last_clean":"2024-04-26T07:48:32.599168+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:48:32.599168+0000","last_undegraded":"2024-04-26T07:48:32.599168+0000","last_fullsized":"2024-04-26T07:48:32.599168+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610279+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:48:32.610279+0000","last_peered":"2024-04-26T07:48:32.610279+0000","last_clean":"2024-04-26T07:48:32.610279+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:48:32.610279+0000","last_undegraded":"2024-04-26T07:48:32.610279+0000","last_fullsized":"2024-04-26T07:48:32.610279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614618+0000","last_change":"2024-04-26T07:48:21.522429+0000","last_active":"2024-04-26T07:48:32.614618+0000","last_peered":"2024-04-26T07:48:32.614618+0000","last_clean":"2024-04-26T07:48:32.614618+0000","last_became_active":"2024-04-26T07:48:21.521246+0000","last_became_peered":"2024-04-26T07:48:21.521246+0000","last_unstale":"2024-04-26T07:48:32.614618+0000","last_undegraded":"2024-04-26T07:48:32.614618+0000","last_fullsized":"2024-04-26T07:48:32.614618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593818+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:48:32.593818+0000","last_peered":"2024-04-26T07:48:32.593818+0000","last_clean":"2024-04-26T07:48:32.593818+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:48:32.593818+0000","last_undegraded":"2024-04-26T07:48:32.593818+0000","last_fullsized":"2024-04-26T07:48:32.593818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.945787+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:48:32.945787+0000","last_peered":"2024-04-26T07:48:32.945787+0000","last_clean":"2024-04-26T07:48:32.945787+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:48:32.945787+0000","last_undegraded":"2024-04-26T07:48:32.945787+0000","last_fullsized":"2024-04-26T07:48:32.945787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612480+0000","last_change":"2024-04-26T07:48:29.582765+0000","last_active":"2024-04-26T07:48:32.612480+0000","last_peered":"2024-04-26T07:48:32.612480+0000","last_clean":"2024-04-26T07:48:32.612480+0000","last_became_active":"2024-04-26T07:48:29.581836+0000","last_became_peered":"2024-04-26T07:48:29.581836+0000","last_unstale":"2024-04-26T07:48:32.612480+0000","last_undegraded":"2024-04-26T07:48:32.612480+0000","last_fullsized":"2024-04-26T07:48:32.612480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594143+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:48:32.594143+0000","last_peered":"2024-04-26T07:48:32.594143+0000","last_clean":"2024-04-26T07:48:32.594143+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:48:32.594143+0000","last_undegraded":"2024-04-26T07:48:32.594143+0000","last_fullsized":"2024-04-26T07:48:32.594143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593017+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:48:32.593017+0000","last_peered":"2024-04-26T07:48:32.593017+0000","last_clean":"2024-04-26T07:48:32.593017+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:48:32.593017+0000","last_undegraded":"2024-04-26T07:48:32.593017+0000","last_fullsized":"2024-04-26T07:48:32.593017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619540+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:48:32.619540+0000","last_peered":"2024-04-26T07:48:32.619540+0000","last_clean":"2024-04-26T07:48:32.619540+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:48:32.619540+0000","last_undegraded":"2024-04-26T07:48:32.619540+0000","last_fullsized":"2024-04-26T07:48:32.619540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611367+0000","last_change":"2024-04-26T07:48:25.575678+0000","last_active":"2024-04-26T07:48:32.611367+0000","last_peered":"2024-04-26T07:48:32.611367+0000","last_clean":"2024-04-26T07:48:32.611367+0000","last_became_active":"2024-04-26T07:48:25.574985+0000","last_became_peered":"2024-04-26T07:48:25.574985+0000","last_unstale":"2024-04-26T07:48:32.611367+0000","last_undegraded":"2024-04-26T07:48:32.611367+0000","last_fullsized":"2024-04-26T07:48:32.611367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.401856+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:48:33.401856+0000","last_peered":"2024-04-26T07:48:33.401856+0000","last_clean":"2024-04-26T07:48:33.401856+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:48:33.401856+0000","last_undegraded":"2024-04-26T07:48:33.401856+0000","last_fullsized":"2024-04-26T07:48:33.401856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622031+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:48:32.622031+0000","last_peered":"2024-04-26T07:48:32.622031+0000","last_clean":"2024-04-26T07:48:32.622031+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:48:32.622031+0000","last_undegraded":"2024-04-26T07:48:32.622031+0000","last_fullsized":"2024-04-26T07:48:32.622031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619689+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:48:32.619689+0000","last_peered":"2024-04-26T07:48:32.619689+0000","last_clean":"2024-04-26T07:48:32.619689+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:48:32.619689+0000","last_undegraded":"2024-04-26T07:48:32.619689+0000","last_fullsized":"2024-04-26T07:48:32.619689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593757+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:48:32.593757+0000","last_peered":"2024-04-26T07:48:32.593757+0000","last_clean":"2024-04-26T07:48:32.593757+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:48:32.593757+0000","last_undegraded":"2024-04-26T07:48:32.593757+0000","last_fullsized":"2024-04-26T07:48:32.593757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.597201+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:48:32.597201+0000","last_peered":"2024-04-26T07:48:32.597201+0000","last_clean":"2024-04-26T07:48:32.597201+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:48:32.597201+0000","last_undegraded":"2024-04-26T07:48:32.597201+0000","last_fullsized":"2024-04-26T07:48:32.597201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621631+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:48:32.621631+0000","last_peered":"2024-04-26T07:48:32.621631+0000","last_clean":"2024-04-26T07:48:32.621631+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:48:32.621631+0000","last_undegraded":"2024-04-26T07:48:32.621631+0000","last_fullsized":"2024-04-26T07:48:32.621631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.171654+0000","last_change":"2024-04-26T07:48:27.575530+0000","last_active":"2024-04-26T07:48:33.171654+0000","last_peered":"2024-04-26T07:48:33.171654+0000","last_clean":"2024-04-26T07:48:33.171654+0000","last_became_active":"2024-04-26T07:48:27.574659+0000","last_became_peered":"2024-04-26T07:48:27.574659+0000","last_unstale":"2024-04-26T07:48:33.171654+0000","last_undegraded":"2024-04-26T07:48:33.171654+0000","last_fullsized":"2024-04-26T07:48:33.171654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593499+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:48:32.593499+0000","last_peered":"2024-04-26T07:48:32.593499+0000","last_clean":"2024-04-26T07:48:32.593499+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:48:32.593499+0000","last_undegraded":"2024-04-26T07:48:32.593499+0000","last_fullsized":"2024-04-26T07:48:32.593499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.623425+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:48:32.623425+0000","last_peered":"2024-04-26T07:48:32.623425+0000","last_clean":"2024-04-26T07:48:32.623425+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:48:32.623425+0000","last_undegraded":"2024-04-26T07:48:32.623425+0000","last_fullsized":"2024-04-26T07:48:32.623425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.594228+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:48:32.594228+0000","last_peered":"2024-04-26T07:48:32.594228+0000","last_clean":"2024-04-26T07:48:32.594228+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:48:32.594228+0000","last_undegraded":"2024-04-26T07:48:32.594228+0000","last_fullsized":"2024-04-26T07:48:32.594228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596808+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:48:32.596808+0000","last_peered":"2024-04-26T07:48:32.596808+0000","last_clean":"2024-04-26T07:48:32.596808+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:48:32.596808+0000","last_undegraded":"2024-04-26T07:48:32.596808+0000","last_fullsized":"2024-04-26T07:48:32.596808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.521486+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:48:33.521486+0000","last_peered":"2024-04-26T07:48:33.521486+0000","last_clean":"2024-04-26T07:48:33.521486+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:48:33.521486+0000","last_undegraded":"2024-04-26T07:48:33.521486+0000","last_fullsized":"2024-04-26T07:48:33.521486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619799+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:48:32.619799+0000","last_peered":"2024-04-26T07:48:32.619799+0000","last_clean":"2024-04-26T07:48:32.619799+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:48:32.619799+0000","last_undegraded":"2024-04-26T07:48:32.619799+0000","last_fullsized":"2024-04-26T07:48:32.619799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592915+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:48:32.592915+0000","last_peered":"2024-04-26T07:48:32.592915+0000","last_clean":"2024-04-26T07:48:32.592915+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:48:32.592915+0000","last_undegraded":"2024-04-26T07:48:32.592915+0000","last_fullsized":"2024-04-26T07:48:32.592915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.597605+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:48:32.597605+0000","last_peered":"2024-04-26T07:48:32.597605+0000","last_clean":"2024-04-26T07:48:32.597605+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:48:32.597605+0000","last_undegraded":"2024-04-26T07:48:32.597605+0000","last_fullsized":"2024-04-26T07:48:32.597605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610841+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:48:32.610841+0000","last_peered":"2024-04-26T07:48:32.610841+0000","last_clean":"2024-04-26T07:48:32.610841+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:48:32.610841+0000","last_undegraded":"2024-04-26T07:48:32.610841+0000","last_fullsized":"2024-04-26T07:48:32.610841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622594+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:48:32.622594+0000","last_peered":"2024-04-26T07:48:32.622594+0000","last_clean":"2024-04-26T07:48:32.622594+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:48:32.622594+0000","last_undegraded":"2024-04-26T07:48:32.622594+0000","last_fullsized":"2024-04-26T07:48:32.622594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.300822+0000","last_change":"2024-04-26T07:48:27.578601+0000","last_active":"2024-04-26T07:48:33.300822+0000","last_peered":"2024-04-26T07:48:33.300822+0000","last_clean":"2024-04-26T07:48:33.300822+0000","last_became_active":"2024-04-26T07:48:27.577870+0000","last_became_peered":"2024-04-26T07:48:27.577870+0000","last_unstale":"2024-04-26T07:48:33.300822+0000","last_undegraded":"2024-04-26T07:48:33.300822+0000","last_fullsized":"2024-04-26T07:48:33.300822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610532+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:48:32.610532+0000","last_peered":"2024-04-26T07:48:32.610532+0000","last_clean":"2024-04-26T07:48:32.610532+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:48:32.610532+0000","last_undegraded":"2024-04-26T07:48:32.610532+0000","last_fullsized":"2024-04-26T07:48:32.610532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621726+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:48:32.621726+0000","last_peered":"2024-04-26T07:48:32.621726+0000","last_clean":"2024-04-26T07:48:32.621726+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:48:32.621726+0000","last_undegraded":"2024-04-26T07:48:32.621726+0000","last_fullsized":"2024-04-26T07:48:32.621726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599793+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:48:32.599793+0000","last_peered":"2024-04-26T07:48:32.599793+0000","last_clean":"2024-04-26T07:48:32.599793+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:48:32.599793+0000","last_undegraded":"2024-04-26T07:48:32.599793+0000","last_fullsized":"2024-04-26T07:48:32.599793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590114+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:48:32.590114+0000","last_peered":"2024-04-26T07:48:32.590114+0000","last_clean":"2024-04-26T07:48:32.590114+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:48:32.590114+0000","last_undegraded":"2024-04-26T07:48:32.590114+0000","last_fullsized":"2024-04-26T07:48:32.590114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591513+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:48:32.591513+0000","last_peered":"2024-04-26T07:48:32.591513+0000","last_clean":"2024-04-26T07:48:32.591513+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:48:32.591513+0000","last_undegraded":"2024-04-26T07:48:32.591513+0000","last_fullsized":"2024-04-26T07:48:32.591513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.499524+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:48:33.499524+0000","last_peered":"2024-04-26T07:48:33.499524+0000","last_clean":"2024-04-26T07:48:33.499524+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:48:33.499524+0000","last_undegraded":"2024-04-26T07:48:33.499524+0000","last_fullsized":"2024-04-26T07:48:33.499524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610039+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:48:32.610039+0000","last_peered":"2024-04-26T07:48:32.610039+0000","last_clean":"2024-04-26T07:48:32.610039+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:48:32.610039+0000","last_undegraded":"2024-04-26T07:48:32.610039+0000","last_fullsized":"2024-04-26T07:48:32.610039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.616922+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:48:32.616922+0000","last_peered":"2024-04-26T07:48:32.616922+0000","last_clean":"2024-04-26T07:48:32.616922+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:48:32.616922+0000","last_undegraded":"2024-04-26T07:48:32.616922+0000","last_fullsized":"2024-04-26T07:48:32.616922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640769+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:48:32.640769+0000","last_peered":"2024-04-26T07:48:32.640769+0000","last_clean":"2024-04-26T07:48:32.640769+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:48:32.640769+0000","last_undegraded":"2024-04-26T07:48:32.640769+0000","last_fullsized":"2024-04-26T07:48:32.640769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593960+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:48:32.593960+0000","last_peered":"2024-04-26T07:48:32.593960+0000","last_clean":"2024-04-26T07:48:32.593960+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:48:32.593960+0000","last_undegraded":"2024-04-26T07:48:32.593960+0000","last_fullsized":"2024-04-26T07:48:32.593960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610928+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:48:32.610928+0000","last_peered":"2024-04-26T07:48:32.610928+0000","last_clean":"2024-04-26T07:48:32.610928+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:48:32.610928+0000","last_undegraded":"2024-04-26T07:48:32.610928+0000","last_fullsized":"2024-04-26T07:48:32.610928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.476275+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:48:33.476275+0000","last_peered":"2024-04-26T07:48:33.476275+0000","last_clean":"2024-04-26T07:48:33.476275+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:48:33.476275+0000","last_undegraded":"2024-04-26T07:48:33.476275+0000","last_fullsized":"2024-04-26T07:48:33.476275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622434+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:48:32.622434+0000","last_peered":"2024-04-26T07:48:32.622434+0000","last_clean":"2024-04-26T07:48:32.622434+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:48:32.622434+0000","last_undegraded":"2024-04-26T07:48:32.622434+0000","last_fullsized":"2024-04-26T07:48:32.622434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611619+0000","last_change":"2024-04-26T07:48:31.605556+0000","last_active":"2024-04-26T07:48:32.611619+0000","last_peered":"2024-04-26T07:48:32.611619+0000","last_clean":"2024-04-26T07:48:32.611619+0000","last_became_active":"2024-04-26T07:48:31.604886+0000","last_became_peered":"2024-04-26T07:48:31.604886+0000","last_unstale":"2024-04-26T07:48:32.611619+0000","last_undegraded":"2024-04-26T07:48:32.611619+0000","last_fullsized":"2024-04-26T07:48:32.611619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589419+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:48:32.589419+0000","last_peered":"2024-04-26T07:48:32.589419+0000","last_clean":"2024-04-26T07:48:32.589419+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:48:32.589419+0000","last_undegraded":"2024-04-26T07:48:32.589419+0000","last_fullsized":"2024-04-26T07:48:32.589419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.620159+0000","last_change":"2024-04-26T07:48:21.523345+0000","last_active":"2024-04-26T07:48:32.620159+0000","last_peered":"2024-04-26T07:48:32.620159+0000","last_clean":"2024-04-26T07:48:32.620159+0000","last_became_active":"2024-04-26T07:48:21.521160+0000","last_became_peered":"2024-04-26T07:48:21.521160+0000","last_unstale":"2024-04-26T07:48:32.620159+0000","last_undegraded":"2024-04-26T07:48:32.620159+0000","last_fullsized":"2024-04-26T07:48:32.620159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.612783+0000","last_change":"2024-04-26T07:48:25.576286+0000","last_active":"2024-04-26T07:48:32.612783+0000","last_peered":"2024-04-26T07:48:32.612783+0000","last_clean":"2024-04-26T07:48:32.612783+0000","last_became_active":"2024-04-26T07:48:25.575505+0000","last_became_peered":"2024-04-26T07:48:25.575505+0000","last_unstale":"2024-04-26T07:48:32.612783+0000","last_undegraded":"2024-04-26T07:48:32.612783+0000","last_fullsized":"2024-04-26T07:48:32.612783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.511270+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:48:33.511270+0000","last_peered":"2024-04-26T07:48:33.511270+0000","last_clean":"2024-04-26T07:48:33.511270+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:48:33.511270+0000","last_undegraded":"2024-04-26T07:48:33.511270+0000","last_fullsized":"2024-04-26T07:48:33.511270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590708+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:48:32.590708+0000","last_peered":"2024-04-26T07:48:32.590708+0000","last_clean":"2024-04-26T07:48:32.590708+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:48:32.590708+0000","last_undegraded":"2024-04-26T07:48:32.590708+0000","last_fullsized":"2024-04-26T07:48:32.590708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.615315+0000","last_change":"2024-04-26T07:48:31.598704+0000","last_active":"2024-04-26T07:48:32.615315+0000","last_peered":"2024-04-26T07:48:32.615315+0000","last_clean":"2024-04-26T07:48:32.615315+0000","last_became_active":"2024-04-26T07:48:31.597882+0000","last_became_peered":"2024-04-26T07:48:31.597882+0000","last_unstale":"2024-04-26T07:48:32.615315+0000","last_undegraded":"2024-04-26T07:48:32.615315+0000","last_fullsized":"2024-04-26T07:48:32.615315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.589839+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:48:32.589839+0000","last_peered":"2024-04-26T07:48:32.589839+0000","last_clean":"2024-04-26T07:48:32.589839+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:48:32.589839+0000","last_undegraded":"2024-04-26T07:48:32.589839+0000","last_fullsized":"2024-04-26T07:48:32.589839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619300+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:48:32.619300+0000","last_peered":"2024-04-26T07:48:32.619300+0000","last_clean":"2024-04-26T07:48:32.619300+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:48:32.619300+0000","last_undegraded":"2024-04-26T07:48:32.619300+0000","last_fullsized":"2024-04-26T07:48:32.619300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617834+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:48:32.617834+0000","last_peered":"2024-04-26T07:48:32.617834+0000","last_clean":"2024-04-26T07:48:32.617834+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:48:32.617834+0000","last_undegraded":"2024-04-26T07:48:32.617834+0000","last_fullsized":"2024-04-26T07:48:32.617834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.936575+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:48:32.936575+0000","last_peered":"2024-04-26T07:48:32.936575+0000","last_clean":"2024-04-26T07:48:32.936575+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:48:32.936575+0000","last_undegraded":"2024-04-26T07:48:32.936575+0000","last_fullsized":"2024-04-26T07:48:32.936575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621238+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:48:32.621238+0000","last_peered":"2024-04-26T07:48:32.621238+0000","last_clean":"2024-04-26T07:48:32.621238+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:48:32.621238+0000","last_undegraded":"2024-04-26T07:48:32.621238+0000","last_fullsized":"2024-04-26T07:48:32.621238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599239+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:48:32.599239+0000","last_peered":"2024-04-26T07:48:32.599239+0000","last_clean":"2024-04-26T07:48:32.599239+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:48:32.599239+0000","last_undegraded":"2024-04-26T07:48:32.599239+0000","last_fullsized":"2024-04-26T07:48:32.599239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593383+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:48:32.593383+0000","last_peered":"2024-04-26T07:48:32.593383+0000","last_clean":"2024-04-26T07:48:32.593383+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:48:32.593383+0000","last_undegraded":"2024-04-26T07:48:32.593383+0000","last_fullsized":"2024-04-26T07:48:32.593383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.599629+0000","last_change":"2024-04-26T07:48:21.503786+0000","last_active":"2024-04-26T07:48:32.599629+0000","last_peered":"2024-04-26T07:48:32.599629+0000","last_clean":"2024-04-26T07:48:32.599629+0000","last_became_active":"2024-04-26T07:48:21.503422+0000","last_became_peered":"2024-04-26T07:48:21.503422+0000","last_unstale":"2024-04-26T07:48:32.599629+0000","last_undegraded":"2024-04-26T07:48:32.599629+0000","last_fullsized":"2024-04-26T07:48:32.599629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588378+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:48:32.588378+0000","last_peered":"2024-04-26T07:48:32.588378+0000","last_clean":"2024-04-26T07:48:32.588378+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:48:32.588378+0000","last_undegraded":"2024-04-26T07:48:32.588378+0000","last_fullsized":"2024-04-26T07:48:32.588378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.124402+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:48:33.124402+0000","last_peered":"2024-04-26T07:48:33.124402+0000","last_clean":"2024-04-26T07:48:33.124402+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:48:33.124402+0000","last_undegraded":"2024-04-26T07:48:33.124402+0000","last_fullsized":"2024-04-26T07:48:33.124402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588892+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:48:32.588892+0000","last_peered":"2024-04-26T07:48:32.588892+0000","last_clean":"2024-04-26T07:48:32.588892+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:48:32.588892+0000","last_undegraded":"2024-04-26T07:48:32.588892+0000","last_fullsized":"2024-04-26T07:48:32.588892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614267+0000","last_change":"2024-04-26T07:48:31.591594+0000","last_active":"2024-04-26T07:48:32.614267+0000","last_peered":"2024-04-26T07:48:32.614267+0000","last_clean":"2024-04-26T07:48:32.614267+0000","last_became_active":"2024-04-26T07:48:31.590889+0000","last_became_peered":"2024-04-26T07:48:31.590889+0000","last_unstale":"2024-04-26T07:48:32.614267+0000","last_undegraded":"2024-04-26T07:48:32.614267+0000","last_fullsized":"2024-04-26T07:48:32.614267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.588839+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:48:32.588839+0000","last_peered":"2024-04-26T07:48:32.588839+0000","last_clean":"2024-04-26T07:48:32.588839+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:48:32.588839+0000","last_undegraded":"2024-04-26T07:48:32.588839+0000","last_fullsized":"2024-04-26T07:48:32.588839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596852+0000","last_change":"2024-04-26T07:48:21.506013+0000","last_active":"2024-04-26T07:48:32.596852+0000","last_peered":"2024-04-26T07:48:32.596852+0000","last_clean":"2024-04-26T07:48:32.596852+0000","last_became_active":"2024-04-26T07:48:21.505104+0000","last_became_peered":"2024-04-26T07:48:21.505104+0000","last_unstale":"2024-04-26T07:48:32.596852+0000","last_undegraded":"2024-04-26T07:48:32.596852+0000","last_fullsized":"2024-04-26T07:48:32.596852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.609158+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:48:32.609158+0000","last_peered":"2024-04-26T07:48:32.609158+0000","last_clean":"2024-04-26T07:48:32.609158+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:48:32.609158+0000","last_undegraded":"2024-04-26T07:48:32.609158+0000","last_fullsized":"2024-04-26T07:48:32.609158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:33.193324+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:48:33.193324+0000","last_peered":"2024-04-26T07:48:33.193324+0000","last_clean":"2024-04-26T07:48:33.193324+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:48:33.193324+0000","last_undegraded":"2024-04-26T07:48:33.193324+0000","last_fullsized":"2024-04-26T07:48:33.193324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593109+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:48:32.593109+0000","last_peered":"2024-04-26T07:48:32.593109+0000","last_clean":"2024-04-26T07:48:32.593109+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:48:32.593109+0000","last_undegraded":"2024-04-26T07:48:32.593109+0000","last_fullsized":"2024-04-26T07:48:32.593109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591741+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:48:32.591741+0000","last_peered":"2024-04-26T07:48:32.591741+0000","last_clean":"2024-04-26T07:48:32.591741+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:48:32.591741+0000","last_undegraded":"2024-04-26T07:48:32.591741+0000","last_fullsized":"2024-04-26T07:48:32.591741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611127+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:48:32.611127+0000","last_peered":"2024-04-26T07:48:32.611127+0000","last_clean":"2024-04-26T07:48:32.611127+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:48:32.611127+0000","last_undegraded":"2024-04-26T07:48:32.611127+0000","last_fullsized":"2024-04-26T07:48:32.611127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.621107+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:48:32.621107+0000","last_peered":"2024-04-26T07:48:32.621107+0000","last_clean":"2024-04-26T07:48:32.621107+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:48:32.621107+0000","last_undegraded":"2024-04-26T07:48:32.621107+0000","last_fullsized":"2024-04-26T07:48:32.621107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611076+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:48:32.611076+0000","last_peered":"2024-04-26T07:48:32.611076+0000","last_clean":"2024-04-26T07:48:32.611076+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:48:32.611076+0000","last_undegraded":"2024-04-26T07:48:32.611076+0000","last_fullsized":"2024-04-26T07:48:32.611076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.639741+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:48:32.639741+0000","last_peered":"2024-04-26T07:48:32.639741+0000","last_clean":"2024-04-26T07:48:32.639741+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:48:32.639741+0000","last_undegraded":"2024-04-26T07:48:32.639741+0000","last_fullsized":"2024-04-26T07:48:32.639741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617830+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:48:32.617830+0000","last_peered":"2024-04-26T07:48:32.617830+0000","last_clean":"2024-04-26T07:48:32.617830+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:48:32.617830+0000","last_undegraded":"2024-04-26T07:48:32.617830+0000","last_fullsized":"2024-04-26T07:48:32.617830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618414+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:48:32.618414+0000","last_peered":"2024-04-26T07:48:32.618414+0000","last_clean":"2024-04-26T07:48:32.618414+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:48:32.618414+0000","last_undegraded":"2024-04-26T07:48:32.618414+0000","last_fullsized":"2024-04-26T07:48:32.618414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611806+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:48:32.611806+0000","last_peered":"2024-04-26T07:48:32.611806+0000","last_clean":"2024-04-26T07:48:32.611806+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:48:32.611806+0000","last_undegraded":"2024-04-26T07:48:32.611806+0000","last_fullsized":"2024-04-26T07:48:32.611806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.595435+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:48:32.595435+0000","last_peered":"2024-04-26T07:48:32.595435+0000","last_clean":"2024-04-26T07:48:32.595435+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:48:32.595435+0000","last_undegraded":"2024-04-26T07:48:32.595435+0000","last_fullsized":"2024-04-26T07:48:32.595435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596319+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:48:32.596319+0000","last_peered":"2024-04-26T07:48:32.596319+0000","last_clean":"2024-04-26T07:48:32.596319+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:48:32.596319+0000","last_undegraded":"2024-04-26T07:48:32.596319+0000","last_fullsized":"2024-04-26T07:48:32.596319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.598592+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:48:32.598592+0000","last_peered":"2024-04-26T07:48:32.598592+0000","last_clean":"2024-04-26T07:48:32.598592+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:48:32.598592+0000","last_undegraded":"2024-04-26T07:48:32.598592+0000","last_fullsized":"2024-04-26T07:48:32.598592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.590055+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:48:32.590055+0000","last_peered":"2024-04-26T07:48:32.590055+0000","last_clean":"2024-04-26T07:48:32.590055+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:48:32.590055+0000","last_undegraded":"2024-04-26T07:48:32.590055+0000","last_fullsized":"2024-04-26T07:48:32.590055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611505+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:48:32.611505+0000","last_peered":"2024-04-26T07:48:32.611505+0000","last_clean":"2024-04-26T07:48:32.611505+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:48:32.611505+0000","last_undegraded":"2024-04-26T07:48:32.611505+0000","last_fullsized":"2024-04-26T07:48:32.611505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592808+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:48:32.592808+0000","last_peered":"2024-04-26T07:48:32.592808+0000","last_clean":"2024-04-26T07:48:32.592808+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:48:32.592808+0000","last_undegraded":"2024-04-26T07:48:32.592808+0000","last_fullsized":"2024-04-26T07:48:32.592808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622687+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:48:32.622687+0000","last_peered":"2024-04-26T07:48:32.622687+0000","last_clean":"2024-04-26T07:48:32.622687+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:48:32.622687+0000","last_undegraded":"2024-04-26T07:48:32.622687+0000","last_fullsized":"2024-04-26T07:48:32.622687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.620978+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:48:32.620978+0000","last_peered":"2024-04-26T07:48:32.620978+0000","last_clean":"2024-04-26T07:48:32.620978+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:48:32.620978+0000","last_undegraded":"2024-04-26T07:48:32.620978+0000","last_fullsized":"2024-04-26T07:48:32.620978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.600079+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:48:32.600079+0000","last_peered":"2024-04-26T07:48:32.600079+0000","last_clean":"2024-04-26T07:48:32.600079+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:48:32.600079+0000","last_undegraded":"2024-04-26T07:48:32.600079+0000","last_fullsized":"2024-04-26T07:48:32.600079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596517+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:48:32.596517+0000","last_peered":"2024-04-26T07:48:32.596517+0000","last_clean":"2024-04-26T07:48:32.596517+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:48:32.596517+0000","last_undegraded":"2024-04-26T07:48:32.596517+0000","last_fullsized":"2024-04-26T07:48:32.596517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617940+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:48:32.617940+0000","last_peered":"2024-04-26T07:48:32.617940+0000","last_clean":"2024-04-26T07:48:32.617940+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:48:32.617940+0000","last_undegraded":"2024-04-26T07:48:32.617940+0000","last_fullsized":"2024-04-26T07:48:32.617940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591008+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:48:32.591008+0000","last_peered":"2024-04-26T07:48:32.591008+0000","last_clean":"2024-04-26T07:48:32.591008+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:48:32.591008+0000","last_undegraded":"2024-04-26T07:48:32.591008+0000","last_fullsized":"2024-04-26T07:48:32.591008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593587+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:48:32.593587+0000","last_peered":"2024-04-26T07:48:32.593587+0000","last_clean":"2024-04-26T07:48:32.593587+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:48:32.593587+0000","last_undegraded":"2024-04-26T07:48:32.593587+0000","last_fullsized":"2024-04-26T07:48:32.593587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.640863+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:48:32.640863+0000","last_peered":"2024-04-26T07:48:32.640863+0000","last_clean":"2024-04-26T07:48:32.640863+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:48:32.640863+0000","last_undegraded":"2024-04-26T07:48:32.640863+0000","last_fullsized":"2024-04-26T07:48:32.640863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.618861+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:48:32.618861+0000","last_peered":"2024-04-26T07:48:32.618861+0000","last_clean":"2024-04-26T07:48:32.618861+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:48:32.618861+0000","last_undegraded":"2024-04-26T07:48:32.618861+0000","last_fullsized":"2024-04-26T07:48:32.618861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.591134+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:48:32.591134+0000","last_peered":"2024-04-26T07:48:32.591134+0000","last_clean":"2024-04-26T07:48:32.591134+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:48:32.591134+0000","last_undegraded":"2024-04-26T07:48:32.591134+0000","last_fullsized":"2024-04-26T07:48:32.591134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596316+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:48:32.596316+0000","last_peered":"2024-04-26T07:48:32.596316+0000","last_clean":"2024-04-26T07:48:32.596316+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:48:32.596316+0000","last_undegraded":"2024-04-26T07:48:32.596316+0000","last_fullsized":"2024-04-26T07:48:32.596316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.613812+0000","last_change":"2024-04-26T07:48:23.552189+0000","last_active":"2024-04-26T07:48:32.613812+0000","last_peered":"2024-04-26T07:48:32.613812+0000","last_clean":"2024-04-26T07:48:32.613812+0000","last_became_active":"2024-04-26T07:48:23.547277+0000","last_became_peered":"2024-04-26T07:48:23.547277+0000","last_unstale":"2024-04-26T07:48:32.613812+0000","last_undegraded":"2024-04-26T07:48:32.613812+0000","last_fullsized":"2024-04-26T07:48:32.613812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.622175+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:48:32.622175+0000","last_peered":"2024-04-26T07:48:32.622175+0000","last_clean":"2024-04-26T07:48:32.622175+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:48:32.622175+0000","last_undegraded":"2024-04-26T07:48:32.622175+0000","last_fullsized":"2024-04-26T07:48:32.622175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.593015+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:48:32.593015+0000","last_peered":"2024-04-26T07:48:32.593015+0000","last_clean":"2024-04-26T07:48:32.593015+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:48:32.593015+0000","last_undegraded":"2024-04-26T07:48:32.593015+0000","last_fullsized":"2024-04-26T07:48:32.593015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.614924+0000","last_change":"2024-04-26T07:48:21.521908+0000","last_active":"2024-04-26T07:48:32.614924+0000","last_peered":"2024-04-26T07:48:32.614924+0000","last_clean":"2024-04-26T07:48:32.614924+0000","last_became_active":"2024-04-26T07:48:21.520599+0000","last_became_peered":"2024-04-26T07:48:21.520599+0000","last_unstale":"2024-04-26T07:48:32.614924+0000","last_undegraded":"2024-04-26T07:48:32.614924+0000","last_fullsized":"2024-04-26T07:48:32.614924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.592541+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:48:32.592541+0000","last_peered":"2024-04-26T07:48:32.592541+0000","last_clean":"2024-04-26T07:48:32.592541+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:48:32.592541+0000","last_undegraded":"2024-04-26T07:48:32.592541+0000","last_fullsized":"2024-04-26T07:48:32.592541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.641446+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:48:32.641446+0000","last_peered":"2024-04-26T07:48:32.641446+0000","last_clean":"2024-04-26T07:48:32.641446+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:48:32.641446+0000","last_undegraded":"2024-04-26T07:48:32.641446+0000","last_fullsized":"2024-04-26T07:48:32.641446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.611749+0000","last_change":"2024-04-26T07:48:23.557177+0000","last_active":"2024-04-26T07:48:32.611749+0000","last_peered":"2024-04-26T07:48:32.611749+0000","last_clean":"2024-04-26T07:48:32.611749+0000","last_became_active":"2024-04-26T07:48:23.556564+0000","last_became_peered":"2024-04-26T07:48:23.556564+0000","last_unstale":"2024-04-26T07:48:32.611749+0000","last_undegraded":"2024-04-26T07:48:32.611749+0000","last_fullsized":"2024-04-26T07:48:32.611749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619852+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:48:32.619852+0000","last_peered":"2024-04-26T07:48:32.619852+0000","last_clean":"2024-04-26T07:48:32.619852+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:48:32.619852+0000","last_undegraded":"2024-04-26T07:48:32.619852+0000","last_fullsized":"2024-04-26T07:48:32.619852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.617686+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:48:32.617686+0000","last_peered":"2024-04-26T07:48:32.617686+0000","last_clean":"2024-04-26T07:48:32.617686+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:48:32.617686+0000","last_undegraded":"2024-04-26T07:48:32.617686+0000","last_fullsized":"2024-04-26T07:48:32.617686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.596263+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:48:32.596263+0000","last_peered":"2024-04-26T07:48:32.596263+0000","last_clean":"2024-04-26T07:48:32.596263+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:48:32.596263+0000","last_undegraded":"2024-04-26T07:48:32.596263+0000","last_fullsized":"2024-04-26T07:48:32.596263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.610449+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:48:32.610449+0000","last_peered":"2024-04-26T07:48:32.610449+0000","last_clean":"2024-04-26T07:48:32.610449+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:48:32.610449+0000","last_undegraded":"2024-04-26T07:48:32.610449+0000","last_fullsized":"2024-04-26T07:48:32.610449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T07:48:32.619472+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:48:32.619472+0000","last_peered":"2024-04-26T07:48:32.619472+0000","last_clean":"2024-04-26T07:48:32.619472+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:48:32.619472+0000","last_undegraded":"2024-04-26T07:48:32.619472+0000","last_fullsized":"2024-04-26T07:48:32.619472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":734425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":143397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":144225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":142895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":145222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":142959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":144083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36264,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335576,"statfs":{"total":96636764160,"available":96599629824,"internally_reserved":0,"allocated":946176,"data_stored":734824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:48:39.912 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T07:48:39.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 29 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 49487ed9-d16e-45ed-bfa2-5a4b8da36b24 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-04-26T07:48:02.780799+0000 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-04-26T07:48:32.578634+0000 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:crush_version 4 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:full_ratio 0.95 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:backfillfull_ratio 0.9 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:nearfull_ratio 0.85 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:require_min_compat_client luminous 2024-04-26T07:48:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:min_compat_client jewel 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:require_osd_release squid 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:stretch_mode_enabled false 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 29 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:max_osd 8 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6816/3522703831,v1:172.21.15.53:6818/3522703831] [v2:172.21.15.53:6820/3522703831,v1:172.21.15.53:6822/3522703831] exists,up 6c19b301-d4c3-4075-aea7-ab2ee53aaf3a 2024-04-26T07:48:40.258 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6800/4143904497,v1:172.21.15.53:6802/4143904497] [v2:172.21.15.53:6804/4143904497,v1:172.21.15.53:6806/4143904497] exists,up 639db176-ee73-4aa3-aa4b-e1e713fb0026 2024-04-26T07:48:40.259 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 up in weight 1 up_from 13 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6817/2446521991,v1:172.21.15.53:6819/2446521991] [v2:172.21.15.53:6821/2446521991,v1:172.21.15.53:6823/2446521991] exists,up f2832add-3da3-4a41-b7eb-80c0b58a6166 2024-04-26T07:48:40.259 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6801/3123753498,v1:172.21.15.53:6803/3123753498] [v2:172.21.15.53:6805/3123753498,v1:172.21.15.53:6807/3123753498] exists,up e532d54a-ed1f-4177-8289-2eea90fe5d27 2024-04-26T07:48:40.259 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6816/4225192245,v1:172.21.15.191:6817/4225192245] [v2:172.21.15.191:6818/4225192245,v1:172.21.15.191:6820/4225192245] exists,up 17337c8b-3ed8-41fb-900b-e7068a4cc2e4 2024-04-26T07:48:40.259 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/1158804178,v1:172.21.15.191:6801/1158804178] [v2:172.21.15.191:6802/1158804178,v1:172.21.15.191:6803/1158804178] exists,up 99310d57-c1a3-4935-9bbf-908dd237036d 2024-04-26T07:48:40.259 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6807/451207779,v1:172.21.15.191:6809/451207779] [v2:172.21.15.191:6810/451207779,v1:172.21.15.191:6811/451207779] exists,up 2fef5c6a-e83d-4ab2-b571-794295b6fe31 2024-04-26T07:48:40.259 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6819/2025100830,v1:172.21.15.191:6821/2025100830] [v2:172.21.15.191:6824/2025100830,v1:172.21.15.191:6826/2025100830] exists,up 82fb2b9a-7a8d-4af8-ab0e-94da703625ef 2024-04-26T07:48:40.275 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6816/3522703831,v1:172.21.15.53:6818/3522703831] [v2:172.21.15.53:6820/3522703831,v1:172.21.15.53:6822/3522703831] exists,up 6c19b301-d4c3-4075-aea7-ab2ee53aaf3a', 'osd.1 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6800/4143904497,v1:172.21.15.53:6802/4143904497] [v2:172.21.15.53:6804/4143904497,v1:172.21.15.53:6806/4143904497] exists,up 639db176-ee73-4aa3-aa4b-e1e713fb0026', 'osd.2 up in weight 1 up_from 13 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6817/2446521991,v1:172.21.15.53:6819/2446521991] [v2:172.21.15.53:6821/2446521991,v1:172.21.15.53:6823/2446521991] exists,up f2832add-3da3-4a41-b7eb-80c0b58a6166', 'osd.3 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6801/3123753498,v1:172.21.15.53:6803/3123753498] [v2:172.21.15.53:6805/3123753498,v1:172.21.15.53:6807/3123753498] exists,up e532d54a-ed1f-4177-8289-2eea90fe5d27', 'osd.4 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6816/4225192245,v1:172.21.15.191:6817/4225192245] [v2:172.21.15.191:6818/4225192245,v1:172.21.15.191:6820/4225192245] exists,up 17337c8b-3ed8-41fb-900b-e7068a4cc2e4', 'osd.5 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/1158804178,v1:172.21.15.191:6801/1158804178] [v2:172.21.15.191:6802/1158804178,v1:172.21.15.191:6803/1158804178] exists,up 99310d57-c1a3-4935-9bbf-908dd237036d', 'osd.6 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6807/451207779,v1:172.21.15.191:6809/451207779] [v2:172.21.15.191:6810/451207779,v1:172.21.15.191:6811/451207779] exists,up 2fef5c6a-e83d-4ab2-b571-794295b6fe31', 'osd.7 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6819/2025100830,v1:172.21.15.191:6821/2025100830] [v2:172.21.15.191:6824/2025100830,v1:172.21.15.191:6826/2025100830] exists,up 82fb2b9a-7a8d-4af8-ab0e-94da703625ef'] 2024-04-26T07:48:40.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T07:48:40.389 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mon.a", 2024-04-26T07:48:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster": "ceph", 2024-04-26T07:48:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T07:48:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "admin_socket_mode": "", 2024-04-26T07:48:40.389 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T07:48:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_client_required": "cephx, none", 2024-04-26T07:48:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_cluster_required": "cephx", 2024-04-26T07:48:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_debug": "true", 2024-04-26T07:48:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T07:48:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T07:48:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_service_required": "cephx", 2024-04-26T07:48:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T07:48:40.390 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_supported": "cephx", 2024-04-26T07:48:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_aio": "true", 2024-04-26T07:48:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T07:48:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T07:48:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_aio_reap_max": "16", 2024-04-26T07:48:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_async_discard_threads": "0", 2024-04-26T07:48:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_block_size": "4096", 2024-04-26T07:48:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_debug_aio": "false", 2024-04-26T07:48:40.391 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_enable_discard": "false", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_flock_retry": "3", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_inject_crash": "0", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_ioring": "false", 2024-04-26T07:48:40.392 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_ioring_hipri": "false", 2024-04-26T07:48:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T07:48:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T07:48:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T07:48:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T07:48:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "bdev_type": "", 2024-04-26T07:48:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T07:48:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_allocator": "hybrid", 2024-04-26T07:48:40.393 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_buffered_io": "true", 2024-04-26T07:48:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T07:48:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T07:48:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T07:48:40.394 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T07:48:40.395 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_replay_recovery": "false", 2024-04-26T07:48:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T07:48:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T07:48:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_sync_write": "false", 2024-04-26T07:48:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T07:48:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T07:48:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T07:48:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T07:48:40.396 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_allocator": "hybrid", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_create": "true", 2024-04-26T07:48:40.397 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_db_create": "false", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_db_path": "", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_db_size": "0", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_path": "", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_size": "107374182400", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_wal_create": "false", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_wal_path": "", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bluefs": "true", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T07:48:40.398 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_autotune": "true", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_size": "0", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_type": "2q", 2024-04-26T07:48:40.399 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_clone_cow": "true", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_mode": "none", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-26T07:48:40.400 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_freelist": "false", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T07:48:40.401 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fail_eio": "false", 2024-04-26T07:48:40.402 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T07:48:40.403 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T07:48:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T07:48:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T07:48:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T07:48:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T07:48:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T07:48:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T07:48:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T07:48:40.404 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T07:48:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T07:48:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_blob_size": "0", 2024-04-26T07:48:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T07:48:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T07:48:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T07:48:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T07:48:40.405 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T07:48:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T07:48:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T07:48:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T07:48:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T07:48:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T07:48:40.406 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T07:48:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T07:48:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T07:48:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T07:48:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T07:48:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T07:48:40.407 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T07:48:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T07:48:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T07:48:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T07:48:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_spdk_mem": "512", 2024-04-26T07:48:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T07:48:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T07:48:40.408 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T07:48:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T07:48:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T07:48:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T07:48:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T07:48:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_tracing": "false", 2024-04-26T07:48:40.409 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T07:48:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T07:48:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T07:48:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T07:48:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T07:48:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T07:48:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T07:48:40.410 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T07:48:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T07:48:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T07:48:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T07:48:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T07:48:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T07:48:40.411 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T07:48:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T07:48:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T07:48:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T07:48:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T07:48:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T07:48:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T07:48:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T07:48:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T07:48:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T07:48:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T07:48:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T07:48:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_cluster_require_version": "2", 2024-04-26T07:48:40.413 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_require_signatures": "false", 2024-04-26T07:48:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_require_version": "2", 2024-04-26T07:48:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_service_require_signatures": "false", 2024-04-26T07:48:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_service_require_version": "2", 2024-04-26T07:48:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "cephx_sign_messages": "true", 2024-04-26T07:48:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "chdir": "", 2024-04-26T07:48:40.414 INFO:teuthology.orchestra.run.smithi053.stdout: "client_acl_type": "", 2024-04-26T07:48:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "client_asio_thread_count": "2", 2024-04-26T07:48:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "client_cache_mid": "0.750000", 2024-04-26T07:48:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "client_cache_size": "16384", 2024-04-26T07:48:40.415 INFO:teuthology.orchestra.run.smithi053.stdout: "client_caps_release_delay": "5", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_check_pool_perm": "true", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_debug_force_sync_read": "false", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_debug_getattr_caps": "false", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_die_on_failed_remount": "false", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_dirsize_rbytes": "true", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_force_lazyio": "false", 2024-04-26T07:48:40.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_fs": "", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_inject_release_failure": "false", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_max_inline_size": "4096", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mds_namespace": "", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_metadata": "", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mount_gid": "-1", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mount_timeout": "300", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mount_uid": "-1", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_mountpoint": "/", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_notify_timeout": "10", 2024-04-26T07:48:40.417 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc": "true", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_max_objects": "1000", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_size": "209715200", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_permissions": "true", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_quota": "true", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_quota_df": "true", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_readahead_max_bytes": "0", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_readahead_max_periods": "4", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_readahead_min": "131072", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_reconnect_stale": "false", 2024-04-26T07:48:40.418 INFO:teuthology.orchestra.run.smithi053.stdout: "client_shutdown_timeout": "30", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_snapdir": ".snap", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_tick_interval": "1", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_trace": "", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_use_faked_inos": "false", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_use_random_mds": "false", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_graylog": "false", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_graylog_port": "12201", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_monitors": "default=true", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_syslog": "false", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "clog_to_syslog_level": "info", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "-", 2024-04-26T07:48:40.419 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_network": "", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_network_interface": "", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "compressor_zlib_isal": "false", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "compressor_zlib_level": "5", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "compressor_zstd_level": "1", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_osd_stat_interval": "0", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crimson_seastar_cpu_cores": "", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_location": "", 2024-04-26T07:48:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_location_hook": "", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_location_hook_timeout": "10", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "daemonize": "false", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "daos_pool": "tank", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_alienstore": "0/5", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_asok": "1/5", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_asok_assert_abort": "false", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_auth": "20/20", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_bdev": "1/3", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_bluefs": "1/5", 2024-04-26T07:48:40.421 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_bluestore": "1/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_buffer": "0/1", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_cephsqlite": "0/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_client": "0/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_compressor": "1/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_context": "0/1", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_crimson_interrupt": "0/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_crush": "1/1", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_crypto": "1/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_cyanstore": "0/5", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T07:48:40.422 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_dpdk": "1/5", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_eventtrace": "1/5", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_filer": "0/1", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_filestore": "1/3", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_finisher": "1/1", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_fuse": "1/5", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_javaclient": "1/5", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_journal": "1/3", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_journaler": "0/5", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_kstore": "1/5", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_lockdep": "0/1", 2024-04-26T07:48:40.423 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mclock": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_balancer": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_locker": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_log": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_migrator": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mds_quiesce": "3/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_memstore": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mgr": "2/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mgrc": "1/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_mon": "20/20", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_monc": "0/10", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_ms": "1/1", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_none": "0/5", 2024-04-26T07:48:40.424 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_objclass": "0/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_objectcacher": "0/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_objecter": "0/1", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_optracker": "0/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_osd": "1/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_paxos": "20/20", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_perfcounter": "1/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_prioritycache": "1/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rados": "0/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rbd": "0/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rbd_replay": "0/5", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_refs": "0/0", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_reserver": "1/1", 2024-04-26T07:48:40.425 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw": "1/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_access": "1/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_flight": "1/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_notification": "1/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rgw_sync": "1/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_rocksdb": "4/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore": "0/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_backref": "0/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_cache": "0/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T07:48:40.426 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_device": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_epm": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_journal": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_lba": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_odata": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_omap": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_onode": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_t": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_seastore_tm": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_striper": "0/1", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_test": "0/5", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_throttle": "1/1", 2024-04-26T07:48:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_timer": "0/1", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_tp": "0/5", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "debug_trace": "1/5", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "device_failure_prediction_mode": "none", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "err_to_graylog": "false", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "err_to_journald": "false", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "err_to_stderr": "true", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "err_to_syslog": "false", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event_tracing": "false", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_http_port": "9926", 2024-04-26T07:48:40.428 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_prio_limit": "5", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_sort_metrics": "true", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "exporter_stats_period": "5", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "fake_statfs_for_testing": "0", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "fatal_signal_handlers": "true", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "filer_max_purge_ops": "10", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "filer_max_truncate_ops": "128", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_blackhole": "false", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_btrfs_snap": "true", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_caller_concurrency": "10", 2024-04-26T07:48:40.429 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_debug_omap_check": "false", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_debug_verify_split": "false", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_dump_file": "", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fadvise": "true", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fail_eio": "true", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fd_cache_size": "128", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fiemap": "false", 2024-04-26T07:48:40.430 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_inject_stall": "0", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_journal_parallel": "false", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_journal_trailing": "false", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_journal_writeahead": "false", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_kill_at": "0", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T07:48:40.431 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_merge_threshold": "-10", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_odsync_write": "false", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T07:48:40.432 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_omap_backend_path": "", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_op_threads": "2", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_punch_hole": "false", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T07:48:40.433 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T07:48:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T07:48:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T07:48:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T07:48:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T07:48:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T07:48:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T07:48:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_queue_max_ops": "50", 2024-04-26T07:48:40.434 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_seek_data_hole": "false", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_sloppy_crc": "false", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_splice": "false", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_split_multiple": "2", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_split_rand_factor": "20", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_update_to": "1000", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T07:48:40.435 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T07:48:40.436 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T07:48:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T07:48:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T07:48:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_xfs_extsize": "false", 2024-04-26T07:48:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "filestore_zfs_snap": "false", 2024-04-26T07:48:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "fio_dir": "/tmp/fio", 2024-04-26T07:48:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "fsid": "49487ed9-d16e-45ed-bfa2-5a4b8da36b24", 2024-04-26T07:48:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_allow_other": "true", 2024-04-26T07:48:40.437 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_big_writes": "true", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_debug": "false", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_default_permissions": "false", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_disable_pagecache": "false", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_max_write": "0", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_multithreaded": "true", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_require_active_mds": "true", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_set_user_groups": "true", 2024-04-26T07:48:40.438 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_splice_move": "true", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_splice_read": "true", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_splice_write": "true", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "gss_target_name": "ceph", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_file": "", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_inject_failure": "0", 2024-04-26T07:48:40.439 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_interval": "5", 2024-04-26T07:48:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "host": "smithi053", 2024-04-26T07:48:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T07:48:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T07:48:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T07:48:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T07:48:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T07:48:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T07:48:40.440 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "inject_early_sigterm": "false", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "jaeger_agent_port": "6799", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "jaeger_tracing_enable": "false", 2024-04-26T07:48:40.441 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_aio": "true", 2024-04-26T07:48:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_align_min_size": "65536", 2024-04-26T07:48:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_block_align": "true", 2024-04-26T07:48:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_block_size": "4096", 2024-04-26T07:48:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_dio": "true", 2024-04-26T07:48:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_discard": "false", 2024-04-26T07:48:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_force_aio": "false", 2024-04-26T07:48:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_ignore_corruption": "false", 2024-04-26T07:48:40.442 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T07:48:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_max_write_entries": "100", 2024-04-26T07:48:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_replay_from": "0", 2024-04-26T07:48:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T07:48:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T07:48:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T07:48:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T07:48:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_write_header_frequency": "0", 2024-04-26T07:48:40.443 INFO:teuthology.orchestra.run.smithi053.stdout: "journal_zero_on_create": "false", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "journaler_prefetch_periods": "10", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "journaler_prezero_periods": "5", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "journaler_write_head_interval": "15", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "keyfile": "", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_backend": "rocksdb", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T07:48:40.444 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_max_bytes": "67108864", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_max_ops": "512", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_onode_map_size": "1024", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "kstore_sync_transaction": "false", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "librados_thread_count": "2", 2024-04-26T07:48:40.445 INFO:teuthology.orchestra.run.smithi053.stdout: "lockdep": "false", 2024-04-26T07:48:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "lockdep_force_backtrace": "false", 2024-04-26T07:48:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "log_coarse_timestamps": "true", 2024-04-26T07:48:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T07:48:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "log_flush_on_exit": "false", 2024-04-26T07:48:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T07:48:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "log_graylog_port": "12201", 2024-04-26T07:48:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "log_max_new": "1000", 2024-04-26T07:48:40.446 INFO:teuthology.orchestra.run.smithi053.stdout: "log_max_recent": "10000", 2024-04-26T07:48:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_stderr_prefix": "", 2024-04-26T07:48:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T07:48:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": "true", 2024-04-26T07:48:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_graylog": "false", 2024-04-26T07:48:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_journald": "false", 2024-04-26T07:48:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_stderr": "false", 2024-04-26T07:48:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_syslog": "false", 2024-04-26T07:48:40.447 INFO:teuthology.orchestra.run.smithi053.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_action_on_write_error": "1", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_alternate_name_max": "8192", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_asio_thread_count": "2", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_export_pin": "true", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_interval": "10", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_max": "-1", 2024-04-26T07:48:40.448 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_max_until": "-1", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_merge_size": "50", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_mode": "0", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_overload_epochs": "2", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_split_bits": "3", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_split_size": "10000", 2024-04-26T07:48:40.449 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_mid": "0.700000", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_delay": "0", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-26T07:48:40.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_trim_interval": "1", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_debug_auth_pins": "false", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_debug_frag": "false", 2024-04-26T07:48:40.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_debug_scatterstat": "false", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_debug_subtrees": "false", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_default_dir_hash": "2", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_defer_session_stale": "true", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dir_max_entries": "0", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dir_prefetch": "true", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T07:48:40.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_early_reply": "true", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_enable_op_tracker": "true", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_enforce_unique_name": "true", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T07:48:40.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_health_dummy": "false", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_join_fs": "", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_journal_format": "1", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_create_at": "0", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_export_at": "0", 2024-04-26T07:48:40.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_import_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_journal_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_link_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_openc_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_rename_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_shutdown_at": "0", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_event_large_threshold": "524288", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_max_events": "-1", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_max_segments": "128", 2024-04-26T07:48:40.455 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_pause": "false", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_segment_size": "0", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_trim_threshold": "128", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_completed_requests": "100000", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_export_size": "20971520", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_file_recover": "32", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_purge_files": "64", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_purge_ops": "8192", 2024-04-26T07:48:40.456 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_metrics_update_interval": "2", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_min_caps_per_client": "100", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_numa_node": "-1", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_history_duration": "600", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_history_size": "20", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_op_log_threshold": "5", 2024-04-26T07:48:40.457 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_ping_grace": "15", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_ping_interval": "5", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_max_caps": "30000", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_replay_interval": "1.000000", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_root_ino_gid": "0", 2024-04-26T07:48:40.458 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_root_ino_uid": "0", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_shutdown_check": "0", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_skip_ino": "0", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T07:48:40.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_snap_min_uid": "0", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_snap_rstat": "false", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_symlink_recovery": "true", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_thrash_exports": "0", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_thrash_fragments": "0", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_tick_interval": "5.000000", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_valgrind_exit": "false", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_verify_backtrace": "1", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_verify_scatter": "false", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_wipe_sessions": "false", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool_debug": "false", 2024-04-26T07:48:40.460 INFO:teuthology.orchestra.run.smithi053.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "memstore_page_set": "false", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "memstore_page_size": "65536", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_client_bytes": "134217728", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_client_messages": "512", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_disabled_modules": "", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_max_pg_creating": "1024", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T07:48:40.461 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_mds_messages": "128", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_mon_messages": "128", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_osd_messages": "8192", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_pool": "true", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_standby_modules": "true", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_stats_period": "5", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_stats_threshold": "5", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_tick_period": "2", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T07:48:40.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_allow_pool_delete": "true", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_bytes": "104857600", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T07:48:40.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_client_target_rank": "-1", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T07:48:40.464 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_compact_on_start": "false", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_compact_on_trim": "true", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_cpu_threads": "4", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T07:48:40.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_data_avail_crit": "5", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_data_avail_warn": "5", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_dump_json": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_extra_checks": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_no_require_squid": "false", 2024-04-26T07:48:40.466 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_down_uptime_grace": "60", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_election_default_strategy": "1", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_election_timeout": "5.000000", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_enable_op_tracker": "true", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_fake_pool_delete": "false", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_force_quorum_join": "false", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T07:48:40.467 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_log_update_period": "5", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_max_detail": "50", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_to_clog": "true", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_host": "172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790],172.21.15.191", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_host_override": "", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_initial_members": "", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_lease": "5.000000", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T07:48:40.468 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_log_full_interval": "50", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_log_max": "10000", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_log_max_summary": "50", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_log_epochs": "500", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_osd": "10000", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T07:48:40.469 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_memory_autotune": "true", 2024-04-26T07:48:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_memory_target": "2147483648", 2024-04-26T07:48:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T07:48:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T07:48:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_digest_period": "5", 2024-04-26T07:48:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T07:48:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T07:48:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T07:48:40.470 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_complaint_time": "30", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_history_duration": "600", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_history_size": "20", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_op_log_threshold": "5", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T07:48:40.471 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_cache_size": "500", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T07:48:40.472 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T07:48:40.473 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_report_timeout": "900", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T07:48:40.474 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_reweight_max_osds": "4", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_interval": "86400", 2024-04-26T07:48:40.475 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_max_keys": "100", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_scrub_timeout": "300", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_session_timeout": "300", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_smart_report_timeout": "5", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stretch_pool_size": "4", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_debug": "false", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T07:48:40.476 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_tick_interval": "5", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T07:48:40.477 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_older_version": "true", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T07:48:40.478 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "monmap": "", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T07:48:40.479 INFO:teuthology.orchestra.run.smithi053.stdout: "motr_tracing_enabled": "false", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_op_threads": "3", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_cm": "false", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_device_name": "", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T07:48:40.480 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_sl": "3", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_rdma_type": "ib", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_async_reap_threshold": "5", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_before_connect": "false", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_ipv4": "true", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_ipv6": "false", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_msgr1": "true", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_msgr2": "true", 2024-04-26T07:48:40.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_port_max": "7568", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_port_min": "6800", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_retry_count": "3", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_bind_retry_delay": "5", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_client": "false", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_mds": "false", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_mgr": "false", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_mon": "false", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_blackhole_osd": "false", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_client_mode": "crc secure", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T07:48:40.482 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_cluster_type": "", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_compress_secure": "false", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_crc_data": "true", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_crc_header": "true", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_bug": "true", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_old_message": "true", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T07:48:40.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_hugepages": "", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_lro": "true", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_pmd": "", 2024-04-26T07:48:40.484 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_port_id": "0", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_dump_on_send": "false", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_delay_type": "", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_network_congestion": "0", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_inject_socket_failures": "0", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T07:48:40.485 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_max_accept_failures": "4", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_max_backoff": "15.000000", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_osd_compress_mode": "none", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_pq_min_cost": "65536", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_public_type": "", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_service_mode": "crc secure", 2024-04-26T07:48:40.486 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_tcp_nodelay": "true", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "ms_type": "async+posix", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "no_config_file": "false", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_inflight_ops": "1024", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T07:48:40.487 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter_timeout": "10.000000", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "objectstore_blackhole": "false", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "openssl_engine_opts": "", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_max_ops": "4", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_agent_slop": "0.020000", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T07:48:40.488 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_asio_thread_count": "2", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backfill_scan_max": "512", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backfill_scan_min": "64", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backoff_on_peering": "false", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_beacon_report_interval": "300", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bench_duration": "30", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T07:48:40.489 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_blkin_trace_all": "false", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T07:48:40.490 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_class_update_on_start": "true", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_client_message_cap": "256", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_client_op_priority": "63", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_client_watch_timeout": "30", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_command_max_records": "256", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_compact_on_start": "false", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_crush_update_on_start": "true", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T07:48:40.491 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_op_order": "false", 2024-04-26T07:48:40.492 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_shutdown": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_trim_objects": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T07:48:40.493 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_default_notify_timeout": "30", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T07:48:40.494 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_enable_op_tracker": "true", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_info": "true", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_shutdown": "true", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T07:48:40.495 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_function_tracing": "false", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_grace": "20", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_interval": "6", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_stale": "600", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T07:48:40.496 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_journal_size": "5120", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_kill_backfill_at": "0", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_cache_size": "50", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_dedup": "true", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_message_max": "40", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_attr_name_len": "100", 2024-04-26T07:48:40.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_attr_size": "0", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_backfills": "1", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_markdown_count": "5", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_markdown_period": "600", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_object_name_len": "2048", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_object_size": "134217728", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T07:48:40.498 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_pgls": "1024", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_push_cost": "8388608", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_push_objects": "10", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_scrubs": "3", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_max_write_size": "90", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T07:48:40.499 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_profile": "balanced", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T07:48:40.500 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_base": "805306368", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_target": "4294967296", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_target_autotune": "false", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_min_recovery_priority": "0", 2024-04-26T07:48:40.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_report_interval": "5", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_num_cache_shards": "32", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_numa_node": "-1", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_objecter_finishers": "1", 2024-04-26T07:48:40.502 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_objectstore": "bluestore", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_objectstore_fuse": "false", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_objectstore_tracing": "false", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_history_duration": "600", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_history_size": "20", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_log_threshold": "5", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_shards": "0", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T07:48:40.503 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_op_thread_timeout": "15", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_open_classes_on_start": "true", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_os_flags": "0", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_peering_op_priority": "255", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T07:48:40.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_delete_priority": "5", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T07:48:40.505 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_crimson": "false", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T07:48:40.506 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_flags": "0", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_min_size": "0", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_read_ratio": "70", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_size": "2", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_default_type": "replicated", 2024-04-26T07:48:40.507 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_cost": "20971520", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_active": "0", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T07:48:40.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_op_priority": "3", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_priority": "5", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_repair_during_recovery": "false", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T07:48:40.509 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_cost": "52428800", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T07:48:40.510 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_end_hour": "0", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_priority": "5", 2024-04-26T07:48:40.511 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_skip_data_digest": "false", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_smart_report_timeout": "5", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_priority": "5", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T07:48:40.512 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_target_transaction_size": "30", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T07:48:40.513 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_tracing": "false", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_use_stale_snap": "false", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_kill_at": "0", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_max_join_drift": "10", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_min": "500", 2024-04-26T07:48:40.514 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_min_wait": "0.050000", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_service_trim_max": "500", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_service_trim_min": "250", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_stash_full_interval": "25", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_trim_max": "500", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "paxos_trim_min": "250", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "perf": "true", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-26T07:48:40.515 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "-", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrv": "", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "public_bind_addr": "-", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "public_network": "", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "public_network_interface": "", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "qat_compressor_enabled": "false", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "rados_mon_op_timeout": "0", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "rados_osd_op_timeout": "0", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "rados_tracing": "false", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_atime_update_interval": "60", 2024-04-26T07:48:40.516 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache": "true", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T07:48:40.517 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_policy": "writearound", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_size": "33554432", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_compression_hint": "none", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_clone_format": "auto", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_data_pool": "", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_features": "61", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_format": "2", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_map_options": "", 2024-04-26T07:48:40.518 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_order": "22", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_pool": "rbd", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_stripe_count": "0", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_io_scheduler": "simple", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T07:48:40.519 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_order": "24", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_pool": "", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_journal_splay_width": "4", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T07:48:40.520 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T07:48:40.521 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T07:48:40.522 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_op_threads": "1", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T07:48:40.523 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_plugins": "", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T07:48:40.524 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T07:48:40.525 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_tracing": "false", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_validate_names": "true", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_validate_pool": "true", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "restapi_base_url": "", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "restapi_log_level": "", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_admin_entry": "admin", 2024-04-26T07:48:40.526 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_backend_store": "rados", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_barbican_url": "", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_beast_enable_async": "true", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_counters_cache": "false", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T07:48:40.527 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cache_enabled": "true", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_config_store": "rados", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_content_length_compat": "false", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_cross_domain_policy": "", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T07:48:40.528 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T07:48:40.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T07:48:40.530 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T07:48:40.531 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_l1_fadvise": "4", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-04-26T07:48:40.532 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_d4n_port": "6379", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_log_window": "30", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T07:48:40.533 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T07:48:40.534 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dns_name": "", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dns_s3website_name": "", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_ops_log": "false", 2024-04-26T07:48:40.535 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_static_website": "false", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enable_usage_log": "false", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_expose_bucket": "false", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_extended_http_attrs": "", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_filter": "none", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T07:48:40.536 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_objs": "32", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_init_timeout": "300", 2024-04-26T07:48:40.537 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_kafka_connection_idle": "300", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_password": "", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T07:48:40.538 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_project": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_token": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_admin_user": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_api_version": "2", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T07:48:40.539 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_url": "", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_max_objs": "32", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_max_worker": "3", 2024-04-26T07:48:40.540 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ldap_uri": "", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lfuda_sync_frequency": "60", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T07:48:40.541 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_log_http_headers": "", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_attr_size": "0", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T07:48:40.542 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_listing_results": "1000", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_notify_retries": "10", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T07:48:40.543 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T07:48:40.544 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_num_control_oids": "8", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_numa_node": "-1", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T07:48:40.545 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_op_tracing": "false", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_opa_token": "", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_opa_url": "", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T07:48:40.546 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ops_log_rados": "false", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_cache_lanes": "3", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-26T07:48:40.547 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_cache_partitions": "3", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_print_continue": "true", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_rados_tracing": "false", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_realm": "", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_realm_id": "", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_region": "", 2024-04-26T07:48:40.548 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_request_uri": "", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_resolve_cname": "false", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_run_sync_thread": "true", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T07:48:40.549 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_s3select_disable": "false", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_script_uri": "", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_service_provider_name": "", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_client_id": "", 2024-04-26T07:48:40.550 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_client_secret": "", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_entry": "sts", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_key": "sts", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_auth_url": "", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_custom_header": "", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_need_stats": "true", 2024-04-26T07:48:40.551 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_tenant_name": "", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_url": "", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_lease_period": "120", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T07:48:40.552 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_thread_pool_size": "512", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_comment": "", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_createby": "", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_encoding": "", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_flag": "false", 2024-04-26T07:48:40.553 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_origin": "", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_torrent_tracker": "", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_usage_max_shards": "32", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_use_opa_authz": "false", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_counters_cache": "false", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T07:48:40.554 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_user_unique_email": "true", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_verify_ssl": "true", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zone": "", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zone_id": "", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T07:48:40.555 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zonegroup": "", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zonegroup_id": "", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_block_size": "4096", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T07:48:40.556 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_partition_filters": "false", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_perf": "false", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T07:48:40.557 INFO:teuthology.orchestra.run.smithi053.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "run_dir": "/var/run/ceph", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_block_create": "true", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_device_size": "53687091200", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T07:48:40.558 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_main_device_type": "SSD", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "seastore_segment_size": "67108864", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "set_keepcaps": "false", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "setgroup": "", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "setuser": "", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "setuser_match_path": "", 2024-04-26T07:48:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T07:48:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "thp": "false", 2024-04-26T07:48:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "threadpool_default_timeout": "60", 2024-04-26T07:48:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T07:48:40.560 INFO:teuthology.orchestra.run.smithi053.stdout: "throttler_perf_counter": "true" 2024-04-26T07:48:40.560 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:40.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T07:48:40.711 INFO:teuthology.orchestra.run.smithi053.stdout:mon.a: {} 2024-04-26T07:48:40.711 INFO:teuthology.orchestra.run.smithi053.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T07:48:40.724 INFO:teuthology.orchestra.run.smithi053.stdout:mon.b: {} 2024-04-26T07:48:40.725 INFO:teuthology.orchestra.run.smithi053.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T07:48:40.734 INFO:teuthology.orchestra.run.smithi053.stdout:mon.c: {} 2024-04-26T07:48:40.734 INFO:teuthology.orchestra.run.smithi053.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T07:48:40.751 DEBUG:teuthology.orchestra.run.smithi053:> type ceph-objectstore-tool 2024-04-26T07:48:40.755 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T07:48:40.755 DEBUG:teuthology.orchestra.run.smithi191:> type ceph-objectstore-tool 2024-04-26T07:48:40.761 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T07:48:40.762 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T07:48:40.773 INFO:tasks.workunit:Pulling workunits from ref 5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:48:40.773 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T07:48:40.774 DEBUG:teuthology.orchestra.run.smithi053:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T07:48:40.774 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T07:48:40.774 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T07:48:40.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T07:48:40.774 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T07:48:40.775 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T07:48:40.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:48:40.775 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T07:48:40.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:48:40.776 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T07:48:40.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:48:40.800 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:40.800+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:40.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:48:40.805 INFO:teuthology.orchestra.run.smithi053.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-26T07:48:40.805 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-26T07:48:40.857 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-26T07:48:40.857 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-26T07:48:40.877 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:40.875+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:40.907 INFO:tasks.workunit:timeout=3h 2024-04-26T07:48:40.907 INFO:tasks.workunit:cleanup=True 2024-04-26T07:48:40.908 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/galsalomon66/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5bfac0af933f1833ec096c3048e2c80e20507e52 2024-04-26T07:48:40.931 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:40.931 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:40.931 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:40.931 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:40.935 INFO:tasks.workunit.client.0.smithi053.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T07:48:40.947 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:40.947 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:40.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:48:40.964 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:40.983 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:40.983 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:40.984 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:40.984+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:41.017 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:41.017 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:41.046 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:41.046 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:41.078 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:41.075+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:41.081 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:41.082 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:41.099 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:41.099 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:41.110 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:41.111 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:41.113 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:48:41.132 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:41.132 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:41.155 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:48:41.220 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:41.219+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:41.248 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:41.248 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:41.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:48:41.304 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:41.303+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:41.380 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:41.379+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:41.422 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:41.423 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:41.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:48:41.484 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:41.483+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:41.555 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:41.555 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:41.569 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:48:41.612 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:41.611+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:41.682 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:41.679+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:41.727 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:41.727 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:41.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:48:41.784 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:41.783+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:41.884 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:41.883+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:41.909 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:41.909 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:41.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:48:41.985 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:41.983+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:42.044 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:42.044 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:42.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:48:42.107 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:42.107+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:42.153 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T07:48:42.178 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T07:48:42.187 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:42.183+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:42.189 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:42.189 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:42.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:48:42.291 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:42.291+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:42.369 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:42.370 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:42.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:48:42.389 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:42.387+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:42.490 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:42.487+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:42.551 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:42.551 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:42.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:48:42.612 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:42.611+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:42.681 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:42.681 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:42.692 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:42.687+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:42.694 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:48:42.793 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:42.791+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:42.827 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:42.827 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:42.842 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:48:42.936 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:42.935+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:42.995 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:42.991+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:43.013 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:43.013 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:43.028 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:48:43.096 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:43.095+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:43.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:48:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T07:48:43.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:48:43.192 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T07:48:43.198 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:43.198 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:43.213 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:48:43.236 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:43.235+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:43.297 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:43.295+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:43.308 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:43.308 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:43.324 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:43.331 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:43.331 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:43.342 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:43.342 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:43.345 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:48:43.360 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:43.360 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:43.379 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:43.398 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:43.398 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:43.398 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:43.395+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:43.415 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:43.415 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:43.434 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:43.434 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:43.462 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:48:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:48:43.462 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:43.476 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:48:43.500 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:43.499+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:43.600 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:43.599+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:43.602 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:43.602 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:43.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:43.602 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:43.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.603 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4449.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:48:43.603 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:25.604098+0000", 2024-04-26T07:48:43.603 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.996077471, 2024-04-26T07:48:43.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031839630000000002, 2024-04-26T07:48:43.603 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.603 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4449", 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 37 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604098+0000", 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604098+0000", 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604100+0000", 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.903e-06 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604111+0000", 2024-04-26T07:48:43.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1202999999999999e-05 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604134+0000", 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3366e-05 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604148+0000", 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3613e-05 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604294+0000", 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014655500000000001 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604586+0000", 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029125800000000002 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604872+0000", 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028644899999999998 2024-04-26T07:48:43.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.606301+0000", 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014285210000000001 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.607107+0000", 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00080672299999999997 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.607212+0000", 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105009 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.607282+0000", 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9363000000000007e-05 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4449.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:25.614143+0000", 2024-04-26T07:48:43.609 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.986032373, 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003289003, 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4449", 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 41 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614143+0000", 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614143+0000", 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614145+0000", 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2560000000000001e-06 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614158+0000", 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2456999999999999e-05 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614188+0000", 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.044e-05 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614203+0000", 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4596999999999999e-05 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614358+0000", 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015504900000000001 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614715+0000", 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035756600000000003 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.615171+0000", 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045563599999999999 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.616485+0000", 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001314426 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.617199+0000", 2024-04-26T07:48:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00071386799999999999 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.617292+0000", 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2598999999999999e-05 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.617432+0000", 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000140109 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596391209088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.008423878, 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006394205, 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 49 2024-04-26T07:48:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591754+0000", 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.103e-06 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591762+0000", 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509999999999995e-06 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591791+0000", 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8668999999999999e-05 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591806+0000", 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5051e-05 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591925+0000", 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119163 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592111+0000", 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000185694 2024-04-26T07:48:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592438+0000", 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032695800000000002 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.593651+0000", 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012125320000000001 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.597931+0000", 2024-04-26T07:48:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042799709999999996 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598007+0000", 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6389000000000003e-05 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598146+0000", 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013872400000000001 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.600706+0000", 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.999469004, 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0036210349999999999, 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600706+0000", 2024-04-26T07:48:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600706+0000", 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600707+0000", 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.37e-07 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600714+0000", 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8349999999999998e-06 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600737+0000", 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2972999999999998e-05 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600748+0000", 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1114999999999999e-05 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600848+0000", 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100511 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600882+0000", 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3136999999999998e-05 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.604235+0000", 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033532480000000001 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.604327+0000", 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2578999999999996e-05 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.002642128, 2024-04-26T07:48:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037973019999999998, 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 205 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597536+0000", 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3000000000000002e-06 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597551+0000", 2024-04-26T07:48:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4932999999999999e-05 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597589+0000", 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7137e-05 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597607+0000", 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8913e-05 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597788+0000", 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018071499999999999 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.598155+0000", 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036658699999999998 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.598898+0000", 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00074370700000000003 2024-04-26T07:48:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.600857+0000", 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001958441 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601163+0000", 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030609799999999998 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601253+0000", 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509e-05 2024-04-26T07:48:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601330+0000", 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7961999999999997e-05 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:219 6.4 e29/23 6:227f63b5:gc::gc.14:head v 29'4, mlcod=26'2)", 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.943804635999999, 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079552349999999997, 2024-04-26T07:48:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656373+0000", 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0430000000000002e-06 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656384+0000", 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1214e-05 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656410+0000", 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6553000000000001e-05 2024-04-26T07:48:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656424+0000", 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3057000000000001e-05 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656523+0000", 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9304999999999999e-05 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656559+0000", 2024-04-26T07:48:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6170000000000001e-05 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664230+0000", 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076710540000000001 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664326+0000", 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5839000000000002e-05 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.665207+0000", 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.934968171, 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003639406, 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 220 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665207+0000", 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665207+0000", 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665210+0000", 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6929999999999999e-06 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665222+0000", 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2653000000000001e-05 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665245+0000", 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2880000000000001e-05 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665261+0000", 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5415999999999999e-05 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665410+0000", 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928200000000001 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665621+0000", 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000211282 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.666051+0000", 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042919699999999998 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.667784+0000", 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017337120000000001 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.668655+0000", 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000870537 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.668742+0000", 2024-04-26T07:48:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7039000000000005e-05 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.668847+0000", 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104715 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.683713+0000", 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.916462451999999, 2024-04-26T07:48:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037153970000000001, 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 225 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683713+0000", 2024-04-26T07:48:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683713+0000", 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683715+0000", 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2199999999999999e-06 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683726+0000", 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1233000000000001e-05 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683757+0000", 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0939999999999999e-05 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683772+0000", 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5123000000000001e-05 2024-04-26T07:48:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683928+0000", 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000156076 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.684310+0000", 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038193400000000001 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.685077+0000", 2024-04-26T07:48:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00076641700000000003 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.686949+0000", 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018719539999999999 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687153+0000", 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020389900000000001 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687310+0000", 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015687200000000001 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687428+0000", 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011872899999999999 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.687747+0000", 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.912427928, 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003482078, 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 226 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687747+0000", 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687747+0000", 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687750+0000", 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3039999999999999e-06 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687761+0000", 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1229999999999999e-05 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687792+0000", 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1232000000000002e-05 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687810+0000", 2024-04-26T07:48:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7972999999999999e-05 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687942+0000", 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013216599999999999 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.688287+0000", 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00034429099999999999 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.688994+0000", 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00070756400000000004 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.690570+0000", 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015754569999999999 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.691079+0000", 2024-04-26T07:48:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050929899999999995 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.691164+0000", 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5595999999999998e-05 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.691229+0000", 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4966000000000001e-05 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:425 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.818743642999999, 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040099369999999999, 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 425 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781435+0000", 2024-04-26T07:48:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8600000000000001e-06 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781449+0000", 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4107000000000001e-05 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781487+0000", 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8819000000000002e-05 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781509+0000", 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1526e-05 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781619+0000", 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110401 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781905+0000", 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028538499999999998 2024-04-26T07:48:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782316+0000", 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041122499999999998 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.783564+0000", 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001248323 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785182+0000", 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016181259999999999 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785321+0000", 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013868600000000001 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785442+0000", 2024-04-26T07:48:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120479 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:426 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.818620834000001, 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042315030000000002, 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 426 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781556+0000", 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5400000000000001e-06 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781567+0000", 2024-04-26T07:48:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1177e-05 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781590+0000", 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2929e-05 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781606+0000", 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5670000000000001e-05 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781730+0000", 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012455800000000001 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782012+0000", 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028137700000000003 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782402+0000", 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039053999999999998 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785218+0000", 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028154040000000001 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785561+0000", 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00034358199999999999 2024-04-26T07:48:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785690+0000", 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012918700000000001 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785786+0000", 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5538999999999994e-05 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:434 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:48:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.813259374999999, 2024-04-26T07:48:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040682310000000003, 2024-04-26T07:48:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 434 2024-04-26T07:48:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786918+0000", 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.95e-06 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786928+0000", 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8369999999999992e-06 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786958+0000", 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0125999999999999e-05 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786970+0000", 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.206e-05 2024-04-26T07:48:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787094+0000", 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000124079 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787302+0000", 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208495 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787827+0000", 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00052492200000000004 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790649+0000", 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028216040000000001 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790750+0000", 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010141699999999999 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790885+0000", 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013442799999999999 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790984+0000", 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9313000000000003e-05 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.789017+0000", 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.811158111999999, 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034800130000000001, 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 436 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789017+0000", 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789017+0000", 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789019+0000", 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9700000000000002e-06 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789032+0000", 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2563e-05 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789064+0000", 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1785999999999997e-05 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789083+0000", 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9907000000000001e-05 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789223+0000", 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014004100000000001 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789533+0000", 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000309938 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789987+0000", 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045396400000000001 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791881+0000", 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001893434 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.792280+0000", 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039945200000000001 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.792421+0000", 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014080700000000001 2024-04-26T07:48:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.792497+0000", 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6150999999999996e-05 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:552 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.854424+0000", 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.745751396999999, 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037558829999999998, 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 552 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854424+0000", 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854424+0000", 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854426+0000", 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.503e-06 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854438+0000", 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1423000000000001e-05 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854469+0000", 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0673999999999998e-05 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854490+0000", 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1545000000000001e-05 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854586+0000", 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.577e-05 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854720+0000", 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013446199999999999 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855022+0000", 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030190799999999998 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.856264+0000", 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012421909999999999 2024-04-26T07:48:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857967+0000", 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017021269999999999 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.858101+0000", 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013485799999999999 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.858180+0000", 2024-04-26T07:48:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8422000000000002e-05 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:823 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.226780+0000", 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.373395616, 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00358077, 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 823 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226780+0000", 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226780+0000", 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226782+0000", 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.996e-06 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226791+0000", 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2969999999999992e-06 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226814+0000", 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3425999999999999e-05 2024-04-26T07:48:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226828+0000", 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3297e-05 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226898+0000", 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0209999999999994e-05 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227089+0000", 2024-04-26T07:48:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019073399999999999 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227402+0000", 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031311499999999999 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.228461+0000", 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001059001 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.230171+0000", 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001710453 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.230258+0000", 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7034999999999996e-05 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.230360+0000", 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102206 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.344777+0000", 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.255398077000001, 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037216839999999998, 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 874 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344777+0000", 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344777+0000", 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344779+0000", 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.193e-06 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344791+0000", 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1297e-05 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344821+0000", 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0726999999999999e-05 2024-04-26T07:48:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344836+0000", 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4863e-05 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344998+0000", 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161528 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.345415+0000", 2024-04-26T07:48:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041737000000000002 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.345979+0000", 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00056401599999999997 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.347316+0000", 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013365530000000001 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.348233+0000", 2024-04-26T07:48:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00091729599999999995 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.348389+0000", 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015637800000000001 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.348499+0000", 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010946300000000001 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.349978+0000", 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.250196839000001, 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031984539999999999, 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 876 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.349978+0000", 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.349978+0000", 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.349981+0000", 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2340000000000001e-06 2024-04-26T07:48:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.349992+0000", 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1206000000000001e-05 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350023+0000", 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0719999999999997e-05 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350040+0000", 2024-04-26T07:48:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.719e-05 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350174+0000", 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134416 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350407+0000", 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023308399999999999 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350874+0000", 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046675599999999997 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.351976+0000", 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011024209999999999 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.352914+0000", 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00093733900000000003 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.353064+0000", 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149729 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.353177+0000", 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113359 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:894 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.391788+0000", 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.208387559, 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037361270000000001, 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 894 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391788+0000", 2024-04-26T07:48:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391788+0000", 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391790+0000", 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3800000000000001e-06 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391802+0000", 2024-04-26T07:48:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1667e-05 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391833+0000", 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1032999999999999e-05 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391851+0000", 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8453000000000001e-05 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391943+0000", 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2003000000000007e-05 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392067+0000", 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123812 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392343+0000", 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027540799999999999 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.393470+0000", 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001127571 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395371+0000", 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019005840000000001 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395456+0000", 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5482000000000006e-05 2024-04-26T07:48:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395524+0000", 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7733999999999999e-05 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.528427+0000", 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.071748567, 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003418089, 2024-04-26T07:48:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 952 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528427+0000", 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528427+0000", 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528429+0000", 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2129999999999998e-06 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528440+0000", 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1223000000000001e-05 2024-04-26T07:48:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528471+0000", 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0607e-05 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528486+0000", 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5440000000000001e-05 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528626+0000", 2024-04-26T07:48:43.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139309 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528990+0000", 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036464000000000001 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.529572+0000", 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00058163500000000005 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.530835+0000", 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00126323 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.531694+0000", 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00085938599999999996 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.531779+0000", 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4509e-05 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.531845+0000", 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5896999999999996e-05 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:954 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.067240774, 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066500159999999999, 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:43.716 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 954 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:43.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532936+0000", 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3599999999999999e-06 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532943+0000", 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8369999999999999e-06 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532962+0000", 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.916e-05 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532976+0000", 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3703000000000001e-05 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533067+0000", 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1049000000000002e-05 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533213+0000", 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146236 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533543+0000", 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033018000000000001 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.534585+0000", 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010418879999999999 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539432+0000", 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048471809999999999 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539516+0000", 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4055999999999996e-05 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539585+0000", 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8366000000000002e-05 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.721 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.722 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.722 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:43.722 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:43.722 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:43.723 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:48:43.724 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:43.719+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:43.824 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:43.823+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:43.892 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:43.892 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:43.892 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:48:43.892 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:43.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:48:43.948 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:43.947+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:44.025 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:44.023+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:44.070 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:44.070 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:44.070 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:48:44.070 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:48:44.070 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:44.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:48:44.128 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:44.127+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:44.170 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T07:48:44.178 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:48:44.199 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T07:48:44.209 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:44.209 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:44.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:44.209 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:44.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.209 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:44.209 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.650902723, 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:48:44.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:48:44.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.216 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596391207936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.620565753999999, 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027719889999999999, 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 47 2024-04-26T07:48:44.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588084+0000", 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.243e-06 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588093+0000", 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6430000000000001e-06 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588113+0000", 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0051000000000002e-05 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588125+0000", 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2191000000000001e-05 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588218+0000", 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3253999999999999e-05 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588480+0000", 2024-04-26T07:48:44.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026131800000000002 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588685+0000", 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020556099999999999 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.589677+0000", 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0009915569999999999 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590602+0000", 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00092485600000000005 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590702+0000", 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100116 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590854+0000", 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000152199 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.222 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.603609358, 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024108010000000002, 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.223 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 54 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:44.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605040+0000", 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.818e-06 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605049+0000", 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7520000000000002e-06 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605072+0000", 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2787999999999999e-05 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605085+0000", 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3200000000000001e-05 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605179+0000", 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3969999999999996e-05 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605357+0000", 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178262 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605511+0000", 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153416 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.606471+0000", 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00096066599999999999 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607310+0000", 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00083910300000000001 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607369+0000", 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8854000000000003e-05 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607449+0000", 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9971999999999999e-05 2024-04-26T07:48:44.228 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596391203328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.600991263000001, 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0021617260000000001, 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 55 2024-04-26T07:48:44.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607658+0000", 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2300000000000001e-06 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607664+0000", 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.387e-06 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607681+0000", 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6796999999999999e-05 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607691+0000", 2024-04-26T07:48:44.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9129999999999998e-06 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607768+0000", 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7732999999999996e-05 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607873+0000", 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104372 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.608054+0000", 2024-04-26T07:48:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018165600000000001 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609112+0000", 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010570969999999999 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609666+0000", 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00055467500000000002 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609733+0000", 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6896999999999993e-05 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609818+0000", 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4969000000000006e-05 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:191 6.5 e26/23 6:a2ace8b3:::data_log.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:48:44.234 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.504189723, 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017875160000000001, 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704460+0000", 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7999999999999999e-06 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704471+0000", 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1446e-05 2024-04-26T07:48:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704502+0000", 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0800000000000003e-05 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704535+0000", 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2982999999999999e-05 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704667+0000", 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013210899999999999 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704717+0000", 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0355999999999997e-05 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.706111+0000", 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013940389999999999 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.706245+0000", 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013398300000000001 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.591782907000001, 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032337429999999999, 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616866+0000", 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.33e-07 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616878+0000", 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2193e-05 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616920+0000", 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2509999999999998e-05 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616942+0000", 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1990000000000001e-05 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.617092+0000", 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149636 2024-04-26T07:48:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.617140+0000", 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8322000000000003e-05 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.619973+0000", 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028324069999999999 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.620099+0000", 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125752 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:231 6.1f e29/23 6:fde4dd55:gc::gc.26:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.501401253000001, 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001768026, 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707247+0000", 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0399999999999996e-07 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707256+0000", 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4499999999999993e-06 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707294+0000", 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7576000000000001e-05 2024-04-26T07:48:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707319+0000", 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4865999999999999e-05 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707499+0000", 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000180469 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707534+0000", 2024-04-26T07:48:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4873000000000003e-05 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.708937+0000", 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001402312 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709014+0000", 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7875999999999998e-05 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:320 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.463902394, 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027437310000000001, 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744746+0000", 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6299999999999993e-07 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744760+0000", 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3893000000000001e-05 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744795+0000", 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4947000000000003e-05 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744817+0000", 2024-04-26T07:48:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1605999999999999e-05 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744963+0000", 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146205 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.745009+0000", 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6607000000000003e-05 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.747361+0000", 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002351414 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.747489+0000", 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012809599999999999 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:360 6.5 e29/23 6:a60f9269:lc::lua_package_allowlist:head v 29'2, mlcod=0'0)", 2024-04-26T07:48:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.456691019999999, 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018680750000000001, 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751958+0000", 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8330000000000001e-06 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751971+0000", 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2274e-05 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752013+0000", 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2281999999999999e-05 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752034+0000", 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0699999999999998e-05 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752254+0000", 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021995900000000001 2024-04-26T07:48:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752306+0000", 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2349000000000003e-05 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753718+0000", 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014118049999999999 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753825+0000", 2024-04-26T07:48:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106873 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:426 6.a e29/23 6:50d64734:::obj_delete_at_hint.0000000009:head v 29'2, mlcod=0'0)", 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.426077378, 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026612879999999999, 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782572+0000", 2024-04-26T07:48:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0200000000000001e-06 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782585+0000", 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2186e-05 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782609+0000", 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4335999999999999e-05 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782621+0000", 2024-04-26T07:48:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2217e-05 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782787+0000", 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016643199999999999 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782844+0000", 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6999000000000001e-05 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785144+0000", 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022998419999999999 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785232+0000", 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7256000000000006e-05 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:434 6.a e29/23 6:50d64734:::obj_delete_at_hint.0000000009:head v 29'3, mlcod=29'1)", 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.42061546, 2024-04-26T07:48:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018461549999999999, 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788034+0000", 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.114e-06 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788050+0000", 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5472999999999999e-05 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788089+0000", 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8748999999999998e-05 2024-04-26T07:48:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788110+0000", 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1457000000000001e-05 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788216+0000", 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106403 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788259+0000", 2024-04-26T07:48:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2517e-05 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789758+0000", 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014993369999999999 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789878+0000", 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120105 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:436 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'1)", 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.41841086, 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017544170000000001, 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790239+0000", 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790281+0000", 2024-04-26T07:48:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1689e-05 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790311+0000", 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0658999999999999e-05 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790331+0000", 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9935000000000001e-05 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790467+0000", 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135301 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790516+0000", 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9839000000000002e-05 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791891+0000", 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013743270000000001 2024-04-26T07:48:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791991+0000", 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010050700000000001 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:466 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'5, mlcod=29'3)", 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.403205454, 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001869601, 2024-04-26T07:48:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805444+0000", 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.486e-06 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805453+0000", 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9730000000000003e-06 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805474+0000", 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1254999999999999e-05 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805485+0000", 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0992000000000001e-05 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805605+0000", 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012044099999999999 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805659+0000", 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3721999999999998e-05 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.807238+0000", 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015787150000000001 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.807312+0000", 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4017000000000006e-05 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:484 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'11, mlcod=29'9)", 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.396040356, 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016497599999999999, 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812610+0000", 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.486e-06 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812625+0000", 2024-04-26T07:48:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5339999999999999e-05 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812707+0000", 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2158999999999997e-05 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812726+0000", 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8654000000000001e-05 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812939+0000", 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000213358 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812998+0000", 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8383e-05 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.814148+0000", 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011502750000000001 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.814257+0000", 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010910500000000001 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:552 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.353471902000001, 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025138949999999999, 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855177+0000", 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.654e-06 2024-04-26T07:48:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855191+0000", 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3719e-05 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855219+0000", 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.794e-05 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855234+0000", 2024-04-26T07:48:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5330999999999999e-05 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855366+0000", 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000131903 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855406+0000", 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9932999999999999e-05 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857619+0000", 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022126950000000002 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857690+0000", 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0720000000000001e-05 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:726 6.1e e29/23 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head v 29'4, mlcod=29'2)", 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.214941212999999, 2024-04-26T07:48:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037299329999999999, 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993708+0000", 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6869999999999999e-06 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993719+0000", 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0526000000000001e-05 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993742+0000", 2024-04-26T07:48:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.376e-05 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993762+0000", 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9706000000000001e-05 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993891+0000", 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012897900000000001 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993951+0000", 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9633999999999999e-05 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997363+0000", 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118550000000001 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997436+0000", 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3786000000000001e-05 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:816 6.1e e29/23 6:7a480f67:::obj_delete_at_hint.0000000079:head v 29'8, mlcod=29'6)", 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.000347652, 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003479055, 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208301+0000", 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.44e-06 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208319+0000", 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7482999999999998e-05 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208343+0000", 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4346999999999999e-05 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208357+0000", 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3256e-05 2024-04-26T07:48:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208465+0000", 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108063 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208497+0000", 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2008999999999998e-05 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.211707+0000", 2024-04-26T07:48:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032102440000000001 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.211779+0000", 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2212999999999995e-05 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:823 6.a e29/23 6:547b96f2:::obj_delete_at_hint.0000000082:head v 29'12, mlcod=29'10)", 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.981069956000001, 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023215279999999998, 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227580+0000", 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1270000000000001e-06 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227595+0000", 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5336999999999999e-05 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227632+0000", 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7196000000000001e-05 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227652+0000", 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9709999999999999e-05 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227759+0000", 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010668200000000001 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227805+0000", 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6165999999999998e-05 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.229812+0000", 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020074210000000001 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.229899+0000", 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6889000000000001e-05 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.816089741000001, 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025350059999999998, 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392560+0000", 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.72e-06 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392573+0000", 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3203e-05 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392600+0000", 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7393999999999999e-05 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392613+0000", 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3213e-05 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392743+0000", 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012966200000000001 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392780+0000", 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6678999999999999e-05 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395019+0000", 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022392459999999999 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395093+0000", 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3888999999999997e-05 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:954 6.a e29/23 6:541d369a:::obj_delete_at_hint.0000000125:head v 29'19, mlcod=29'17)", 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.674956649, 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054590150000000002, 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533693+0000", 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.623e-06 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533703+0000", 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0307e-05 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533730+0000", 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6686000000000002e-05 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533743+0000", 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3746e-05 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533875+0000", 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013116899999999999 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533929+0000", 2024-04-26T07:48:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4617000000000002e-05 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539030+0000", 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051009879999999999 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539150+0000", 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119879 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.307 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:44.308 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:44.307+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:44.309 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:48:44.409 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:44.407+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:44.478 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:44.478 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:44.478 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:48:44.478 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:44.492 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:48:44.510 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:44.511+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:44.611 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:44.607+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:44.659 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:48:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:48:44.659 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:44.674 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:48:44.711 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:44.711+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:44.813 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:44.815+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.384940802999999, 2024-04-26T07:48:44.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:48:44.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:48:44.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.851 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.279152292999999, 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01016414, 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.852 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 36 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562284+0000", 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.976e-06 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562295+0000", 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0563e-05 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562317+0000", 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2160000000000001e-05 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568856+0000", 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065391340000000003 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568996+0000", 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013974500000000001 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.569185+0000", 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018917599999999999 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570452+0000", 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012671259999999999 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572276+0000", 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018236579999999999 2024-04-26T07:48:44.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572374+0000", 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8179999999999999e-05 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572442+0000", 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7651999999999995e-05 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.279097196999999, 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010242279999999999, 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 37 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.858 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7599999999999997e-07 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562340+0000", 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2639999999999997e-06 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562353+0000", 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3953e-05 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562364+0000", 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0023e-05 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570502+0000", 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081387839999999996 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570636+0000", 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133929 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570841+0000", 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020473799999999999 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572179+0000", 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001338136 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572455+0000", 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027610500000000001 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572525+0000", 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9442000000000004e-05 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572575+0000", 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0229999999999998e-05 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:84 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.187546784999999, 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010516041, 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.863 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 84 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653884+0000", 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9299999999999997e-07 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653990+0000", 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010574 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654007+0000", 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7255999999999999e-05 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654016+0000", 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0229999999999998e-06 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.656818+0000", 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028019609999999999 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657052+0000", 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023420799999999999 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657457+0000", 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000404516 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.660887+0000", 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034301549999999998 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664252+0000", 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033656070000000001 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664328+0000", 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6216000000000003e-05 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664399+0000", 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0566000000000002e-05 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:44.868 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.187396806999999, 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010767923, 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 85 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654034+0000", 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654040+0000", 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8300000000000001e-06 2024-04-26T07:48:44.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654051+0000", 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0994e-05 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654059+0000", 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2400000000000007e-06 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659335+0000", 2024-04-26T07:48:44.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052755730000000004 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659564+0000", 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022912799999999999 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659947+0000", 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000383204 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664531+0000", 2024-04-26T07:48:44.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045834930000000001 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664678+0000", 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014781899999999999 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664748+0000", 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0088999999999999e-05 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664801+0000", 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2463000000000002e-05 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.873 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.187357293000002, 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010852031999999999, 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.874 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 86 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654090+0000", 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.649e-05 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654101+0000", 2024-04-26T07:48:44.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1216000000000001e-05 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654109+0000", 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9670000000000001e-06 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661156+0000", 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007047022 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661408+0000", 2024-04-26T07:48:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025155499999999999 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661801+0000", 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039353700000000001 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664660+0000", 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028584499999999998 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664815+0000", 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015576899999999999 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664877+0000", 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1259000000000004e-05 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664925+0000", 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7997000000000001e-05 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.879 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.187306670000002, 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01259659, 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 87 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.880 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654124+0000", 2024-04-26T07:48:44.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4300000000000002e-07 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654222+0000", 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7719000000000004e-05 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654234+0000", 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2604e-05 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654243+0000", 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5459999999999992e-06 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662707+0000", 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084641609999999996 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662839+0000", 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132125 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.663062+0000", 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000223136 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666539+0000", 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034766480000000002 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666567+0000", 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8070000000000001e-05 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666651+0000", 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3856000000000005e-05 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666720+0000", 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8981999999999998e-05 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.187170895000001, 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013093877, 2024-04-26T07:48:44.885 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 88 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654260+0000", 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6000000000000002e-07 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654265+0000", 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4569999999999996e-06 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654278+0000", 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2948999999999999e-05 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654286+0000", 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9200000000000004e-06 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665027+0000", 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010741297 2024-04-26T07:48:44.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665256+0000", 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000228528 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665645+0000", 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038947299999999999 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666936+0000", 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012903260000000001 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667178+0000", 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024258799999999999 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667271+0000", 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2637000000000001e-05 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667353+0000", 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1841999999999993e-05 2024-04-26T07:48:44.890 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.100563509000001, 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011699831000000001, 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.891 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 106 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740867+0000", 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740954+0000", 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6539000000000006e-05 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740976+0000", 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1616000000000001e-05 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740986+0000", 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0210000000000001e-05 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.743957+0000", 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029711820000000002 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744188+0000", 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023153799999999999 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744602+0000", 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041389699999999998 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746647+0000", 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020443940000000002 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752403+0000", 2024-04-26T07:48:44.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00575583 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752495+0000", 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2205000000000002e-05 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752566+0000", 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1329999999999996e-05 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.100424023999999, 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011999419000000001, 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 107 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741007+0000", 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6300000000000004e-07 2024-04-26T07:48:44.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741013+0000", 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0430000000000004e-06 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741024+0000", 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1219999999999999e-05 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741032+0000", 2024-04-26T07:48:44.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0129999999999993e-06 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746964+0000", 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059325890000000003 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747200+0000", 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023506800000000001 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747570+0000", 2024-04-26T07:48:44.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037041400000000001 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752381+0000", 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048112110000000001 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752882+0000", 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050076899999999998 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752951+0000", 2024-04-26T07:48:44.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8639000000000005e-05 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753005+0000", 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4589999999999997e-05 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.902 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.100376381, 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012200701, 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 108 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:44.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741054+0000", 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8299999999999996e-07 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741059+0000", 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2270000000000001e-06 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741072+0000", 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3076e-05 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741081+0000", 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6600000000000001e-06 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748524+0000", 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074427199999999999 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748761+0000", 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023694499999999999 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.749207+0000", 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044570900000000002 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752705+0000", 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034982049999999999 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753019+0000", 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031469100000000003 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753143+0000", 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123919 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753254+0000", 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110766 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.100326745, 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01715328, 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.908 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 109 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741104+0000", 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6400000000000001e-07 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741233+0000", 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129429 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741254+0000", 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0665999999999998e-05 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741264+0000", 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0216e-05 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750196+0000", 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089322310000000005 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750436+0000", 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023930499999999999 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750837+0000", 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040168400000000003 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752861+0000", 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002024086 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758087+0000", 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052259369999999999 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758165+0000", 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7906999999999998e-05 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758256+0000", 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1055000000000001e-05 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.100147570000001, 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017458564999999999, 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 110 2024-04-26T07:48:44.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741283+0000", 2024-04-26T07:48:44.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8299999999999995e-07 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741289+0000", 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7799999999999997e-06 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741302+0000", 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.296e-05 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741310+0000", 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4400000000000005e-06 2024-04-26T07:48:44.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753384+0000", 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012073709 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753620+0000", 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023612500000000001 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754000+0000", 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037985699999999999 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758415+0000", 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044144839999999998 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758560+0000", 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014554100000000001 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758676+0000", 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115906 2024-04-26T07:48:44.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758741+0000", 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.478e-05 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.100106406999998, 2024-04-26T07:48:44.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017565926999999999, 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 111 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.920 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741324+0000", 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741330+0000", 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5899999999999998e-06 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741359+0000", 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.976e-05 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741368+0000", 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4630000000000001e-06 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754914+0000", 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01354584 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755155+0000", 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024081800000000001 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755512+0000", 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035783000000000001 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758539+0000", 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030268529999999999 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758765+0000", 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022618399999999999 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758839+0000", 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3056e-05 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758889+0000", 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0813000000000003e-05 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.100046891000002, 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018715345000000001, 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 112 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741384+0000", 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1399999999999996e-07 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741484+0000", 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010031600000000001 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741497+0000", 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3413e-05 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741506+0000", 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8359999999999998e-06 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756372+0000", 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014865405999999999 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756614+0000", 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024270499999999999 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.757084+0000", 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000469946 2024-04-26T07:48:44.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759020+0000", 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019354979999999999 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759964+0000", 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000944195 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760039+0000", 2024-04-26T07:48:44.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5543000000000005e-05 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760098+0000", 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8773000000000001e-05 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.099907091999999, 2024-04-26T07:48:44.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:48:44.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:48:44.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.099868259000001, 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:48:44.936 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:48:44.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:48:44.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.099830228999998, 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.942 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:48:44.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:48:44.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.099708675999999, 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.948 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:44.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:48:44.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.099668706999999, 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:44.954 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:44.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:48:44.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:48:44.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:48:44.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:44.959 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:44.960 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:44.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:48:44.962 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:44.963+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:45.062 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:45.063+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:45.080 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:45.080 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:45.080 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:45.080 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:45.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:48:45.163 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:45.159+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:45.172 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T07:48:45.199 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T07:48:45.267 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:45.267 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:45.267 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:48:45.267 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:48:45.267 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:45.267 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:45.267+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:45.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:48:45.372 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:45.375+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:45.452 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 15.844546228, 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.461 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:45.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:48:45.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.466 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.856639131, 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:48:45.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:48:45.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:48:45.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:45.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.472 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.837277485, 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:48:45.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:48:45.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.807149054, 2024-04-26T07:48:45.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:48:45.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:48:45.483 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.785730958, 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.484 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:45.489 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.755731589, 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:45.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:48:45.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.737132336, 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.495 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:48:45.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:48:45.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.719149548000001, 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.501 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.687325154, 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:48:45.506 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:45.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:48:45.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:48:45.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:48:45.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.635470739000001, 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.512 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:48:45.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:48:45.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.517 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.626635433000001, 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:48:45.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.577622116000001, 2024-04-26T07:48:45.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.528 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:600 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.57423923, 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002431356, 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 600 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9299999999999996e-07 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886663+0000", 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1590000000000003e-06 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886672+0000", 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0739999999999999e-06 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886677+0000", 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.04e-06 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887171+0000", 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00049419000000000004 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887299+0000", 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012773799999999999 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887554+0000", 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025523100000000002 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888312+0000", 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00075773799999999999 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888986+0000", 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00067451800000000004 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889055+0000", 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9109000000000005e-05 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889089+0000", 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3665999999999999e-05 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.523200214999999, 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.534 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:45.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:48:45.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.538 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.319470954, 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.540 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:48:45.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:45.545 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.315573802999999, 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:48:45.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:48:45.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:45.551 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.261529622999999, 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:48:45.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:48:45.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.257403462999999, 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:48:45.557 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.562 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.077209338999999, 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:48:45.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:48:45.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:48:45.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.073560219000001, 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:45.568 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:45.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:45.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:45.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:45.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:45.573 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:45.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:48:45.575 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:45.571+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:45.592 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:45.593 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:45.610 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:45.611 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:45.629 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:45.648 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:45.670 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:45.670 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:45.675 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:45.675+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:45.691 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:45.691 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:45.710 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:45.711 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:45.712 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:45.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:48:45.733 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:45.796 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:45.799+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:45.858 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:45.858 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:45.872 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:48:45.877 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:45.875+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:45.979 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:45.979+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:46.042 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:46.042 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:46.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:48:46.080 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:46.079+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:46.180 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:46.183+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T07:48:46.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:48:46.210 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T07:48:46.248 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:46.248 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:46.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:48:46.282 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:46.279+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:46.382 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:46.383+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:46.430 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:46.430 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:46.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:48:46.488 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:46.491+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:46.585 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:46.583+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:46.601 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:46.601 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:46.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:48:46.686 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:46.687+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:46.723 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:46.723 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:46.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:48:46.787 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:46.783+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:46.888 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:46.891+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:46.896 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:46.896 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:46.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:48:46.996 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:46.999+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:47.069 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:47.069 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:47.083 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:48:47.125 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:47.127+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:47.190 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:47.191+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:47.209 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:48:47.213 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T07:48:47.216 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:47.216 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:47.231 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:48:47.233 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T07:48:47.291 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:47.287+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:47.356 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:47.356 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:47.370 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:48:47.412 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:47.411+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:47.492 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:47.491+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:47.535 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:47.535 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:47.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:48:47.596 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:47.595+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:47.694 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:47.691+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:47.718 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:47.719 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:47.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:48:47.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:48:47.820 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:47.819+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:47.896 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:47.895+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:47.898 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:47.898 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:47.910 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:47.910 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:47.912 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:48:47.927 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:47.928 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:47.960 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:47.960 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:47.977 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:47.978 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:47.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:47.997 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:47.997 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:47.999+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:48.015 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:48.015 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:48.034 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:48.035 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:48.059 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:48.059 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4449.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:25.604098+0000", 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.476899490000001, 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031839630000000002, 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.084 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4449", 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 37 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604098+0000", 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604098+0000", 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604100+0000", 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.903e-06 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604111+0000", 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1202999999999999e-05 2024-04-26T07:48:48.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604134+0000", 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3366e-05 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604148+0000", 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3613e-05 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604294+0000", 2024-04-26T07:48:48.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014655500000000001 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604586+0000", 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029125800000000002 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.604872+0000", 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028644899999999998 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.606301+0000", 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014285210000000001 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.607107+0000", 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00080672299999999997 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.607212+0000", 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105009 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.607282+0000", 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9363000000000007e-05 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4449.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:25.614143+0000", 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.466854391999998, 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003289003, 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.090 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4449", 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 41 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614143+0000", 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614143+0000", 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614145+0000", 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2560000000000001e-06 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614158+0000", 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2456999999999999e-05 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614188+0000", 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.044e-05 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614203+0000", 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4596999999999999e-05 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614358+0000", 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015504900000000001 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.614715+0000", 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035756600000000003 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.615171+0000", 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045563599999999999 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.616485+0000", 2024-04-26T07:48:48.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001314426 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.617199+0000", 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00071386799999999999 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.617292+0000", 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2598999999999999e-05 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:25.617432+0000", 2024-04-26T07:48:48.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000140109 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596391209088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.489245897, 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006394205, 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.096 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 49 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591754+0000", 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.103e-06 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591762+0000", 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509999999999995e-06 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591791+0000", 2024-04-26T07:48:48.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8668999999999999e-05 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591806+0000", 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5051e-05 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591925+0000", 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119163 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592111+0000", 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000185694 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592438+0000", 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032695800000000002 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.593651+0000", 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012125320000000001 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.597931+0000", 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042799709999999996 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598007+0000", 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6389000000000003e-05 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598146+0000", 2024-04-26T07:48:48.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013872400000000001 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.600706+0000", 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.480291022999999, 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0036210349999999999, 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600706+0000", 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600706+0000", 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600707+0000", 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.37e-07 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600714+0000", 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8349999999999998e-06 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600737+0000", 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2972999999999998e-05 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600748+0000", 2024-04-26T07:48:48.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1114999999999999e-05 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600848+0000", 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100511 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.600882+0000", 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3136999999999998e-05 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.604235+0000", 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033532480000000001 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.604327+0000", 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2578999999999996e-05 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:48:48.106 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.483464146999999, 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037973019999999998, 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 205 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597536+0000", 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3000000000000002e-06 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597551+0000", 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4932999999999999e-05 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597589+0000", 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7137e-05 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597607+0000", 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8913e-05 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597788+0000", 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018071499999999999 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.598155+0000", 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036658699999999998 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.598898+0000", 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00074370700000000003 2024-04-26T07:48:48.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.600857+0000", 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001958441 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601163+0000", 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030609799999999998 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601253+0000", 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509e-05 2024-04-26T07:48:48.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601330+0000", 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7961999999999997e-05 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:219 6.4 e29/23 6:227f63b5:gc::gc.14:head v 29'4, mlcod=26'2)", 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.424626655000001, 2024-04-26T07:48:48.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079552349999999997, 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656373+0000", 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0430000000000002e-06 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656384+0000", 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1214e-05 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656410+0000", 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6553000000000001e-05 2024-04-26T07:48:48.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656424+0000", 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3057000000000001e-05 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656523+0000", 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9304999999999999e-05 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656559+0000", 2024-04-26T07:48:48.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6170000000000001e-05 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664230+0000", 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076710540000000001 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664326+0000", 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5839000000000002e-05 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.665207+0000", 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.415790189999999, 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003639406, 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 220 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.117 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665207+0000", 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665207+0000", 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665210+0000", 2024-04-26T07:48:48.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6929999999999999e-06 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665222+0000", 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2653000000000001e-05 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665245+0000", 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2880000000000001e-05 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665261+0000", 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5415999999999999e-05 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665410+0000", 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928200000000001 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.665621+0000", 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000211282 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.666051+0000", 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042919699999999998 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.667784+0000", 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017337120000000001 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.668655+0000", 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000870537 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.668742+0000", 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7039000000000005e-05 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.668847+0000", 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104715 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.683713+0000", 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.397284471000001, 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037153970000000001, 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 225 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683713+0000", 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683713+0000", 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683715+0000", 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2199999999999999e-06 2024-04-26T07:48:48.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683726+0000", 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1233000000000001e-05 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683757+0000", 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0939999999999999e-05 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683772+0000", 2024-04-26T07:48:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5123000000000001e-05 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.683928+0000", 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000156076 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.684310+0000", 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038193400000000001 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.685077+0000", 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00076641700000000003 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.686949+0000", 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018719539999999999 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687153+0000", 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020389900000000001 2024-04-26T07:48:48.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687310+0000", 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015687200000000001 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687428+0000", 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011872899999999999 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.687747+0000", 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.393249946999999, 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003482078, 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 226 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687747+0000", 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687747+0000", 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687750+0000", 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3039999999999999e-06 2024-04-26T07:48:48.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687761+0000", 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1229999999999999e-05 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687792+0000", 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1232000000000002e-05 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687810+0000", 2024-04-26T07:48:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7972999999999999e-05 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.687942+0000", 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013216599999999999 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.688287+0000", 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00034429099999999999 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.688994+0000", 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00070756400000000004 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.690570+0000", 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015754569999999999 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.691079+0000", 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050929899999999995 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.691164+0000", 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5595999999999998e-05 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.691229+0000", 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4966000000000001e-05 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:425 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.134 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.299565661999999, 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040099369999999999, 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 425 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:48:48.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781435+0000", 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8600000000000001e-06 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781449+0000", 2024-04-26T07:48:48.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4107000000000001e-05 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781487+0000", 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8819000000000002e-05 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781509+0000", 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1526e-05 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781619+0000", 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110401 2024-04-26T07:48:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781905+0000", 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028538499999999998 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782316+0000", 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041122499999999998 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.783564+0000", 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001248323 2024-04-26T07:48:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785182+0000", 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016181259999999999 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785321+0000", 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013868600000000001 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785442+0000", 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120479 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.139 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:426 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.299442853, 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042315030000000002, 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.140 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 426 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781556+0000", 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5400000000000001e-06 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781567+0000", 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1177e-05 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781590+0000", 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2929e-05 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781606+0000", 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5670000000000001e-05 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781730+0000", 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012455800000000001 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782012+0000", 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028137700000000003 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782402+0000", 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039053999999999998 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785218+0000", 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028154040000000001 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785561+0000", 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00034358199999999999 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785690+0000", 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012918700000000001 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785786+0000", 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5538999999999994e-05 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:434 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:48:48.145 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.294081393999999, 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040682310000000003, 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 434 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786918+0000", 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.95e-06 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786928+0000", 2024-04-26T07:48:48.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8369999999999992e-06 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786958+0000", 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0125999999999999e-05 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786970+0000", 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.206e-05 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787094+0000", 2024-04-26T07:48:48.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000124079 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787302+0000", 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208495 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787827+0000", 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00052492200000000004 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790649+0000", 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028216040000000001 2024-04-26T07:48:48.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790750+0000", 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010141699999999999 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790885+0000", 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013442799999999999 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790984+0000", 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9313000000000003e-05 2024-04-26T07:48:48.150 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.789017+0000", 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.291980131000001, 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034800130000000001, 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.151 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 436 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789017+0000", 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789017+0000", 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789019+0000", 2024-04-26T07:48:48.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9700000000000002e-06 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789032+0000", 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2563e-05 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789064+0000", 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1785999999999997e-05 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789083+0000", 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9907000000000001e-05 2024-04-26T07:48:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789223+0000", 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014004100000000001 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789533+0000", 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000309938 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789987+0000", 2024-04-26T07:48:48.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045396400000000001 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791881+0000", 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001893434 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.792280+0000", 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039945200000000001 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.792421+0000", 2024-04-26T07:48:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014080700000000001 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.792497+0000", 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6150999999999996e-05 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:552 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.854424+0000", 2024-04-26T07:48:48.156 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.226573416000001, 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037558829999999998, 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 552 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854424+0000", 2024-04-26T07:48:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854424+0000", 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854426+0000", 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.503e-06 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854438+0000", 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1423000000000001e-05 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854469+0000", 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0673999999999998e-05 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854490+0000", 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1545000000000001e-05 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854586+0000", 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.577e-05 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.854720+0000", 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013446199999999999 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855022+0000", 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030190799999999998 2024-04-26T07:48:48.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.856264+0000", 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012421909999999999 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857967+0000", 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017021269999999999 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.858101+0000", 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013485799999999999 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.858180+0000", 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8422000000000002e-05 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:823 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.226780+0000", 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.854217634999999, 2024-04-26T07:48:48.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00358077, 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 823 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226780+0000", 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226780+0000", 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226782+0000", 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.996e-06 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226791+0000", 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2969999999999992e-06 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226814+0000", 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3425999999999999e-05 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226828+0000", 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3297e-05 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.226898+0000", 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0209999999999994e-05 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227089+0000", 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019073399999999999 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227402+0000", 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031311499999999999 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.228461+0000", 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001059001 2024-04-26T07:48:48.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.230171+0000", 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001710453 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.230258+0000", 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7034999999999996e-05 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.230360+0000", 2024-04-26T07:48:48.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102206 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.344777+0000", 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.736220096, 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037216839999999998, 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.168 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 874 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344777+0000", 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344777+0000", 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344779+0000", 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.193e-06 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344791+0000", 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1297e-05 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344821+0000", 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0726999999999999e-05 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344836+0000", 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4863e-05 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.344998+0000", 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161528 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.345415+0000", 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041737000000000002 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:48.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.345979+0000", 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00056401599999999997 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.347316+0000", 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013365530000000001 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.348233+0000", 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00091729599999999995 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.348389+0000", 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015637800000000001 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.348499+0000", 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010946300000000001 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.349978+0000", 2024-04-26T07:48:48.173 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.731018858000001, 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031984539999999999, 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 876 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.349978+0000", 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.349978+0000", 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.349981+0000", 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2340000000000001e-06 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.349992+0000", 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1206000000000001e-05 2024-04-26T07:48:48.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350023+0000", 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0719999999999997e-05 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350040+0000", 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.719e-05 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350174+0000", 2024-04-26T07:48:48.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134416 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350407+0000", 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023308399999999999 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.350874+0000", 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046675599999999997 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.351976+0000", 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011024209999999999 2024-04-26T07:48:48.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.352914+0000", 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00093733900000000003 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.353064+0000", 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149729 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.353177+0000", 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113359 2024-04-26T07:48:48.178 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:894 6.a 6:575f3851:::obj_delete_at_hint.0000000105:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.391788+0000", 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.689209578, 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037361270000000001, 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 894 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391788+0000", 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391788+0000", 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391790+0000", 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3800000000000001e-06 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391802+0000", 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1667e-05 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391833+0000", 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1032999999999999e-05 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391851+0000", 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8453000000000001e-05 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.391943+0000", 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2003000000000007e-05 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392067+0000", 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123812 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392343+0000", 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027540799999999999 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.393470+0000", 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001127571 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395371+0000", 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019005840000000001 2024-04-26T07:48:48.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395456+0000", 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5482000000000006e-05 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395524+0000", 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7733999999999999e-05 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.528427+0000", 2024-04-26T07:48:48.184 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.552570586, 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003418089, 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 952 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528427+0000", 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528427+0000", 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528429+0000", 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2129999999999998e-06 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528440+0000", 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1223000000000001e-05 2024-04-26T07:48:48.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528471+0000", 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0607e-05 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528486+0000", 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5440000000000001e-05 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528626+0000", 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139309 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.528990+0000", 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036464000000000001 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.529572+0000", 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00058163500000000005 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.530835+0000", 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00126323 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.531694+0000", 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00085938599999999996 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.531779+0000", 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4509e-05 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.531845+0000", 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5896999999999996e-05 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.189 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:954 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.548062793, 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066500159999999999, 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 954 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532936+0000", 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3599999999999999e-06 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532943+0000", 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8369999999999999e-06 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532962+0000", 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.916e-05 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532976+0000", 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3703000000000001e-05 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533067+0000", 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1049000000000002e-05 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533213+0000", 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146236 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533543+0000", 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033018000000000001 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.534585+0000", 2024-04-26T07:48:48.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010418879999999999 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539432+0000", 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048471809999999999 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539516+0000", 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4055999999999996e-05 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539585+0000", 2024-04-26T07:48:48.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8366000000000002e-05 2024-04-26T07:48:48.195 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.195 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.195 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.195 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.195 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.195 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:48.196 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:48:48.197 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:48.199+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T07:48:48.242 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T07:48:48.324 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:48.324 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:48.324 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:48:48.324 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:48.328 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:48.331+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:48.338 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:48:48.398 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:48.399+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:48.456 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:48.456 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:48.457 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:48:48.457 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:48:48.457 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:48.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:48:48.498 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:48.499+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:48.597 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.037544425, 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:48:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:48:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:48:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:48:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596391207936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.007207456, 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027719889999999999, 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 47 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588084+0000", 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.243e-06 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588093+0000", 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6430000000000001e-06 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588113+0000", 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0051000000000002e-05 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588125+0000", 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2191000000000001e-05 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588218+0000", 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3253999999999999e-05 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588480+0000", 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026131800000000002 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588685+0000", 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020556099999999999 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.589677+0000", 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0009915569999999999 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590602+0000", 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00092485600000000005 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590702+0000", 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100116 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590854+0000", 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000152199 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.990251059999999, 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024108010000000002, 2024-04-26T07:48:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 54 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605040+0000", 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.818e-06 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605049+0000", 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7520000000000002e-06 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605072+0000", 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2787999999999999e-05 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605085+0000", 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3200000000000001e-05 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605179+0000", 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3969999999999996e-05 2024-04-26T07:48:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605357+0000", 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178262 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605511+0000", 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153416 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.606471+0000", 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00096066599999999999 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607310+0000", 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00083910300000000001 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607369+0000", 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8854000000000003e-05 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607449+0000", 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9971999999999999e-05 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596391203328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.987632965, 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0021617260000000001, 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 55 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607658+0000", 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2300000000000001e-06 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607664+0000", 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.387e-06 2024-04-26T07:48:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607681+0000", 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6796999999999999e-05 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607691+0000", 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9129999999999998e-06 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607768+0000", 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7732999999999996e-05 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607873+0000", 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104372 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.608054+0000", 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018165600000000001 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609112+0000", 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010570969999999999 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609666+0000", 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00055467500000000002 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609733+0000", 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6896999999999993e-05 2024-04-26T07:48:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609818+0000", 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4969000000000006e-05 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:191 6.5 e26/23 6:a2ace8b3:::data_log.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.890831425000002, 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017875160000000001, 2024-04-26T07:48:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704460+0000", 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7999999999999999e-06 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704471+0000", 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1446e-05 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704502+0000", 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0800000000000003e-05 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704535+0000", 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2982999999999999e-05 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704667+0000", 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013210899999999999 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704717+0000", 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0355999999999997e-05 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.706111+0000", 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013940389999999999 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.706245+0000", 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013398300000000001 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.978424608999999, 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032337429999999999, 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616866+0000", 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.33e-07 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616878+0000", 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2193e-05 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616920+0000", 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2509999999999998e-05 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616942+0000", 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1990000000000001e-05 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.617092+0000", 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149636 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.617140+0000", 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8322000000000003e-05 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.619973+0000", 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028324069999999999 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.620099+0000", 2024-04-26T07:48:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125752 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:231 6.1f e29/23 6:fde4dd55:gc::gc.26:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.888042955, 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001768026, 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707247+0000", 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0399999999999996e-07 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707256+0000", 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4499999999999993e-06 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707294+0000", 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7576000000000001e-05 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707319+0000", 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4865999999999999e-05 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707499+0000", 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000180469 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707534+0000", 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4873000000000003e-05 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.708937+0000", 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001402312 2024-04-26T07:48:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709014+0000", 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7875999999999998e-05 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:320 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.850544096, 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027437310000000001, 2024-04-26T07:48:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744746+0000", 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6299999999999993e-07 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744760+0000", 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3893000000000001e-05 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744795+0000", 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4947000000000003e-05 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744817+0000", 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1605999999999999e-05 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744963+0000", 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146205 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.745009+0000", 2024-04-26T07:48:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6607000000000003e-05 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.747361+0000", 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002351414 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.747489+0000", 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012809599999999999 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:360 6.5 e29/23 6:a60f9269:lc::lua_package_allowlist:head v 29'2, mlcod=0'0)", 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.843332722, 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018680750000000001, 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751958+0000", 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8330000000000001e-06 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751971+0000", 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2274e-05 2024-04-26T07:48:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752013+0000", 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2281999999999999e-05 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752034+0000", 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0699999999999998e-05 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752254+0000", 2024-04-26T07:48:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021995900000000001 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752306+0000", 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2349000000000003e-05 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753718+0000", 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014118049999999999 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753825+0000", 2024-04-26T07:48:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106873 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:426 6.a e29/23 6:50d64734:::obj_delete_at_hint.0000000009:head v 29'2, mlcod=0'0)", 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.812719080000001, 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026612879999999999, 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782572+0000", 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0200000000000001e-06 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782585+0000", 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2186e-05 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782609+0000", 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4335999999999999e-05 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782621+0000", 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2217e-05 2024-04-26T07:48:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782787+0000", 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016643199999999999 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782844+0000", 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6999000000000001e-05 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785144+0000", 2024-04-26T07:48:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022998419999999999 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785232+0000", 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7256000000000006e-05 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:434 6.a e29/23 6:50d64734:::obj_delete_at_hint.0000000009:head v 29'3, mlcod=29'1)", 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.807257161999999, 2024-04-26T07:48:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018461549999999999, 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788034+0000", 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.114e-06 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788050+0000", 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5472999999999999e-05 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788089+0000", 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8748999999999998e-05 2024-04-26T07:48:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788110+0000", 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1457000000000001e-05 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788216+0000", 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106403 2024-04-26T07:48:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788259+0000", 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2517e-05 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789758+0000", 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014993369999999999 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789878+0000", 2024-04-26T07:48:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120105 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:436 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'1)", 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.805052562, 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017544170000000001, 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790239+0000", 2024-04-26T07:48:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790281+0000", 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1689e-05 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790311+0000", 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0658999999999999e-05 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790331+0000", 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9935000000000001e-05 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790467+0000", 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135301 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790516+0000", 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9839000000000002e-05 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791891+0000", 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013743270000000001 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791991+0000", 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010050700000000001 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:466 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'5, mlcod=29'3)", 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.789847156, 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001869601, 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805444+0000", 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.486e-06 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805453+0000", 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9730000000000003e-06 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805474+0000", 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1254999999999999e-05 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805485+0000", 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0992000000000001e-05 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805605+0000", 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012044099999999999 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805659+0000", 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3721999999999998e-05 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.807238+0000", 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015787150000000001 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.807312+0000", 2024-04-26T07:48:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4017000000000006e-05 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:484 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'11, mlcod=29'9)", 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.782682058000001, 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016497599999999999, 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812610+0000", 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.486e-06 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812625+0000", 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5339999999999999e-05 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812707+0000", 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2158999999999997e-05 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812726+0000", 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8654000000000001e-05 2024-04-26T07:48:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812939+0000", 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000213358 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812998+0000", 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8383e-05 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.814148+0000", 2024-04-26T07:48:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011502750000000001 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.814257+0000", 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010910500000000001 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:552 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.740113603999999, 2024-04-26T07:48:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025138949999999999, 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855177+0000", 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.654e-06 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855191+0000", 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3719e-05 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855219+0000", 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.794e-05 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855234+0000", 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5330999999999999e-05 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855366+0000", 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000131903 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855406+0000", 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9932999999999999e-05 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857619+0000", 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022126950000000002 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857690+0000", 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0720000000000001e-05 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:726 6.1e e29/23 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head v 29'4, mlcod=29'2)", 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.601582915, 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037299329999999999, 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993708+0000", 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6869999999999999e-06 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993719+0000", 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0526000000000001e-05 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993742+0000", 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.376e-05 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993762+0000", 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9706000000000001e-05 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993891+0000", 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012897900000000001 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993951+0000", 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9633999999999999e-05 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997363+0000", 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118550000000001 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997436+0000", 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3786000000000001e-05 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:816 6.1e e29/23 6:7a480f67:::obj_delete_at_hint.0000000079:head v 29'8, mlcod=29'6)", 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.386989354000001, 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003479055, 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208301+0000", 2024-04-26T07:48:48.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.44e-06 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208319+0000", 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7482999999999998e-05 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208343+0000", 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4346999999999999e-05 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208357+0000", 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3256e-05 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208465+0000", 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108063 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208497+0000", 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2008999999999998e-05 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.211707+0000", 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032102440000000001 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.211779+0000", 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2212999999999995e-05 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:823 6.a e29/23 6:547b96f2:::obj_delete_at_hint.0000000082:head v 29'12, mlcod=29'10)", 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:48.680 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.367711657999999, 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023215279999999998, 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227580+0000", 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1270000000000001e-06 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227595+0000", 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5336999999999999e-05 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227632+0000", 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7196000000000001e-05 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227652+0000", 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9709999999999999e-05 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227759+0000", 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010668200000000001 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227805+0000", 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6165999999999998e-05 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.229812+0000", 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020074210000000001 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.229899+0000", 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6889000000000001e-05 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.684 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.202731442999999, 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025350059999999998, 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392560+0000", 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.72e-06 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392573+0000", 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3203e-05 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392600+0000", 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7393999999999999e-05 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392613+0000", 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3213e-05 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392743+0000", 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012966200000000001 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392780+0000", 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6678999999999999e-05 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395019+0000", 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022392459999999999 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395093+0000", 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3888999999999997e-05 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:954 6.a e29/23 6:541d369a:::obj_delete_at_hint.0000000125:head v 29'19, mlcod=29'17)", 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.061598351000001, 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054590150000000002, 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:48.689 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:48.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533693+0000", 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.623e-06 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533703+0000", 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0307e-05 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533730+0000", 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6686000000000002e-05 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533743+0000", 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3746e-05 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533875+0000", 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013116899999999999 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:48.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533929+0000", 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4617000000000002e-05 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539030+0000", 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051009879999999999 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539150+0000", 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119879 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.693 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.694 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.694 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:48.694 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:48.694 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:48.695 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:48:48.696 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:48.691+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:48.796 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:48.795+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:48.865 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:48:48.866 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:48.880 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:48:48.924 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:48.923+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:48.998 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:48.995+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:49.050 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:49.050 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:49.050 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:48:49.050 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:48:49.050 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:49.064 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:48:49.108 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:49.107+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:49.200 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:49.203+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:49.223 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T07:48:49.230 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.771087324, 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.231 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:48:49.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.237 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.665298814000003, 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01016414, 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 36 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562284+0000", 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.976e-06 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562295+0000", 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0563e-05 2024-04-26T07:48:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562317+0000", 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2160000000000001e-05 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568856+0000", 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065391340000000003 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568996+0000", 2024-04-26T07:48:49.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013974500000000001 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.569185+0000", 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018917599999999999 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570452+0000", 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012671259999999999 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572276+0000", 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018236579999999999 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572374+0000", 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8179999999999999e-05 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572442+0000", 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7651999999999995e-05 2024-04-26T07:48:49.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.665243717999999, 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010242279999999999, 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.244 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 37 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7599999999999997e-07 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562340+0000", 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2639999999999997e-06 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562353+0000", 2024-04-26T07:48:49.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3953e-05 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562364+0000", 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0023e-05 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570502+0000", 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081387839999999996 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570636+0000", 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133929 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570841+0000", 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020473799999999999 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572179+0000", 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001338136 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572455+0000", 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027610500000000001 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572525+0000", 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9442000000000004e-05 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572575+0000", 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0229999999999998e-05 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.249 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:84 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.573693306000003, 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010516041, 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.250 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 84 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653884+0000", 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9299999999999997e-07 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653990+0000", 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010574 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654007+0000", 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7255999999999999e-05 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654016+0000", 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0229999999999998e-06 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.656818+0000", 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028019609999999999 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657052+0000", 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023420799999999999 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657457+0000", 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000404516 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.660887+0000", 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034301549999999998 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664252+0000", 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033656070000000001 2024-04-26T07:48:49.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664328+0000", 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6216000000000003e-05 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664399+0000", 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0566000000000002e-05 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.573543328, 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010767923, 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 85 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654034+0000", 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654040+0000", 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8300000000000001e-06 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654051+0000", 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0994e-05 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654059+0000", 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2400000000000007e-06 2024-04-26T07:48:49.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659335+0000", 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052755730000000004 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659564+0000", 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022912799999999999 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659947+0000", 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000383204 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664531+0000", 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045834930000000001 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664678+0000", 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014781899999999999 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664748+0000", 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0088999999999999e-05 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664801+0000", 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2463000000000002e-05 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.261 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.573503813999999, 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010852031999999999, 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 86 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:49.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654090+0000", 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.649e-05 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654101+0000", 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1216000000000001e-05 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654109+0000", 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9670000000000001e-06 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661156+0000", 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007047022 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661408+0000", 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025155499999999999 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661801+0000", 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039353700000000001 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664660+0000", 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028584499999999998 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664815+0000", 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015576899999999999 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664877+0000", 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1259000000000004e-05 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664925+0000", 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7997000000000001e-05 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.573453190999999, 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01259659, 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.267 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 87 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654124+0000", 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4300000000000002e-07 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654222+0000", 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7719000000000004e-05 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654234+0000", 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2604e-05 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654243+0000", 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5459999999999992e-06 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662707+0000", 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084641609999999996 2024-04-26T07:48:49.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662839+0000", 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132125 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.663062+0000", 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000223136 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666539+0000", 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034766480000000002 2024-04-26T07:48:49.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666567+0000", 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8070000000000001e-05 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666651+0000", 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3856000000000005e-05 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666720+0000", 2024-04-26T07:48:49.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8981999999999998e-05 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.573317416000002, 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013093877, 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.273 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 88 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654260+0000", 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6000000000000002e-07 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654265+0000", 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4569999999999996e-06 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654278+0000", 2024-04-26T07:48:49.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2948999999999999e-05 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654286+0000", 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9200000000000004e-06 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665027+0000", 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010741297 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665256+0000", 2024-04-26T07:48:49.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000228528 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665645+0000", 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038947299999999999 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666936+0000", 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012903260000000001 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667178+0000", 2024-04-26T07:48:49.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024258799999999999 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667271+0000", 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2637000000000001e-05 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667353+0000", 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1841999999999993e-05 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.278 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.279 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.281 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:49.281 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486710029999998, 2024-04-26T07:48:49.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011699831000000001, 2024-04-26T07:48:49.281 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.281 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.281 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 106 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740867+0000", 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740954+0000", 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6539000000000006e-05 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740976+0000", 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1616000000000001e-05 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740986+0000", 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0210000000000001e-05 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.743957+0000", 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029711820000000002 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744188+0000", 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023153799999999999 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744602+0000", 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041389699999999998 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746647+0000", 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020443940000000002 2024-04-26T07:48:49.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752403+0000", 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00575583 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752495+0000", 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2205000000000002e-05 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752566+0000", 2024-04-26T07:48:49.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1329999999999996e-05 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486570544999999, 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011999419000000001, 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 107 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:49.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741007+0000", 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6300000000000004e-07 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741013+0000", 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0430000000000004e-06 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741024+0000", 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1219999999999999e-05 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741032+0000", 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0129999999999993e-06 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746964+0000", 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059325890000000003 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747200+0000", 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023506800000000001 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747570+0000", 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037041400000000001 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752381+0000", 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048112110000000001 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752882+0000", 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050076899999999998 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752951+0000", 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8639000000000005e-05 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753005+0000", 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4589999999999997e-05 2024-04-26T07:48:49.292 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486522901999997, 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012200701, 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.293 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 108 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741054+0000", 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8299999999999996e-07 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741059+0000", 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2270000000000001e-06 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741072+0000", 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3076e-05 2024-04-26T07:48:49.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741081+0000", 2024-04-26T07:48:49.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6600000000000001e-06 2024-04-26T07:48:49.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748524+0000", 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074427199999999999 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748761+0000", 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023694499999999999 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.749207+0000", 2024-04-26T07:48:49.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044570900000000002 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752705+0000", 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034982049999999999 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753019+0000", 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031469100000000003 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753143+0000", 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123919 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753254+0000", 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110766 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.299 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486473265999997, 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01715328, 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 109 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741104+0000", 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6400000000000001e-07 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741233+0000", 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129429 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741254+0000", 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0665999999999998e-05 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741264+0000", 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0216e-05 2024-04-26T07:48:49.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750196+0000", 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089322310000000005 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750436+0000", 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023930499999999999 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750837+0000", 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040168400000000003 2024-04-26T07:48:49.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752861+0000", 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002024086 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758087+0000", 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052259369999999999 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758165+0000", 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7906999999999998e-05 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758256+0000", 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1055000000000001e-05 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486294090999998, 2024-04-26T07:48:49.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017458564999999999, 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 110 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741283+0000", 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8299999999999995e-07 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741289+0000", 2024-04-26T07:48:49.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7799999999999997e-06 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741302+0000", 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.296e-05 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741310+0000", 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4400000000000005e-06 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753384+0000", 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012073709 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753620+0000", 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023612500000000001 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754000+0000", 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037985699999999999 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758415+0000", 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044144839999999998 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758560+0000", 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014554100000000001 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758676+0000", 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115906 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758741+0000", 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.478e-05 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486252927999999, 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017565926999999999, 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.311 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 111 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741324+0000", 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741330+0000", 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5899999999999998e-06 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741359+0000", 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.976e-05 2024-04-26T07:48:49.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741368+0000", 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4630000000000001e-06 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754914+0000", 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01354584 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755155+0000", 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024081800000000001 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755512+0000", 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035783000000000001 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758539+0000", 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030268529999999999 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758765+0000", 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022618399999999999 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758839+0000", 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3056e-05 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758889+0000", 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0813000000000003e-05 2024-04-26T07:48:49.316 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486193411999999, 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018715345000000001, 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.317 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 112 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:49.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741384+0000", 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1399999999999996e-07 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741484+0000", 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010031600000000001 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741497+0000", 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3413e-05 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741506+0000", 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8359999999999998e-06 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756372+0000", 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014865405999999999 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756614+0000", 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024270499999999999 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.757084+0000", 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000469946 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759020+0000", 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019354979999999999 2024-04-26T07:48:49.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759964+0000", 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000944195 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760039+0000", 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5543000000000005e-05 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760098+0000", 2024-04-26T07:48:49.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8773000000000001e-05 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486053613000003, 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.323 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:48:49.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:49.328 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.486014779999998, 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:49.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:48:49.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.485976749999999, 2024-04-26T07:48:49.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:48:49.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:48:49.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.485855196999999, 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.340 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:49.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.345 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.485815228, 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:49.346 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:48:49.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:49.351 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:49.352 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:49.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:48:49.354 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T07:48:49.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:48:49.355 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:49.351+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:49.355 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:48:49.454 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:49.455+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:49.533 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:49.533 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:49.533 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:49.533 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:49.555 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:48:49.556 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:49.551+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:49.656 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:49.655+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:49.709 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:49.709 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:49.709 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:48:49.709 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:48:49.709 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:49.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:48:49.757 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:49.755+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:49.780 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:49.788 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:48:49.794 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-04-26T07:48:49.222175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241636,"kb_used_data":4652,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733084,"statfs":{"total":773094113280,"available":772846678016,"internally_reserved":0,"allocated":4763648,"data_stored":2782844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044392"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523196+0000","last_change":"2024-04-26T07:48:21.522910+0000","last_active":"2024-04-26T07:48:47.523196+0000","last_peered":"2024-04-26T07:48:47.523196+0000","last_clean":"2024-04-26T07:48:47.523196+0000","last_became_active":"2024-04-26T07:48:21.522270+0000","last_became_peered":"2024-04-26T07:48:21.522270+0000","last_unstale":"2024-04-26T07:48:47.523196+0000","last_undegraded":"2024-04-26T07:48:47.523196+0000","last_fullsized":"2024-04-26T07:48:47.523196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420262+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:48:48.420262+0000","last_peered":"2024-04-26T07:48:48.420262+0000","last_clean":"2024-04-26T07:48:48.420262+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:48:48.420262+0000","last_undegraded":"2024-04-26T07:48:48.420262+0000","last_fullsized":"2024-04-26T07:48:48.420262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.782267+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:48:47.782267+0000","last_peered":"2024-04-26T07:48:47.782267+0000","last_clean":"2024-04-26T07:48:47.782267+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:48:47.782267+0000","last_undegraded":"2024-04-26T07:48:47.782267+0000","last_fullsized":"2024-04-26T07:48:47.782267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521370+0000","last_change":"2024-04-26T07:48:23.546594+0000","last_active":"2024-04-26T07:48:47.521370+0000","last_peered":"2024-04-26T07:48:47.521370+0000","last_clean":"2024-04-26T07:48:47.521370+0000","last_became_active":"2024-04-26T07:48:23.545761+0000","last_became_peered":"2024-04-26T07:48:23.545761+0000","last_unstale":"2024-04-26T07:48:47.521370+0000","last_undegraded":"2024-04-26T07:48:47.521370+0000","last_fullsized":"2024-04-26T07:48:47.521370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561055+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:48:47.561055+0000","last_peered":"2024-04-26T07:48:47.561055+0000","last_clean":"2024-04-26T07:48:47.561055+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:48:47.561055+0000","last_undegraded":"2024-04-26T07:48:47.561055+0000","last_fullsized":"2024-04-26T07:48:47.561055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218795+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:48:48.218795+0000","last_peered":"2024-04-26T07:48:48.218795+0000","last_clean":"2024-04-26T07:48:48.218795+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:48:48.218795+0000","last_undegraded":"2024-04-26T07:48:48.218795+0000","last_fullsized":"2024-04-26T07:48:48.218795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421769+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:48:48.421769+0000","last_peered":"2024-04-26T07:48:48.421769+0000","last_clean":"2024-04-26T07:48:48.421769+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:48:48.421769+0000","last_undegraded":"2024-04-26T07:48:48.421769+0000","last_fullsized":"2024-04-26T07:48:48.421769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559504+0000","last_change":"2024-04-26T07:48:23.549877+0000","last_active":"2024-04-26T07:48:47.559504+0000","last_peered":"2024-04-26T07:48:47.559504+0000","last_clean":"2024-04-26T07:48:47.559504+0000","last_became_active":"2024-04-26T07:48:23.549563+0000","last_became_peered":"2024-04-26T07:48:23.549563+0000","last_unstale":"2024-04-26T07:48:47.559504+0000","last_undegraded":"2024-04-26T07:48:47.559504+0000","last_fullsized":"2024-04-26T07:48:47.559504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522319+0000","last_change":"2024-04-26T07:48:21.523373+0000","last_active":"2024-04-26T07:48:47.522319+0000","last_peered":"2024-04-26T07:48:47.522319+0000","last_clean":"2024-04-26T07:48:47.522319+0000","last_became_active":"2024-04-26T07:48:21.522623+0000","last_became_peered":"2024-04-26T07:48:21.522623+0000","last_unstale":"2024-04-26T07:48:47.522319+0000","last_undegraded":"2024-04-26T07:48:47.522319+0000","last_fullsized":"2024-04-26T07:48:47.522319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581437+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:48:48.581437+0000","last_peered":"2024-04-26T07:48:48.581437+0000","last_clean":"2024-04-26T07:48:48.581437+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:48:48.581437+0000","last_undegraded":"2024-04-26T07:48:48.581437+0000","last_fullsized":"2024-04-26T07:48:48.581437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421158+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:48:48.421158+0000","last_peered":"2024-04-26T07:48:48.421158+0000","last_clean":"2024-04-26T07:48:48.421158+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:48:48.421158+0000","last_undegraded":"2024-04-26T07:48:48.421158+0000","last_fullsized":"2024-04-26T07:48:48.421158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219457+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:48:48.219457+0000","last_peered":"2024-04-26T07:48:48.219457+0000","last_clean":"2024-04-26T07:48:48.219457+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:48:48.219457+0000","last_undegraded":"2024-04-26T07:48:48.219457+0000","last_fullsized":"2024-04-26T07:48:48.219457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521627+0000","last_change":"2024-04-26T07:48:21.521442+0000","last_active":"2024-04-26T07:48:47.521627+0000","last_peered":"2024-04-26T07:48:47.521627+0000","last_clean":"2024-04-26T07:48:47.521627+0000","last_became_active":"2024-04-26T07:48:21.520835+0000","last_became_peered":"2024-04-26T07:48:21.520835+0000","last_unstale":"2024-04-26T07:48:47.521627+0000","last_undegraded":"2024-04-26T07:48:47.521627+0000","last_fullsized":"2024-04-26T07:48:47.521627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422203+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:48:48.422203+0000","last_peered":"2024-04-26T07:48:48.422203+0000","last_clean":"2024-04-26T07:48:48.422203+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:48:48.422203+0000","last_undegraded":"2024-04-26T07:48:48.422203+0000","last_fullsized":"2024-04-26T07:48:48.422203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220533+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:48:48.220533+0000","last_peered":"2024-04-26T07:48:48.220533+0000","last_clean":"2024-04-26T07:48:48.220533+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:48:48.220533+0000","last_undegraded":"2024-04-26T07:48:48.220533+0000","last_fullsized":"2024-04-26T07:48:48.220533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222751+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:48:48.222751+0000","last_peered":"2024-04-26T07:48:48.222751+0000","last_clean":"2024-04-26T07:48:48.222751+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:48:48.222751+0000","last_undegraded":"2024-04-26T07:48:48.222751+0000","last_fullsized":"2024-04-26T07:48:48.222751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218222+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:48:48.218222+0000","last_peered":"2024-04-26T07:48:48.218222+0000","last_clean":"2024-04-26T07:48:48.218222+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:48:48.218222+0000","last_undegraded":"2024-04-26T07:48:48.218222+0000","last_fullsized":"2024-04-26T07:48:48.218222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523240+0000","last_change":"2024-04-26T07:48:21.530617+0000","last_active":"2024-04-26T07:48:47.523240+0000","last_peered":"2024-04-26T07:48:47.523240+0000","last_clean":"2024-04-26T07:48:47.523240+0000","last_became_active":"2024-04-26T07:48:21.529930+0000","last_became_peered":"2024-04-26T07:48:21.529930+0000","last_unstale":"2024-04-26T07:48:47.523240+0000","last_undegraded":"2024-04-26T07:48:47.523240+0000","last_fullsized":"2024-04-26T07:48:47.523240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.873875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521431+0000","last_change":"2024-04-26T07:48:23.553223+0000","last_active":"2024-04-26T07:48:47.521431+0000","last_peered":"2024-04-26T07:48:47.521431+0000","last_clean":"2024-04-26T07:48:47.521431+0000","last_became_active":"2024-04-26T07:48:23.547557+0000","last_became_peered":"2024-04-26T07:48:23.547557+0000","last_unstale":"2024-04-26T07:48:47.521431+0000","last_undegraded":"2024-04-26T07:48:47.521431+0000","last_fullsized":"2024-04-26T07:48:47.521431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581319+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:48:48.581319+0000","last_peered":"2024-04-26T07:48:48.581319+0000","last_clean":"2024-04-26T07:48:48.581319+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:48:48.581319+0000","last_undegraded":"2024-04-26T07:48:48.581319+0000","last_fullsized":"2024-04-26T07:48:48.581319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421282+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:48:48.421282+0000","last_peered":"2024-04-26T07:48:48.421282+0000","last_clean":"2024-04-26T07:48:48.421282+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:48:48.421282+0000","last_undegraded":"2024-04-26T07:48:48.421282+0000","last_fullsized":"2024-04-26T07:48:48.421282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.582033+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:48:48.582033+0000","last_peered":"2024-04-26T07:48:48.582033+0000","last_clean":"2024-04-26T07:48:48.582033+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:48:48.582033+0000","last_undegraded":"2024-04-26T07:48:48.582033+0000","last_fullsized":"2024-04-26T07:48:48.582033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220932+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:48:48.220932+0000","last_peered":"2024-04-26T07:48:48.220932+0000","last_clean":"2024-04-26T07:48:48.220932+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:48:48.220932+0000","last_undegraded":"2024-04-26T07:48:48.220932+0000","last_fullsized":"2024-04-26T07:48:48.220932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219303+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:48:48.219303+0000","last_peered":"2024-04-26T07:48:48.219303+0000","last_clean":"2024-04-26T07:48:48.219303+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:48:48.219303+0000","last_undegraded":"2024-04-26T07:48:48.219303+0000","last_fullsized":"2024-04-26T07:48:48.219303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219465+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:48:48.219465+0000","last_peered":"2024-04-26T07:48:48.219465+0000","last_clean":"2024-04-26T07:48:48.219465+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:48:48.219465+0000","last_undegraded":"2024-04-26T07:48:48.219465+0000","last_fullsized":"2024-04-26T07:48:48.219465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224993+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:48:48.224993+0000","last_peered":"2024-04-26T07:48:48.224993+0000","last_clean":"2024-04-26T07:48:48.224993+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:48:48.224993+0000","last_undegraded":"2024-04-26T07:48:48.224993+0000","last_fullsized":"2024-04-26T07:48:48.224993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219523+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:48:48.219523+0000","last_peered":"2024-04-26T07:48:48.219523+0000","last_clean":"2024-04-26T07:48:48.219523+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:48:48.219523+0000","last_undegraded":"2024-04-26T07:48:48.219523+0000","last_fullsized":"2024-04-26T07:48:48.219523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561399+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:48:47.561399+0000","last_peered":"2024-04-26T07:48:47.561399+0000","last_clean":"2024-04-26T07:48:47.561399+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:48:47.561399+0000","last_undegraded":"2024-04-26T07:48:47.561399+0000","last_fullsized":"2024-04-26T07:48:47.561399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217481+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:48:48.217481+0000","last_peered":"2024-04-26T07:48:48.217481+0000","last_clean":"2024-04-26T07:48:48.217481+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:48:48.217481+0000","last_undegraded":"2024-04-26T07:48:48.217481+0000","last_fullsized":"2024-04-26T07:48:48.217481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226104+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:48:48.226104+0000","last_peered":"2024-04-26T07:48:48.226104+0000","last_clean":"2024-04-26T07:48:48.226104+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:48:48.226104+0000","last_undegraded":"2024-04-26T07:48:48.226104+0000","last_fullsized":"2024-04-26T07:48:48.226104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522699+0000","last_change":"2024-04-26T07:48:21.532476+0000","last_active":"2024-04-26T07:48:47.522699+0000","last_peered":"2024-04-26T07:48:47.522699+0000","last_clean":"2024-04-26T07:48:47.522699+0000","last_became_active":"2024-04-26T07:48:21.531890+0000","last_became_peered":"2024-04-26T07:48:21.531890+0000","last_unstale":"2024-04-26T07:48:47.522699+0000","last_undegraded":"2024-04-26T07:48:47.522699+0000","last_fullsized":"2024-04-26T07:48:47.522699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421989+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:48:48.421989+0000","last_peered":"2024-04-26T07:48:48.421989+0000","last_clean":"2024-04-26T07:48:48.421989+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:48:48.421989+0000","last_undegraded":"2024-04-26T07:48:48.421989+0000","last_fullsized":"2024-04-26T07:48:48.421989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563796+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:48:47.563796+0000","last_peered":"2024-04-26T07:48:47.563796+0000","last_clean":"2024-04-26T07:48:47.563796+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:48:47.563796+0000","last_undegraded":"2024-04-26T07:48:47.563796+0000","last_fullsized":"2024-04-26T07:48:47.563796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522780+0000","last_change":"2024-04-26T07:48:29.585278+0000","last_active":"2024-04-26T07:48:47.522780+0000","last_peered":"2024-04-26T07:48:47.522780+0000","last_clean":"2024-04-26T07:48:47.522780+0000","last_became_active":"2024-04-26T07:48:29.584564+0000","last_became_peered":"2024-04-26T07:48:29.584564+0000","last_unstale":"2024-04-26T07:48:47.522780+0000","last_undegraded":"2024-04-26T07:48:47.522780+0000","last_fullsized":"2024-04-26T07:48:47.522780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420374+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:48:48.420374+0000","last_peered":"2024-04-26T07:48:48.420374+0000","last_clean":"2024-04-26T07:48:48.420374+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:48:48.420374+0000","last_undegraded":"2024-04-26T07:48:48.420374+0000","last_fullsized":"2024-04-26T07:48:48.420374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422464+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:48:48.422464+0000","last_peered":"2024-04-26T07:48:48.422464+0000","last_clean":"2024-04-26T07:48:48.422464+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:48:48.422464+0000","last_undegraded":"2024-04-26T07:48:48.422464+0000","last_fullsized":"2024-04-26T07:48:48.422464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561532+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:48:47.561532+0000","last_peered":"2024-04-26T07:48:47.561532+0000","last_clean":"2024-04-26T07:48:47.561532+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:48:47.561532+0000","last_undegraded":"2024-04-26T07:48:47.561532+0000","last_fullsized":"2024-04-26T07:48:47.561532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225526+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:48:48.225526+0000","last_peered":"2024-04-26T07:48:48.225526+0000","last_clean":"2024-04-26T07:48:48.225526+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:48:48.225526+0000","last_undegraded":"2024-04-26T07:48:48.225526+0000","last_fullsized":"2024-04-26T07:48:48.225526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219818+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:48:48.219818+0000","last_peered":"2024-04-26T07:48:48.219818+0000","last_clean":"2024-04-26T07:48:48.219818+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:48:48.219818+0000","last_undegraded":"2024-04-26T07:48:48.219818+0000","last_fullsized":"2024-04-26T07:48:48.219818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219637+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:48:48.219637+0000","last_peered":"2024-04-26T07:48:48.219637+0000","last_clean":"2024-04-26T07:48:48.219637+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:48:48.219637+0000","last_undegraded":"2024-04-26T07:48:48.219637+0000","last_fullsized":"2024-04-26T07:48:48.219637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560745+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:48:47.560745+0000","last_peered":"2024-04-26T07:48:47.560745+0000","last_clean":"2024-04-26T07:48:47.560745+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:48:47.560745+0000","last_undegraded":"2024-04-26T07:48:47.560745+0000","last_fullsized":"2024-04-26T07:48:47.560745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559740+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:48:47.559740+0000","last_peered":"2024-04-26T07:48:47.559740+0000","last_clean":"2024-04-26T07:48:47.559740+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:48:47.559740+0000","last_undegraded":"2024-04-26T07:48:47.559740+0000","last_fullsized":"2024-04-26T07:48:47.559740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521662+0000","last_change":"2024-04-26T07:48:21.532432+0000","last_active":"2024-04-26T07:48:47.521662+0000","last_peered":"2024-04-26T07:48:47.521662+0000","last_clean":"2024-04-26T07:48:47.521662+0000","last_became_active":"2024-04-26T07:48:21.531735+0000","last_became_peered":"2024-04-26T07:48:21.531735+0000","last_unstale":"2024-04-26T07:48:47.521662+0000","last_undegraded":"2024-04-26T07:48:47.521662+0000","last_fullsized":"2024-04-26T07:48:47.521662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:44.669301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226169+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:48:48.226169+0000","last_peered":"2024-04-26T07:48:48.226169+0000","last_clean":"2024-04-26T07:48:48.226169+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:48:48.226169+0000","last_undegraded":"2024-04-26T07:48:48.226169+0000","last_fullsized":"2024-04-26T07:48:48.226169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219978+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:48:48.219978+0000","last_peered":"2024-04-26T07:48:48.219978+0000","last_clean":"2024-04-26T07:48:48.219978+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:48:48.219978+0000","last_undegraded":"2024-04-26T07:48:48.219978+0000","last_fullsized":"2024-04-26T07:48:48.219978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522284+0000","last_change":"2024-04-26T07:48:29.580319+0000","last_active":"2024-04-26T07:48:47.522284+0000","last_peered":"2024-04-26T07:48:47.522284+0000","last_clean":"2024-04-26T07:48:47.522284+0000","last_became_active":"2024-04-26T07:48:29.579332+0000","last_became_peered":"2024-04-26T07:48:29.579332+0000","last_unstale":"2024-04-26T07:48:47.522284+0000","last_undegraded":"2024-04-26T07:48:47.522284+0000","last_fullsized":"2024-04-26T07:48:47.522284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217185+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:48:48.217185+0000","last_peered":"2024-04-26T07:48:48.217185+0000","last_clean":"2024-04-26T07:48:48.217185+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:48:48.217185+0000","last_undegraded":"2024-04-26T07:48:48.217185+0000","last_fullsized":"2024-04-26T07:48:48.217185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225898+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:48:48.225898+0000","last_peered":"2024-04-26T07:48:48.225898+0000","last_clean":"2024-04-26T07:48:48.225898+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:48:48.225898+0000","last_undegraded":"2024-04-26T07:48:48.225898+0000","last_fullsized":"2024-04-26T07:48:48.225898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580551+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:48:48.580551+0000","last_peered":"2024-04-26T07:48:48.580551+0000","last_clean":"2024-04-26T07:48:48.580551+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:48:48.580551+0000","last_undegraded":"2024-04-26T07:48:48.580551+0000","last_fullsized":"2024-04-26T07:48:48.580551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422086+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:48:48.422086+0000","last_peered":"2024-04-26T07:48:48.422086+0000","last_clean":"2024-04-26T07:48:48.422086+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:48:48.422086+0000","last_undegraded":"2024-04-26T07:48:48.422086+0000","last_fullsized":"2024-04-26T07:48:48.422086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522642+0000","last_change":"2024-04-26T07:48:27.656615+0000","last_active":"2024-04-26T07:48:47.522642+0000","last_peered":"2024-04-26T07:48:47.522642+0000","last_clean":"2024-04-26T07:48:47.522642+0000","last_became_active":"2024-04-26T07:48:27.655900+0000","last_became_peered":"2024-04-26T07:48:27.655900+0000","last_unstale":"2024-04-26T07:48:47.522642+0000","last_undegraded":"2024-04-26T07:48:47.522642+0000","last_fullsized":"2024-04-26T07:48:47.522642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225226+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:48:48.225226+0000","last_peered":"2024-04-26T07:48:48.225226+0000","last_clean":"2024-04-26T07:48:48.225226+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:48:48.225226+0000","last_undegraded":"2024-04-26T07:48:48.225226+0000","last_fullsized":"2024-04-26T07:48:48.225226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420814+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:48:48.420814+0000","last_peered":"2024-04-26T07:48:48.420814+0000","last_clean":"2024-04-26T07:48:48.420814+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:48:48.420814+0000","last_undegraded":"2024-04-26T07:48:48.420814+0000","last_fullsized":"2024-04-26T07:48:48.420814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523377+0000","last_change":"2024-04-26T07:48:21.532535+0000","last_active":"2024-04-26T07:48:47.523377+0000","last_peered":"2024-04-26T07:48:47.523377+0000","last_clean":"2024-04-26T07:48:47.523377+0000","last_became_active":"2024-04-26T07:48:21.531870+0000","last_became_peered":"2024-04-26T07:48:21.531870+0000","last_unstale":"2024-04-26T07:48:47.523377+0000","last_undegraded":"2024-04-26T07:48:47.523377+0000","last_fullsized":"2024-04-26T07:48:47.523377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:53.041052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521103+0000","last_change":"2024-04-26T07:48:25.580567+0000","last_active":"2024-04-26T07:48:47.521103+0000","last_peered":"2024-04-26T07:48:47.521103+0000","last_clean":"2024-04-26T07:48:47.521103+0000","last_became_active":"2024-04-26T07:48:25.579735+0000","last_became_peered":"2024-04-26T07:48:25.579735+0000","last_unstale":"2024-04-26T07:48:47.521103+0000","last_undegraded":"2024-04-26T07:48:47.521103+0000","last_fullsized":"2024-04-26T07:48:47.521103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421019+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:48:48.421019+0000","last_peered":"2024-04-26T07:48:48.421019+0000","last_clean":"2024-04-26T07:48:48.421019+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:48:48.421019+0000","last_undegraded":"2024-04-26T07:48:48.421019+0000","last_fullsized":"2024-04-26T07:48:48.421019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781263+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:48:47.781263+0000","last_peered":"2024-04-26T07:48:47.781263+0000","last_clean":"2024-04-26T07:48:47.781263+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:48:47.781263+0000","last_undegraded":"2024-04-26T07:48:47.781263+0000","last_fullsized":"2024-04-26T07:48:47.781263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420357+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:48:48.420357+0000","last_peered":"2024-04-26T07:48:48.420357+0000","last_clean":"2024-04-26T07:48:48.420357+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:48:48.420357+0000","last_undegraded":"2024-04-26T07:48:48.420357+0000","last_fullsized":"2024-04-26T07:48:48.420357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218394+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:48:48.218394+0000","last_peered":"2024-04-26T07:48:48.218394+0000","last_clean":"2024-04-26T07:48:48.218394+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:48:48.218394+0000","last_undegraded":"2024-04-26T07:48:48.218394+0000","last_fullsized":"2024-04-26T07:48:48.218394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523224+0000","last_change":"2024-04-26T07:48:21.531367+0000","last_active":"2024-04-26T07:48:47.523224+0000","last_peered":"2024-04-26T07:48:47.523224+0000","last_clean":"2024-04-26T07:48:47.523224+0000","last_became_active":"2024-04-26T07:48:21.530818+0000","last_became_peered":"2024-04-26T07:48:21.530818+0000","last_unstale":"2024-04-26T07:48:47.523224+0000","last_undegraded":"2024-04-26T07:48:47.523224+0000","last_fullsized":"2024-04-26T07:48:47.523224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218765+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:48:48.218765+0000","last_peered":"2024-04-26T07:48:48.218765+0000","last_clean":"2024-04-26T07:48:48.218765+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:48:48.218765+0000","last_undegraded":"2024-04-26T07:48:48.218765+0000","last_fullsized":"2024-04-26T07:48:48.218765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225328+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:48:48.225328+0000","last_peered":"2024-04-26T07:48:48.225328+0000","last_clean":"2024-04-26T07:48:48.225328+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:48:48.225328+0000","last_undegraded":"2024-04-26T07:48:48.225328+0000","last_fullsized":"2024-04-26T07:48:48.225328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220778+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:48:48.220778+0000","last_peered":"2024-04-26T07:48:48.220778+0000","last_clean":"2024-04-26T07:48:48.220778+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:48:48.220778+0000","last_undegraded":"2024-04-26T07:48:48.220778+0000","last_fullsized":"2024-04-26T07:48:48.220778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580061+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:48:48.580061+0000","last_peered":"2024-04-26T07:48:48.580061+0000","last_clean":"2024-04-26T07:48:48.580061+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:48:48.580061+0000","last_undegraded":"2024-04-26T07:48:48.580061+0000","last_fullsized":"2024-04-26T07:48:48.580061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580838+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:48:48.580838+0000","last_peered":"2024-04-26T07:48:48.580838+0000","last_clean":"2024-04-26T07:48:48.580838+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:48:48.580838+0000","last_undegraded":"2024-04-26T07:48:48.580838+0000","last_fullsized":"2024-04-26T07:48:48.580838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523358+0000","last_change":"2024-04-26T07:48:21.528922+0000","last_active":"2024-04-26T07:48:47.523358+0000","last_peered":"2024-04-26T07:48:47.523358+0000","last_clean":"2024-04-26T07:48:47.523358+0000","last_became_active":"2024-04-26T07:48:21.528409+0000","last_became_peered":"2024-04-26T07:48:21.528409+0000","last_unstale":"2024-04-26T07:48:47.523358+0000","last_undegraded":"2024-04-26T07:48:47.523358+0000","last_fullsized":"2024-04-26T07:48:47.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221569+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:48:48.221569+0000","last_peered":"2024-04-26T07:48:48.221569+0000","last_clean":"2024-04-26T07:48:48.221569+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:48:48.221569+0000","last_undegraded":"2024-04-26T07:48:48.221569+0000","last_fullsized":"2024-04-26T07:48:48.221569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521811+0000","last_change":"2024-04-26T07:48:27.575739+0000","last_active":"2024-04-26T07:48:47.521811+0000","last_peered":"2024-04-26T07:48:47.521811+0000","last_clean":"2024-04-26T07:48:47.521811+0000","last_became_active":"2024-04-26T07:48:27.574665+0000","last_became_peered":"2024-04-26T07:48:27.574665+0000","last_unstale":"2024-04-26T07:48:47.521811+0000","last_undegraded":"2024-04-26T07:48:47.521811+0000","last_fullsized":"2024-04-26T07:48:47.521811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560229+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:48:47.560229+0000","last_peered":"2024-04-26T07:48:47.560229+0000","last_clean":"2024-04-26T07:48:47.560229+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:48:47.560229+0000","last_undegraded":"2024-04-26T07:48:47.560229+0000","last_fullsized":"2024-04-26T07:48:47.560229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563956+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:48:47.563956+0000","last_peered":"2024-04-26T07:48:47.563956+0000","last_clean":"2024-04-26T07:48:47.563956+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:48:47.563956+0000","last_undegraded":"2024-04-26T07:48:47.563956+0000","last_fullsized":"2024-04-26T07:48:47.563956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.562149+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:48:47.562149+0000","last_peered":"2024-04-26T07:48:47.562149+0000","last_clean":"2024-04-26T07:48:47.562149+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:48:47.562149+0000","last_undegraded":"2024-04-26T07:48:47.562149+0000","last_fullsized":"2024-04-26T07:48:47.562149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421993+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:48:48.421993+0000","last_peered":"2024-04-26T07:48:48.421993+0000","last_clean":"2024-04-26T07:48:48.421993+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:48:48.421993+0000","last_undegraded":"2024-04-26T07:48:48.421993+0000","last_fullsized":"2024-04-26T07:48:48.421993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220276+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:48:48.220276+0000","last_peered":"2024-04-26T07:48:48.220276+0000","last_clean":"2024-04-26T07:48:48.220276+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:48:48.220276+0000","last_undegraded":"2024-04-26T07:48:48.220276+0000","last_fullsized":"2024-04-26T07:48:48.220276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560526+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:48:47.560526+0000","last_peered":"2024-04-26T07:48:47.560526+0000","last_clean":"2024-04-26T07:48:47.560526+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:48:47.560526+0000","last_undegraded":"2024-04-26T07:48:47.560526+0000","last_fullsized":"2024-04-26T07:48:47.560526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218523+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:48:48.218523+0000","last_peered":"2024-04-26T07:48:48.218523+0000","last_clean":"2024-04-26T07:48:48.218523+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:48:48.218523+0000","last_undegraded":"2024-04-26T07:48:48.218523+0000","last_fullsized":"2024-04-26T07:48:48.218523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780818+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:48:47.780818+0000","last_peered":"2024-04-26T07:48:47.780818+0000","last_clean":"2024-04-26T07:48:47.780818+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:48:47.780818+0000","last_undegraded":"2024-04-26T07:48:47.780818+0000","last_fullsized":"2024-04-26T07:48:47.780818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217308+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:48:48.217308+0000","last_peered":"2024-04-26T07:48:48.217308+0000","last_clean":"2024-04-26T07:48:48.217308+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:48:48.217308+0000","last_undegraded":"2024-04-26T07:48:48.217308+0000","last_fullsized":"2024-04-26T07:48:48.217308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220070+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:48:48.220070+0000","last_peered":"2024-04-26T07:48:48.220070+0000","last_clean":"2024-04-26T07:48:48.220070+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:48:48.220070+0000","last_undegraded":"2024-04-26T07:48:48.220070+0000","last_fullsized":"2024-04-26T07:48:48.220070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220464+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:48:48.220464+0000","last_peered":"2024-04-26T07:48:48.220464+0000","last_clean":"2024-04-26T07:48:48.220464+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:48:48.220464+0000","last_undegraded":"2024-04-26T07:48:48.220464+0000","last_fullsized":"2024-04-26T07:48:48.220464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219667+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:48:48.219667+0000","last_peered":"2024-04-26T07:48:48.219667+0000","last_clean":"2024-04-26T07:48:48.219667+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:48:48.219667+0000","last_undegraded":"2024-04-26T07:48:48.219667+0000","last_fullsized":"2024-04-26T07:48:48.219667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564001+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:48:47.564001+0000","last_peered":"2024-04-26T07:48:47.564001+0000","last_clean":"2024-04-26T07:48:47.564001+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:48:47.564001+0000","last_undegraded":"2024-04-26T07:48:47.564001+0000","last_fullsized":"2024-04-26T07:48:47.564001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219986+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:48:48.219986+0000","last_peered":"2024-04-26T07:48:48.219986+0000","last_clean":"2024-04-26T07:48:48.219986+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:48:48.219986+0000","last_undegraded":"2024-04-26T07:48:48.219986+0000","last_fullsized":"2024-04-26T07:48:48.219986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217792+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:48:48.217792+0000","last_peered":"2024-04-26T07:48:48.217792+0000","last_clean":"2024-04-26T07:48:48.217792+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:48:48.217792+0000","last_undegraded":"2024-04-26T07:48:48.217792+0000","last_fullsized":"2024-04-26T07:48:48.217792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580881+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:48:48.580881+0000","last_peered":"2024-04-26T07:48:48.580881+0000","last_clean":"2024-04-26T07:48:48.580881+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:48:48.580881+0000","last_undegraded":"2024-04-26T07:48:48.580881+0000","last_fullsized":"2024-04-26T07:48:48.580881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781393+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:48:47.781393+0000","last_peered":"2024-04-26T07:48:47.781393+0000","last_clean":"2024-04-26T07:48:47.781393+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:48:47.781393+0000","last_undegraded":"2024-04-26T07:48:47.781393+0000","last_fullsized":"2024-04-26T07:48:47.781393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222425+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:48:48.222425+0000","last_peered":"2024-04-26T07:48:48.222425+0000","last_clean":"2024-04-26T07:48:48.222425+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:48:48.222425+0000","last_undegraded":"2024-04-26T07:48:48.222425+0000","last_fullsized":"2024-04-26T07:48:48.222425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222028+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:48:48.222028+0000","last_peered":"2024-04-26T07:48:48.222028+0000","last_clean":"2024-04-26T07:48:48.222028+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:48:48.222028+0000","last_undegraded":"2024-04-26T07:48:48.222028+0000","last_fullsized":"2024-04-26T07:48:48.222028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780106+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:48:47.780106+0000","last_peered":"2024-04-26T07:48:47.780106+0000","last_clean":"2024-04-26T07:48:47.780106+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:48:47.780106+0000","last_undegraded":"2024-04-26T07:48:47.780106+0000","last_fullsized":"2024-04-26T07:48:47.780106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217745+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:48:48.217745+0000","last_peered":"2024-04-26T07:48:48.217745+0000","last_clean":"2024-04-26T07:48:48.217745+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:48:48.217745+0000","last_undegraded":"2024-04-26T07:48:48.217745+0000","last_fullsized":"2024-04-26T07:48:48.217745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218771+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:48:48.218771+0000","last_peered":"2024-04-26T07:48:48.218771+0000","last_clean":"2024-04-26T07:48:48.218771+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:48:48.218771+0000","last_undegraded":"2024-04-26T07:48:48.218771+0000","last_fullsized":"2024-04-26T07:48:48.218771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422232+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:48:48.422232+0000","last_peered":"2024-04-26T07:48:48.422232+0000","last_clean":"2024-04-26T07:48:48.422232+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:48:48.422232+0000","last_undegraded":"2024-04-26T07:48:48.422232+0000","last_fullsized":"2024-04-26T07:48:48.422232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225253+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:48:48.225253+0000","last_peered":"2024-04-26T07:48:48.225253+0000","last_clean":"2024-04-26T07:48:48.225253+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:48:48.225253+0000","last_undegraded":"2024-04-26T07:48:48.225253+0000","last_fullsized":"2024-04-26T07:48:48.225253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581328+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:48:48.581328+0000","last_peered":"2024-04-26T07:48:48.581328+0000","last_clean":"2024-04-26T07:48:48.581328+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:48:48.581328+0000","last_undegraded":"2024-04-26T07:48:48.581328+0000","last_fullsized":"2024-04-26T07:48:48.581328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217037+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:48:48.217037+0000","last_peered":"2024-04-26T07:48:48.217037+0000","last_clean":"2024-04-26T07:48:48.217037+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:48:48.217037+0000","last_undegraded":"2024-04-26T07:48:48.217037+0000","last_fullsized":"2024-04-26T07:48:48.217037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780596+0000","last_change":"2024-04-26T07:48:23.549303+0000","last_active":"2024-04-26T07:48:47.780596+0000","last_peered":"2024-04-26T07:48:47.780596+0000","last_clean":"2024-04-26T07:48:47.780596+0000","last_became_active":"2024-04-26T07:48:23.548989+0000","last_became_peered":"2024-04-26T07:48:23.548989+0000","last_unstale":"2024-04-26T07:48:47.780596+0000","last_undegraded":"2024-04-26T07:48:47.780596+0000","last_fullsized":"2024-04-26T07:48:47.780596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220689+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:48:48.220689+0000","last_peered":"2024-04-26T07:48:48.220689+0000","last_clean":"2024-04-26T07:48:48.220689+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:48:48.220689+0000","last_undegraded":"2024-04-26T07:48:48.220689+0000","last_fullsized":"2024-04-26T07:48:48.220689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219997+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:48:48.219997+0000","last_peered":"2024-04-26T07:48:48.219997+0000","last_clean":"2024-04-26T07:48:48.219997+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:48:48.219997+0000","last_undegraded":"2024-04-26T07:48:48.219997+0000","last_fullsized":"2024-04-26T07:48:48.219997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421860+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:48:48.421860+0000","last_peered":"2024-04-26T07:48:48.421860+0000","last_clean":"2024-04-26T07:48:48.421860+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:48:48.421860+0000","last_undegraded":"2024-04-26T07:48:48.421860+0000","last_fullsized":"2024-04-26T07:48:48.421860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580999+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:48:48.580999+0000","last_peered":"2024-04-26T07:48:48.580999+0000","last_clean":"2024-04-26T07:48:48.580999+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:48:48.580999+0000","last_undegraded":"2024-04-26T07:48:48.580999+0000","last_fullsized":"2024-04-26T07:48:48.580999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.779970+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:48:47.779970+0000","last_peered":"2024-04-26T07:48:47.779970+0000","last_clean":"2024-04-26T07:48:47.779970+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:48:47.779970+0000","last_undegraded":"2024-04-26T07:48:47.779970+0000","last_fullsized":"2024-04-26T07:48:47.779970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580007+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:48:48.580007+0000","last_peered":"2024-04-26T07:48:48.580007+0000","last_clean":"2024-04-26T07:48:48.580007+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:48:48.580007+0000","last_undegraded":"2024-04-26T07:48:48.580007+0000","last_fullsized":"2024-04-26T07:48:48.580007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521888+0000","last_change":"2024-04-26T07:48:15.519242+0000","last_active":"2024-04-26T07:48:47.521888+0000","last_peered":"2024-04-26T07:48:47.521888+0000","last_clean":"2024-04-26T07:48:47.521888+0000","last_became_active":"2024-04-26T07:48:15.516846+0000","last_became_peered":"2024-04-26T07:48:15.516846+0000","last_unstale":"2024-04-26T07:48:47.521888+0000","last_undegraded":"2024-04-26T07:48:47.521888+0000","last_fullsized":"2024-04-26T07:48:47.521888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:20.666857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421538+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:48:48.421538+0000","last_peered":"2024-04-26T07:48:48.421538+0000","last_clean":"2024-04-26T07:48:48.421538+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:48:48.421538+0000","last_undegraded":"2024-04-26T07:48:48.421538+0000","last_fullsized":"2024-04-26T07:48:48.421538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221036+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:48:48.221036+0000","last_peered":"2024-04-26T07:48:48.221036+0000","last_clean":"2024-04-26T07:48:48.221036+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:48:48.221036+0000","last_undegraded":"2024-04-26T07:48:48.221036+0000","last_fullsized":"2024-04-26T07:48:48.221036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522293+0000","last_change":"2024-04-26T07:48:25.573125+0000","last_active":"2024-04-26T07:48:47.522293+0000","last_peered":"2024-04-26T07:48:47.522293+0000","last_clean":"2024-04-26T07:48:47.522293+0000","last_became_active":"2024-04-26T07:48:25.572200+0000","last_became_peered":"2024-04-26T07:48:25.572200+0000","last_unstale":"2024-04-26T07:48:47.522293+0000","last_undegraded":"2024-04-26T07:48:47.522293+0000","last_fullsized":"2024-04-26T07:48:47.522293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422480+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:48:48.422480+0000","last_peered":"2024-04-26T07:48:48.422480+0000","last_clean":"2024-04-26T07:48:48.422480+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:48:48.422480+0000","last_undegraded":"2024-04-26T07:48:48.422480+0000","last_fullsized":"2024-04-26T07:48:48.422480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564125+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:48:47.564125+0000","last_peered":"2024-04-26T07:48:47.564125+0000","last_clean":"2024-04-26T07:48:47.564125+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:48:47.564125+0000","last_undegraded":"2024-04-26T07:48:47.564125+0000","last_fullsized":"2024-04-26T07:48:47.564125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580201+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:48:48.580201+0000","last_peered":"2024-04-26T07:48:48.580201+0000","last_clean":"2024-04-26T07:48:48.580201+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:48:48.580201+0000","last_undegraded":"2024-04-26T07:48:48.580201+0000","last_fullsized":"2024-04-26T07:48:48.580201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564325+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:48:47.564325+0000","last_peered":"2024-04-26T07:48:47.564325+0000","last_clean":"2024-04-26T07:48:47.564325+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:48:47.564325+0000","last_undegraded":"2024-04-26T07:48:47.564325+0000","last_fullsized":"2024-04-26T07:48:47.564325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521635+0000","last_change":"2024-04-26T07:48:15.450172+0000","last_active":"2024-04-26T07:48:47.521635+0000","last_peered":"2024-04-26T07:48:47.521635+0000","last_clean":"2024-04-26T07:48:47.521635+0000","last_became_active":"2024-04-26T07:48:15.449113+0000","last_became_peered":"2024-04-26T07:48:15.449113+0000","last_unstale":"2024-04-26T07:48:47.521635+0000","last_undegraded":"2024-04-26T07:48:47.521635+0000","last_fullsized":"2024-04-26T07:48:47.521635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:51.283507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560617+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:48:47.560617+0000","last_peered":"2024-04-26T07:48:47.560617+0000","last_clean":"2024-04-26T07:48:47.560617+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:48:47.560617+0000","last_undegraded":"2024-04-26T07:48:47.560617+0000","last_fullsized":"2024-04-26T07:48:47.560617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422590+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:48:48.422590+0000","last_peered":"2024-04-26T07:48:48.422590+0000","last_clean":"2024-04-26T07:48:48.422590+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:48:48.422590+0000","last_undegraded":"2024-04-26T07:48:48.422590+0000","last_fullsized":"2024-04-26T07:48:48.422590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781304+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:48:47.781304+0000","last_peered":"2024-04-26T07:48:47.781304+0000","last_clean":"2024-04-26T07:48:47.781304+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:48:47.781304+0000","last_undegraded":"2024-04-26T07:48:47.781304+0000","last_fullsized":"2024-04-26T07:48:47.781304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522338+0000","last_change":"2024-04-26T07:48:29.582371+0000","last_active":"2024-04-26T07:48:47.522338+0000","last_peered":"2024-04-26T07:48:47.522338+0000","last_clean":"2024-04-26T07:48:47.522338+0000","last_became_active":"2024-04-26T07:48:29.581770+0000","last_became_peered":"2024-04-26T07:48:29.581770+0000","last_unstale":"2024-04-26T07:48:47.522338+0000","last_undegraded":"2024-04-26T07:48:47.522338+0000","last_fullsized":"2024-04-26T07:48:47.522338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780258+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:48:47.780258+0000","last_peered":"2024-04-26T07:48:47.780258+0000","last_clean":"2024-04-26T07:48:47.780258+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:48:47.780258+0000","last_undegraded":"2024-04-26T07:48:47.780258+0000","last_fullsized":"2024-04-26T07:48:47.780258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780432+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:48:47.780432+0000","last_peered":"2024-04-26T07:48:47.780432+0000","last_clean":"2024-04-26T07:48:47.780432+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:48:47.780432+0000","last_undegraded":"2024-04-26T07:48:47.780432+0000","last_fullsized":"2024-04-26T07:48:47.780432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223855+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:48:48.223855+0000","last_peered":"2024-04-26T07:48:48.223855+0000","last_clean":"2024-04-26T07:48:48.223855+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:48:48.223855+0000","last_undegraded":"2024-04-26T07:48:48.223855+0000","last_fullsized":"2024-04-26T07:48:48.223855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781158+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:48:47.781158+0000","last_peered":"2024-04-26T07:48:47.781158+0000","last_clean":"2024-04-26T07:48:47.781158+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:48:47.781158+0000","last_undegraded":"2024-04-26T07:48:47.781158+0000","last_fullsized":"2024-04-26T07:48:47.781158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222138+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:48:48.222138+0000","last_peered":"2024-04-26T07:48:48.222138+0000","last_clean":"2024-04-26T07:48:48.222138+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:48:48.222138+0000","last_undegraded":"2024-04-26T07:48:48.222138+0000","last_fullsized":"2024-04-26T07:48:48.222138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522849+0000","last_change":"2024-04-26T07:48:27.651812+0000","last_active":"2024-04-26T07:48:47.522849+0000","last_peered":"2024-04-26T07:48:47.522849+0000","last_clean":"2024-04-26T07:48:47.522849+0000","last_became_active":"2024-04-26T07:48:27.651073+0000","last_became_peered":"2024-04-26T07:48:27.651073+0000","last_unstale":"2024-04-26T07:48:47.522849+0000","last_undegraded":"2024-04-26T07:48:47.522849+0000","last_fullsized":"2024-04-26T07:48:47.522849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561172+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:48:47.561172+0000","last_peered":"2024-04-26T07:48:47.561172+0000","last_clean":"2024-04-26T07:48:47.561172+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:48:47.561172+0000","last_undegraded":"2024-04-26T07:48:47.561172+0000","last_fullsized":"2024-04-26T07:48:47.561172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224666+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:48:48.224666+0000","last_peered":"2024-04-26T07:48:48.224666+0000","last_clean":"2024-04-26T07:48:48.224666+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:48:48.224666+0000","last_undegraded":"2024-04-26T07:48:48.224666+0000","last_fullsized":"2024-04-26T07:48:48.224666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780206+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:48:47.780206+0000","last_peered":"2024-04-26T07:48:47.780206+0000","last_clean":"2024-04-26T07:48:47.780206+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:48:47.780206+0000","last_undegraded":"2024-04-26T07:48:47.780206+0000","last_fullsized":"2024-04-26T07:48:47.780206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421440+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:48:48.421440+0000","last_peered":"2024-04-26T07:48:48.421440+0000","last_clean":"2024-04-26T07:48:48.421440+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:48:48.421440+0000","last_undegraded":"2024-04-26T07:48:48.421440+0000","last_fullsized":"2024-04-26T07:48:48.421440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219119+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:48:48.219119+0000","last_peered":"2024-04-26T07:48:48.219119+0000","last_clean":"2024-04-26T07:48:48.219119+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:48:48.219119+0000","last_undegraded":"2024-04-26T07:48:48.219119+0000","last_fullsized":"2024-04-26T07:48:48.219119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560935+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:48:47.560935+0000","last_peered":"2024-04-26T07:48:47.560935+0000","last_clean":"2024-04-26T07:48:47.560935+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:48:47.560935+0000","last_undegraded":"2024-04-26T07:48:47.560935+0000","last_fullsized":"2024-04-26T07:48:47.560935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225700+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:48:48.225700+0000","last_peered":"2024-04-26T07:48:48.225700+0000","last_clean":"2024-04-26T07:48:48.225700+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:48:48.225700+0000","last_undegraded":"2024-04-26T07:48:48.225700+0000","last_fullsized":"2024-04-26T07:48:48.225700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581583+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:48:48.581583+0000","last_peered":"2024-04-26T07:48:48.581583+0000","last_clean":"2024-04-26T07:48:48.581583+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:48:48.581583+0000","last_undegraded":"2024-04-26T07:48:48.581583+0000","last_fullsized":"2024-04-26T07:48:48.581583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420538+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:48:48.420538+0000","last_peered":"2024-04-26T07:48:48.420538+0000","last_clean":"2024-04-26T07:48:48.420538+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:48:48.420538+0000","last_undegraded":"2024-04-26T07:48:48.420538+0000","last_fullsized":"2024-04-26T07:48:48.420538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.779973+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:48:47.779973+0000","last_peered":"2024-04-26T07:48:47.779973+0000","last_clean":"2024-04-26T07:48:47.779973+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:48:47.779973+0000","last_undegraded":"2024-04-26T07:48:47.779973+0000","last_fullsized":"2024-04-26T07:48:47.779973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422573+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:48:48.422573+0000","last_peered":"2024-04-26T07:48:48.422573+0000","last_clean":"2024-04-26T07:48:48.422573+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:48:48.422573+0000","last_undegraded":"2024-04-26T07:48:48.422573+0000","last_fullsized":"2024-04-26T07:48:48.422573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781557+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:48:47.781557+0000","last_peered":"2024-04-26T07:48:47.781557+0000","last_clean":"2024-04-26T07:48:47.781557+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:48:47.781557+0000","last_undegraded":"2024-04-26T07:48:47.781557+0000","last_fullsized":"2024-04-26T07:48:47.781557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561824+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:48:47.561824+0000","last_peered":"2024-04-26T07:48:47.561824+0000","last_clean":"2024-04-26T07:48:47.561824+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:48:47.561824+0000","last_undegraded":"2024-04-26T07:48:47.561824+0000","last_fullsized":"2024-04-26T07:48:47.561824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561336+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:48:47.561336+0000","last_peered":"2024-04-26T07:48:47.561336+0000","last_clean":"2024-04-26T07:48:47.561336+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:48:47.561336+0000","last_undegraded":"2024-04-26T07:48:47.561336+0000","last_fullsized":"2024-04-26T07:48:47.561336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218110+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:48:48.218110+0000","last_peered":"2024-04-26T07:48:48.218110+0000","last_clean":"2024-04-26T07:48:48.218110+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:48:48.218110+0000","last_undegraded":"2024-04-26T07:48:48.218110+0000","last_fullsized":"2024-04-26T07:48:48.218110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563689+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:48:47.563689+0000","last_peered":"2024-04-26T07:48:47.563689+0000","last_clean":"2024-04-26T07:48:47.563689+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:48:47.563689+0000","last_undegraded":"2024-04-26T07:48:47.563689+0000","last_fullsized":"2024-04-26T07:48:47.563689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559694+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:48:47.559694+0000","last_peered":"2024-04-26T07:48:47.559694+0000","last_clean":"2024-04-26T07:48:47.559694+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:48:47.559694+0000","last_undegraded":"2024-04-26T07:48:47.559694+0000","last_fullsized":"2024-04-26T07:48:47.559694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781525+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:48:47.781525+0000","last_peered":"2024-04-26T07:48:47.781525+0000","last_clean":"2024-04-26T07:48:47.781525+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:48:47.781525+0000","last_undegraded":"2024-04-26T07:48:47.781525+0000","last_fullsized":"2024-04-26T07:48:47.781525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523686+0000","last_change":"2024-04-26T07:48:15.517260+0000","last_active":"2024-04-26T07:48:47.523686+0000","last_peered":"2024-04-26T07:48:47.523686+0000","last_clean":"2024-04-26T07:48:47.523686+0000","last_became_active":"2024-04-26T07:48:15.516567+0000","last_became_peered":"2024-04-26T07:48:15.516567+0000","last_unstale":"2024-04-26T07:48:47.523686+0000","last_undegraded":"2024-04-26T07:48:47.523686+0000","last_fullsized":"2024-04-26T07:48:47.523686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:31.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580552+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:48:48.580552+0000","last_peered":"2024-04-26T07:48:48.580552+0000","last_clean":"2024-04-26T07:48:48.580552+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:48:48.580552+0000","last_undegraded":"2024-04-26T07:48:48.580552+0000","last_fullsized":"2024-04-26T07:48:48.580552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781308+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:48:47.781308+0000","last_peered":"2024-04-26T07:48:47.781308+0000","last_clean":"2024-04-26T07:48:47.781308+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:48:47.781308+0000","last_undegraded":"2024-04-26T07:48:47.781308+0000","last_fullsized":"2024-04-26T07:48:47.781308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420694+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:48:48.420694+0000","last_peered":"2024-04-26T07:48:48.420694+0000","last_clean":"2024-04-26T07:48:48.420694+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:48:48.420694+0000","last_undegraded":"2024-04-26T07:48:48.420694+0000","last_fullsized":"2024-04-26T07:48:48.420694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225979+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:48:48.225979+0000","last_peered":"2024-04-26T07:48:48.225979+0000","last_clean":"2024-04-26T07:48:48.225979+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:48:48.225979+0000","last_undegraded":"2024-04-26T07:48:48.225979+0000","last_fullsized":"2024-04-26T07:48:48.225979+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220328+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:48:48.220328+0000","last_peered":"2024-04-26T07:48:48.220328+0000","last_clean":"2024-04-26T07:48:48.220328+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:48:48.220328+0000","last_undegraded":"2024-04-26T07:48:48.220328+0000","last_fullsized":"2024-04-26T07:48:48.220328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225759+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:48:48.225759+0000","last_peered":"2024-04-26T07:48:48.225759+0000","last_clean":"2024-04-26T07:48:48.225759+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:48:48.225759+0000","last_undegraded":"2024-04-26T07:48:48.225759+0000","last_fullsized":"2024-04-26T07:48:48.225759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780414+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:48:47.780414+0000","last_peered":"2024-04-26T07:48:47.780414+0000","last_clean":"2024-04-26T07:48:47.780414+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:48:47.780414+0000","last_undegraded":"2024-04-26T07:48:47.780414+0000","last_fullsized":"2024-04-26T07:48:47.780414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218413+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:48:48.218413+0000","last_peered":"2024-04-26T07:48:48.218413+0000","last_clean":"2024-04-26T07:48:48.218413+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:48:48.218413+0000","last_undegraded":"2024-04-26T07:48:48.218413+0000","last_fullsized":"2024-04-26T07:48:48.218413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218681+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:48:48.218681+0000","last_peered":"2024-04-26T07:48:48.218681+0000","last_clean":"2024-04-26T07:48:48.218681+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:48:48.218681+0000","last_undegraded":"2024-04-26T07:48:48.218681+0000","last_fullsized":"2024-04-26T07:48:48.218681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225812+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:48:48.225812+0000","last_peered":"2024-04-26T07:48:48.225812+0000","last_clean":"2024-04-26T07:48:48.225812+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:48:48.225812+0000","last_undegraded":"2024-04-26T07:48:48.225812+0000","last_fullsized":"2024-04-26T07:48:48.225812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561536+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:48:47.561536+0000","last_peered":"2024-04-26T07:48:47.561536+0000","last_clean":"2024-04-26T07:48:47.561536+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:48:47.561536+0000","last_undegraded":"2024-04-26T07:48:47.561536+0000","last_fullsized":"2024-04-26T07:48:47.561536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217383+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:48:48.217383+0000","last_peered":"2024-04-26T07:48:48.217383+0000","last_clean":"2024-04-26T07:48:48.217383+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:48:48.217383+0000","last_undegraded":"2024-04-26T07:48:48.217383+0000","last_fullsized":"2024-04-26T07:48:48.217383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564396+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:48:47.564396+0000","last_peered":"2024-04-26T07:48:47.564396+0000","last_clean":"2024-04-26T07:48:47.564396+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:48:47.564396+0000","last_undegraded":"2024-04-26T07:48:47.564396+0000","last_fullsized":"2024-04-26T07:48:47.564396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581983+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:48:48.581983+0000","last_peered":"2024-04-26T07:48:48.581983+0000","last_clean":"2024-04-26T07:48:48.581983+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:48:48.581983+0000","last_undegraded":"2024-04-26T07:48:48.581983+0000","last_fullsized":"2024-04-26T07:48:48.581983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220184+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:48:48.220184+0000","last_peered":"2024-04-26T07:48:48.220184+0000","last_clean":"2024-04-26T07:48:48.220184+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:48:48.220184+0000","last_undegraded":"2024-04-26T07:48:48.220184+0000","last_fullsized":"2024-04-26T07:48:48.220184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521597+0000","last_change":"2024-04-26T07:48:27.655376+0000","last_active":"2024-04-26T07:48:47.521597+0000","last_peered":"2024-04-26T07:48:47.521597+0000","last_clean":"2024-04-26T07:48:47.521597+0000","last_became_active":"2024-04-26T07:48:27.654669+0000","last_became_peered":"2024-04-26T07:48:27.654669+0000","last_unstale":"2024-04-26T07:48:47.521597+0000","last_undegraded":"2024-04-26T07:48:47.521597+0000","last_fullsized":"2024-04-26T07:48:47.521597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220860+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:48:48.220860+0000","last_peered":"2024-04-26T07:48:48.220860+0000","last_clean":"2024-04-26T07:48:48.220860+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:48:48.220860+0000","last_undegraded":"2024-04-26T07:48:48.220860+0000","last_fullsized":"2024-04-26T07:48:48.220860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421855+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:48:48.421855+0000","last_peered":"2024-04-26T07:48:48.421855+0000","last_clean":"2024-04-26T07:48:48.421855+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:48:48.421855+0000","last_undegraded":"2024-04-26T07:48:48.421855+0000","last_fullsized":"2024-04-26T07:48:48.421855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563834+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:48:47.563834+0000","last_peered":"2024-04-26T07:48:47.563834+0000","last_clean":"2024-04-26T07:48:47.563834+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:48:47.563834+0000","last_undegraded":"2024-04-26T07:48:47.563834+0000","last_fullsized":"2024-04-26T07:48:47.563834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216998+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:48:48.216998+0000","last_peered":"2024-04-26T07:48:48.216998+0000","last_clean":"2024-04-26T07:48:48.216998+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:48:48.216998+0000","last_undegraded":"2024-04-26T07:48:48.216998+0000","last_fullsized":"2024-04-26T07:48:48.216998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219173+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:48:48.219173+0000","last_peered":"2024-04-26T07:48:48.219173+0000","last_clean":"2024-04-26T07:48:48.219173+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:48:48.219173+0000","last_undegraded":"2024-04-26T07:48:48.219173+0000","last_fullsized":"2024-04-26T07:48:48.219173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781169+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:48:47.781169+0000","last_peered":"2024-04-26T07:48:47.781169+0000","last_clean":"2024-04-26T07:48:47.781169+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:48:47.781169+0000","last_undegraded":"2024-04-26T07:48:47.781169+0000","last_fullsized":"2024-04-26T07:48:47.781169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221980+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:48:48.221980+0000","last_peered":"2024-04-26T07:48:48.221980+0000","last_clean":"2024-04-26T07:48:48.221980+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:48:48.221980+0000","last_undegraded":"2024-04-26T07:48:48.221980+0000","last_fullsized":"2024-04-26T07:48:48.221980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220078+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:48:48.220078+0000","last_peered":"2024-04-26T07:48:48.220078+0000","last_clean":"2024-04-26T07:48:48.220078+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:48:48.220078+0000","last_undegraded":"2024-04-26T07:48:48.220078+0000","last_fullsized":"2024-04-26T07:48:48.220078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225475+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:48:48.225475+0000","last_peered":"2024-04-26T07:48:48.225475+0000","last_clean":"2024-04-26T07:48:48.225475+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:48:48.225475+0000","last_undegraded":"2024-04-26T07:48:48.225475+0000","last_fullsized":"2024-04-26T07:48:48.225475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780159+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:48:47.780159+0000","last_peered":"2024-04-26T07:48:47.780159+0000","last_clean":"2024-04-26T07:48:47.780159+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:48:47.780159+0000","last_undegraded":"2024-04-26T07:48:47.780159+0000","last_fullsized":"2024-04-26T07:48:47.780159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523135+0000","last_change":"2024-04-26T07:48:21.522429+0000","last_active":"2024-04-26T07:48:47.523135+0000","last_peered":"2024-04-26T07:48:47.523135+0000","last_clean":"2024-04-26T07:48:47.523135+0000","last_became_active":"2024-04-26T07:48:21.521246+0000","last_became_peered":"2024-04-26T07:48:21.521246+0000","last_unstale":"2024-04-26T07:48:47.523135+0000","last_undegraded":"2024-04-26T07:48:47.523135+0000","last_fullsized":"2024-04-26T07:48:47.523135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225015+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:48:48.225015+0000","last_peered":"2024-04-26T07:48:48.225015+0000","last_clean":"2024-04-26T07:48:48.225015+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:48:48.225015+0000","last_undegraded":"2024-04-26T07:48:48.225015+0000","last_fullsized":"2024-04-26T07:48:48.225015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'4","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561121+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:48:47.561121+0000","last_peered":"2024-04-26T07:48:47.561121+0000","last_clean":"2024-04-26T07:48:47.561121+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:48:47.561121+0000","last_undegraded":"2024-04-26T07:48:47.561121+0000","last_fullsized":"2024-04-26T07:48:47.561121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521305+0000","last_change":"2024-04-26T07:48:29.582765+0000","last_active":"2024-04-26T07:48:47.521305+0000","last_peered":"2024-04-26T07:48:47.521305+0000","last_clean":"2024-04-26T07:48:47.521305+0000","last_became_active":"2024-04-26T07:48:29.581836+0000","last_became_peered":"2024-04-26T07:48:29.581836+0000","last_unstale":"2024-04-26T07:48:47.521305+0000","last_undegraded":"2024-04-26T07:48:47.521305+0000","last_fullsized":"2024-04-26T07:48:47.521305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560834+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:48:47.560834+0000","last_peered":"2024-04-26T07:48:47.560834+0000","last_clean":"2024-04-26T07:48:47.560834+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:48:47.560834+0000","last_undegraded":"2024-04-26T07:48:47.560834+0000","last_fullsized":"2024-04-26T07:48:47.560834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223029+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:48:48.223029+0000","last_peered":"2024-04-26T07:48:48.223029+0000","last_clean":"2024-04-26T07:48:48.223029+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:48:48.223029+0000","last_undegraded":"2024-04-26T07:48:48.223029+0000","last_fullsized":"2024-04-26T07:48:48.223029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422422+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:48:48.422422+0000","last_peered":"2024-04-26T07:48:48.422422+0000","last_clean":"2024-04-26T07:48:48.422422+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:48:48.422422+0000","last_undegraded":"2024-04-26T07:48:48.422422+0000","last_fullsized":"2024-04-26T07:48:48.422422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.520911+0000","last_change":"2024-04-26T07:48:25.575678+0000","last_active":"2024-04-26T07:48:47.520911+0000","last_peered":"2024-04-26T07:48:47.520911+0000","last_clean":"2024-04-26T07:48:47.520911+0000","last_became_active":"2024-04-26T07:48:25.574985+0000","last_became_peered":"2024-04-26T07:48:25.574985+0000","last_unstale":"2024-04-26T07:48:47.520911+0000","last_undegraded":"2024-04-26T07:48:47.520911+0000","last_fullsized":"2024-04-26T07:48:47.520911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224176+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:48:48.224176+0000","last_peered":"2024-04-26T07:48:48.224176+0000","last_clean":"2024-04-26T07:48:48.224176+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:48:48.224176+0000","last_undegraded":"2024-04-26T07:48:48.224176+0000","last_fullsized":"2024-04-26T07:48:48.224176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580569+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:48:48.580569+0000","last_peered":"2024-04-26T07:48:48.580569+0000","last_clean":"2024-04-26T07:48:48.580569+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:48:48.580569+0000","last_undegraded":"2024-04-26T07:48:48.580569+0000","last_fullsized":"2024-04-26T07:48:48.580569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421523+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:48:48.421523+0000","last_peered":"2024-04-26T07:48:48.421523+0000","last_clean":"2024-04-26T07:48:48.421523+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:48:48.421523+0000","last_undegraded":"2024-04-26T07:48:48.421523+0000","last_fullsized":"2024-04-26T07:48:48.421523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220455+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:48:48.220455+0000","last_peered":"2024-04-26T07:48:48.220455+0000","last_clean":"2024-04-26T07:48:48.220455+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:48:48.220455+0000","last_undegraded":"2024-04-26T07:48:48.220455+0000","last_fullsized":"2024-04-26T07:48:48.220455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564209+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:48:47.564209+0000","last_peered":"2024-04-26T07:48:47.564209+0000","last_clean":"2024-04-26T07:48:47.564209+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:48:47.564209+0000","last_undegraded":"2024-04-26T07:48:47.564209+0000","last_fullsized":"2024-04-26T07:48:47.564209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580891+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:48:48.580891+0000","last_peered":"2024-04-26T07:48:48.580891+0000","last_clean":"2024-04-26T07:48:48.580891+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:48:48.580891+0000","last_undegraded":"2024-04-26T07:48:48.580891+0000","last_fullsized":"2024-04-26T07:48:48.580891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521577+0000","last_change":"2024-04-26T07:48:27.575530+0000","last_active":"2024-04-26T07:48:47.521577+0000","last_peered":"2024-04-26T07:48:47.521577+0000","last_clean":"2024-04-26T07:48:47.521577+0000","last_became_active":"2024-04-26T07:48:27.574659+0000","last_became_peered":"2024-04-26T07:48:27.574659+0000","last_unstale":"2024-04-26T07:48:47.521577+0000","last_undegraded":"2024-04-26T07:48:47.521577+0000","last_fullsized":"2024-04-26T07:48:47.521577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561663+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:48:47.561663+0000","last_peered":"2024-04-26T07:48:47.561663+0000","last_clean":"2024-04-26T07:48:47.561663+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:48:47.561663+0000","last_undegraded":"2024-04-26T07:48:47.561663+0000","last_fullsized":"2024-04-26T07:48:47.561663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581854+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:48:48.581854+0000","last_peered":"2024-04-26T07:48:48.581854+0000","last_clean":"2024-04-26T07:48:48.581854+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:48:48.581854+0000","last_undegraded":"2024-04-26T07:48:48.581854+0000","last_fullsized":"2024-04-26T07:48:48.581854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220611+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:48:48.220611+0000","last_peered":"2024-04-26T07:48:48.220611+0000","last_clean":"2024-04-26T07:48:48.220611+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:48:48.220611+0000","last_undegraded":"2024-04-26T07:48:48.220611+0000","last_fullsized":"2024-04-26T07:48:48.220611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564246+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:48:47.564246+0000","last_peered":"2024-04-26T07:48:47.564246+0000","last_clean":"2024-04-26T07:48:47.564246+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:48:47.564246+0000","last_undegraded":"2024-04-26T07:48:47.564246+0000","last_fullsized":"2024-04-26T07:48:47.564246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781504+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:48:47.781504+0000","last_peered":"2024-04-26T07:48:47.781504+0000","last_clean":"2024-04-26T07:48:47.781504+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:48:47.781504+0000","last_undegraded":"2024-04-26T07:48:47.781504+0000","last_fullsized":"2024-04-26T07:48:47.781504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421702+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:48:48.421702+0000","last_peered":"2024-04-26T07:48:48.421702+0000","last_clean":"2024-04-26T07:48:48.421702+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:48:48.421702+0000","last_undegraded":"2024-04-26T07:48:48.421702+0000","last_fullsized":"2024-04-26T07:48:48.421702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219892+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:48:48.219892+0000","last_peered":"2024-04-26T07:48:48.219892+0000","last_clean":"2024-04-26T07:48:48.219892+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:48:48.219892+0000","last_undegraded":"2024-04-26T07:48:48.219892+0000","last_fullsized":"2024-04-26T07:48:48.219892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559861+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:48:47.559861+0000","last_peered":"2024-04-26T07:48:47.559861+0000","last_clean":"2024-04-26T07:48:47.559861+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:48:47.559861+0000","last_undegraded":"2024-04-26T07:48:47.559861+0000","last_fullsized":"2024-04-26T07:48:47.559861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781841+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:48:47.781841+0000","last_peered":"2024-04-26T07:48:47.781841+0000","last_clean":"2024-04-26T07:48:47.781841+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:48:47.781841+0000","last_undegraded":"2024-04-26T07:48:47.781841+0000","last_fullsized":"2024-04-26T07:48:47.781841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581638+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:48:48.581638+0000","last_peered":"2024-04-26T07:48:48.581638+0000","last_clean":"2024-04-26T07:48:48.581638+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:48:48.581638+0000","last_undegraded":"2024-04-26T07:48:48.581638+0000","last_fullsized":"2024-04-26T07:48:48.581638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522129+0000","last_change":"2024-04-26T07:48:27.578601+0000","last_active":"2024-04-26T07:48:47.522129+0000","last_peered":"2024-04-26T07:48:47.522129+0000","last_clean":"2024-04-26T07:48:47.522129+0000","last_became_active":"2024-04-26T07:48:27.577870+0000","last_became_peered":"2024-04-26T07:48:27.577870+0000","last_unstale":"2024-04-26T07:48:47.522129+0000","last_undegraded":"2024-04-26T07:48:47.522129+0000","last_fullsized":"2024-04-26T07:48:47.522129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781671+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:48:47.781671+0000","last_peered":"2024-04-26T07:48:47.781671+0000","last_clean":"2024-04-26T07:48:47.781671+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:48:47.781671+0000","last_undegraded":"2024-04-26T07:48:47.781671+0000","last_fullsized":"2024-04-26T07:48:47.781671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580388+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:48:48.580388+0000","last_peered":"2024-04-26T07:48:48.580388+0000","last_clean":"2024-04-26T07:48:48.580388+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:48:48.580388+0000","last_undegraded":"2024-04-26T07:48:48.580388+0000","last_fullsized":"2024-04-26T07:48:48.580388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225793+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:48:48.225793+0000","last_peered":"2024-04-26T07:48:48.225793+0000","last_clean":"2024-04-26T07:48:48.225793+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:48:48.225793+0000","last_undegraded":"2024-04-26T07:48:48.225793+0000","last_fullsized":"2024-04-26T07:48:48.225793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218974+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:48:48.218974+0000","last_peered":"2024-04-26T07:48:48.218974+0000","last_clean":"2024-04-26T07:48:48.218974+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:48:48.218974+0000","last_undegraded":"2024-04-26T07:48:48.218974+0000","last_fullsized":"2024-04-26T07:48:48.218974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219853+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:48:48.219853+0000","last_peered":"2024-04-26T07:48:48.219853+0000","last_clean":"2024-04-26T07:48:48.219853+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:48:48.219853+0000","last_undegraded":"2024-04-26T07:48:48.219853+0000","last_fullsized":"2024-04-26T07:48:48.219853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226120+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:48:48.226120+0000","last_peered":"2024-04-26T07:48:48.226120+0000","last_clean":"2024-04-26T07:48:48.226120+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:48:48.226120+0000","last_undegraded":"2024-04-26T07:48:48.226120+0000","last_fullsized":"2024-04-26T07:48:48.226120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781903+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:48:47.781903+0000","last_peered":"2024-04-26T07:48:47.781903+0000","last_clean":"2024-04-26T07:48:47.781903+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:48:47.781903+0000","last_undegraded":"2024-04-26T07:48:47.781903+0000","last_fullsized":"2024-04-26T07:48:47.781903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420933+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:48:48.420933+0000","last_peered":"2024-04-26T07:48:48.420933+0000","last_clean":"2024-04-26T07:48:48.420933+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:48:48.420933+0000","last_undegraded":"2024-04-26T07:48:48.420933+0000","last_fullsized":"2024-04-26T07:48:48.420933+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221787+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:48:48.221787+0000","last_peered":"2024-04-26T07:48:48.221787+0000","last_clean":"2024-04-26T07:48:48.221787+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:48:48.221787+0000","last_undegraded":"2024-04-26T07:48:48.221787+0000","last_fullsized":"2024-04-26T07:48:48.221787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561703+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:48:47.561703+0000","last_peered":"2024-04-26T07:48:47.561703+0000","last_clean":"2024-04-26T07:48:47.561703+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:48:47.561703+0000","last_undegraded":"2024-04-26T07:48:47.561703+0000","last_fullsized":"2024-04-26T07:48:47.561703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781824+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:48:47.781824+0000","last_peered":"2024-04-26T07:48:47.781824+0000","last_clean":"2024-04-26T07:48:47.781824+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:48:47.781824+0000","last_undegraded":"2024-04-26T07:48:47.781824+0000","last_fullsized":"2024-04-26T07:48:47.781824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219878+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:48:48.219878+0000","last_peered":"2024-04-26T07:48:48.219878+0000","last_clean":"2024-04-26T07:48:48.219878+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:48:48.219878+0000","last_undegraded":"2024-04-26T07:48:48.219878+0000","last_fullsized":"2024-04-26T07:48:48.219878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581144+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:48:48.581144+0000","last_peered":"2024-04-26T07:48:48.581144+0000","last_clean":"2024-04-26T07:48:48.581144+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:48:48.581144+0000","last_undegraded":"2024-04-26T07:48:48.581144+0000","last_fullsized":"2024-04-26T07:48:48.581144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.520862+0000","last_change":"2024-04-26T07:48:31.605556+0000","last_active":"2024-04-26T07:48:47.520862+0000","last_peered":"2024-04-26T07:48:47.520862+0000","last_clean":"2024-04-26T07:48:47.520862+0000","last_became_active":"2024-04-26T07:48:31.604886+0000","last_became_peered":"2024-04-26T07:48:31.604886+0000","last_unstale":"2024-04-26T07:48:47.520862+0000","last_undegraded":"2024-04-26T07:48:47.520862+0000","last_fullsized":"2024-04-26T07:48:47.520862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217537+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:48:48.217537+0000","last_peered":"2024-04-26T07:48:48.217537+0000","last_clean":"2024-04-26T07:48:48.217537+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:48:48.217537+0000","last_undegraded":"2024-04-26T07:48:48.217537+0000","last_fullsized":"2024-04-26T07:48:48.217537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421869+0000","last_change":"2024-04-26T07:48:21.523345+0000","last_active":"2024-04-26T07:48:48.421869+0000","last_peered":"2024-04-26T07:48:48.421869+0000","last_clean":"2024-04-26T07:48:48.421869+0000","last_became_active":"2024-04-26T07:48:21.521160+0000","last_became_peered":"2024-04-26T07:48:21.521160+0000","last_unstale":"2024-04-26T07:48:48.421869+0000","last_undegraded":"2024-04-26T07:48:48.421869+0000","last_fullsized":"2024-04-26T07:48:48.421869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521831+0000","last_change":"2024-04-26T07:48:25.576286+0000","last_active":"2024-04-26T07:48:47.521831+0000","last_peered":"2024-04-26T07:48:47.521831+0000","last_clean":"2024-04-26T07:48:47.521831+0000","last_became_active":"2024-04-26T07:48:25.575505+0000","last_became_peered":"2024-04-26T07:48:25.575505+0000","last_unstale":"2024-04-26T07:48:47.521831+0000","last_undegraded":"2024-04-26T07:48:47.521831+0000","last_fullsized":"2024-04-26T07:48:47.521831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421124+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:48:48.421124+0000","last_peered":"2024-04-26T07:48:48.421124+0000","last_clean":"2024-04-26T07:48:48.421124+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:48:48.421124+0000","last_undegraded":"2024-04-26T07:48:48.421124+0000","last_fullsized":"2024-04-26T07:48:48.421124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560163+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:48:47.560163+0000","last_peered":"2024-04-26T07:48:47.560163+0000","last_clean":"2024-04-26T07:48:47.560163+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:48:47.560163+0000","last_undegraded":"2024-04-26T07:48:47.560163+0000","last_fullsized":"2024-04-26T07:48:47.560163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523466+0000","last_change":"2024-04-26T07:48:31.598704+0000","last_active":"2024-04-26T07:48:47.523466+0000","last_peered":"2024-04-26T07:48:47.523466+0000","last_clean":"2024-04-26T07:48:47.523466+0000","last_became_active":"2024-04-26T07:48:31.597882+0000","last_became_peered":"2024-04-26T07:48:31.597882+0000","last_unstale":"2024-04-26T07:48:47.523466+0000","last_undegraded":"2024-04-26T07:48:47.523466+0000","last_fullsized":"2024-04-26T07:48:47.523466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217112+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:48:48.217112+0000","last_peered":"2024-04-26T07:48:48.217112+0000","last_clean":"2024-04-26T07:48:48.217112+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:48:48.217112+0000","last_undegraded":"2024-04-26T07:48:48.217112+0000","last_fullsized":"2024-04-26T07:48:48.217112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422501+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:48:48.422501+0000","last_peered":"2024-04-26T07:48:48.422501+0000","last_clean":"2024-04-26T07:48:48.422501+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:48:48.422501+0000","last_undegraded":"2024-04-26T07:48:48.422501+0000","last_fullsized":"2024-04-26T07:48:48.422501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421357+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:48:48.421357+0000","last_peered":"2024-04-26T07:48:48.421357+0000","last_clean":"2024-04-26T07:48:48.421357+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:48:48.421357+0000","last_undegraded":"2024-04-26T07:48:48.421357+0000","last_fullsized":"2024-04-26T07:48:48.421357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560444+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:48:47.560444+0000","last_peered":"2024-04-26T07:48:47.560444+0000","last_clean":"2024-04-26T07:48:47.560444+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:48:47.560444+0000","last_undegraded":"2024-04-26T07:48:47.560444+0000","last_fullsized":"2024-04-26T07:48:47.560444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580520+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:48:48.580520+0000","last_peered":"2024-04-26T07:48:48.580520+0000","last_clean":"2024-04-26T07:48:48.580520+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:48:48.580520+0000","last_undegraded":"2024-04-26T07:48:48.580520+0000","last_fullsized":"2024-04-26T07:48:48.580520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225548+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:48:48.225548+0000","last_peered":"2024-04-26T07:48:48.225548+0000","last_clean":"2024-04-26T07:48:48.225548+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:48:48.225548+0000","last_undegraded":"2024-04-26T07:48:48.225548+0000","last_fullsized":"2024-04-26T07:48:48.225548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223401+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:48:48.223401+0000","last_peered":"2024-04-26T07:48:48.223401+0000","last_clean":"2024-04-26T07:48:48.223401+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:48:48.223401+0000","last_undegraded":"2024-04-26T07:48:48.223401+0000","last_fullsized":"2024-04-26T07:48:48.223401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225814+0000","last_change":"2024-04-26T07:48:21.503786+0000","last_active":"2024-04-26T07:48:48.225814+0000","last_peered":"2024-04-26T07:48:48.225814+0000","last_clean":"2024-04-26T07:48:48.225814+0000","last_became_active":"2024-04-26T07:48:21.503422+0000","last_became_peered":"2024-04-26T07:48:21.503422+0000","last_unstale":"2024-04-26T07:48:48.225814+0000","last_undegraded":"2024-04-26T07:48:48.225814+0000","last_fullsized":"2024-04-26T07:48:48.225814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217954+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:48:48.217954+0000","last_peered":"2024-04-26T07:48:48.217954+0000","last_clean":"2024-04-26T07:48:48.217954+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:48:48.217954+0000","last_undegraded":"2024-04-26T07:48:48.217954+0000","last_fullsized":"2024-04-26T07:48:48.217954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225592+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:48:48.225592+0000","last_peered":"2024-04-26T07:48:48.225592+0000","last_clean":"2024-04-26T07:48:48.225592+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:48:48.225592+0000","last_undegraded":"2024-04-26T07:48:48.225592+0000","last_fullsized":"2024-04-26T07:48:48.225592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218107+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:48:48.218107+0000","last_peered":"2024-04-26T07:48:48.218107+0000","last_clean":"2024-04-26T07:48:48.218107+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:48:48.218107+0000","last_undegraded":"2024-04-26T07:48:48.218107+0000","last_fullsized":"2024-04-26T07:48:48.218107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522599+0000","last_change":"2024-04-26T07:48:31.591594+0000","last_active":"2024-04-26T07:48:47.522599+0000","last_peered":"2024-04-26T07:48:47.522599+0000","last_clean":"2024-04-26T07:48:47.522599+0000","last_became_active":"2024-04-26T07:48:31.590889+0000","last_became_peered":"2024-04-26T07:48:31.590889+0000","last_unstale":"2024-04-26T07:48:47.522599+0000","last_undegraded":"2024-04-26T07:48:47.522599+0000","last_fullsized":"2024-04-26T07:48:47.522599+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216928+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:48:48.216928+0000","last_peered":"2024-04-26T07:48:48.216928+0000","last_clean":"2024-04-26T07:48:48.216928+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:48:48.216928+0000","last_undegraded":"2024-04-26T07:48:48.216928+0000","last_fullsized":"2024-04-26T07:48:48.216928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564045+0000","last_change":"2024-04-26T07:48:21.506013+0000","last_active":"2024-04-26T07:48:47.564045+0000","last_peered":"2024-04-26T07:48:47.564045+0000","last_clean":"2024-04-26T07:48:47.564045+0000","last_became_active":"2024-04-26T07:48:21.505104+0000","last_became_peered":"2024-04-26T07:48:21.505104+0000","last_unstale":"2024-04-26T07:48:47.564045+0000","last_undegraded":"2024-04-26T07:48:47.564045+0000","last_fullsized":"2024-04-26T07:48:47.564045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781418+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:48:47.781418+0000","last_peered":"2024-04-26T07:48:47.781418+0000","last_clean":"2024-04-26T07:48:47.781418+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:48:47.781418+0000","last_undegraded":"2024-04-26T07:48:47.781418+0000","last_fullsized":"2024-04-26T07:48:47.781418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218297+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:48:48.218297+0000","last_peered":"2024-04-26T07:48:48.218297+0000","last_clean":"2024-04-26T07:48:48.218297+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:48:48.218297+0000","last_undegraded":"2024-04-26T07:48:48.218297+0000","last_fullsized":"2024-04-26T07:48:48.218297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561608+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:48:47.561608+0000","last_peered":"2024-04-26T07:48:47.561608+0000","last_clean":"2024-04-26T07:48:47.561608+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:48:47.561608+0000","last_undegraded":"2024-04-26T07:48:47.561608+0000","last_fullsized":"2024-04-26T07:48:47.561608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217300+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:48:48.217300+0000","last_peered":"2024-04-26T07:48:48.217300+0000","last_clean":"2024-04-26T07:48:48.217300+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:48:48.217300+0000","last_undegraded":"2024-04-26T07:48:48.217300+0000","last_fullsized":"2024-04-26T07:48:48.217300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780758+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:48:47.780758+0000","last_peered":"2024-04-26T07:48:47.780758+0000","last_clean":"2024-04-26T07:48:47.780758+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:48:47.780758+0000","last_undegraded":"2024-04-26T07:48:47.780758+0000","last_fullsized":"2024-04-26T07:48:47.780758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580366+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:48:48.580366+0000","last_peered":"2024-04-26T07:48:48.580366+0000","last_clean":"2024-04-26T07:48:48.580366+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:48:48.580366+0000","last_undegraded":"2024-04-26T07:48:48.580366+0000","last_fullsized":"2024-04-26T07:48:48.580366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780572+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:48:47.780572+0000","last_peered":"2024-04-26T07:48:47.780572+0000","last_clean":"2024-04-26T07:48:47.780572+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:48:47.780572+0000","last_undegraded":"2024-04-26T07:48:47.780572+0000","last_fullsized":"2024-04-26T07:48:47.780572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219048+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:48:48.219048+0000","last_peered":"2024-04-26T07:48:48.219048+0000","last_clean":"2024-04-26T07:48:48.219048+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:48:48.219048+0000","last_undegraded":"2024-04-26T07:48:48.219048+0000","last_fullsized":"2024-04-26T07:48:48.219048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422101+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:48:48.422101+0000","last_peered":"2024-04-26T07:48:48.422101+0000","last_clean":"2024-04-26T07:48:48.422101+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:48:48.422101+0000","last_undegraded":"2024-04-26T07:48:48.422101+0000","last_fullsized":"2024-04-26T07:48:48.422101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421396+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:48:48.421396+0000","last_peered":"2024-04-26T07:48:48.421396+0000","last_clean":"2024-04-26T07:48:48.421396+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:48:48.421396+0000","last_undegraded":"2024-04-26T07:48:48.421396+0000","last_fullsized":"2024-04-26T07:48:48.421396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780001+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:48:47.780001+0000","last_peered":"2024-04-26T07:48:47.780001+0000","last_clean":"2024-04-26T07:48:47.780001+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:48:47.780001+0000","last_undegraded":"2024-04-26T07:48:47.780001+0000","last_fullsized":"2024-04-26T07:48:47.780001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561785+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:48:47.561785+0000","last_peered":"2024-04-26T07:48:47.561785+0000","last_clean":"2024-04-26T07:48:47.561785+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:48:47.561785+0000","last_undegraded":"2024-04-26T07:48:47.561785+0000","last_fullsized":"2024-04-26T07:48:47.561785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225243+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:48:48.225243+0000","last_peered":"2024-04-26T07:48:48.225243+0000","last_clean":"2024-04-26T07:48:48.225243+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:48:48.225243+0000","last_undegraded":"2024-04-26T07:48:48.225243+0000","last_fullsized":"2024-04-26T07:48:48.225243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226483+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:48:48.226483+0000","last_peered":"2024-04-26T07:48:48.226483+0000","last_clean":"2024-04-26T07:48:48.226483+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:48:48.226483+0000","last_undegraded":"2024-04-26T07:48:48.226483+0000","last_fullsized":"2024-04-26T07:48:48.226483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216813+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:48:48.216813+0000","last_peered":"2024-04-26T07:48:48.216813+0000","last_clean":"2024-04-26T07:48:48.216813+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:48:48.216813+0000","last_undegraded":"2024-04-26T07:48:48.216813+0000","last_fullsized":"2024-04-26T07:48:48.216813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.782020+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:48:47.782020+0000","last_peered":"2024-04-26T07:48:47.782020+0000","last_clean":"2024-04-26T07:48:47.782020+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:48:47.782020+0000","last_undegraded":"2024-04-26T07:48:47.782020+0000","last_fullsized":"2024-04-26T07:48:47.782020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222804+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:48:48.222804+0000","last_peered":"2024-04-26T07:48:48.222804+0000","last_clean":"2024-04-26T07:48:48.222804+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:48:48.222804+0000","last_undegraded":"2024-04-26T07:48:48.222804+0000","last_fullsized":"2024-04-26T07:48:48.222804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581758+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:48:48.581758+0000","last_peered":"2024-04-26T07:48:48.581758+0000","last_clean":"2024-04-26T07:48:48.581758+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:48:48.581758+0000","last_undegraded":"2024-04-26T07:48:48.581758+0000","last_fullsized":"2024-04-26T07:48:48.581758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580289+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:48:48.580289+0000","last_peered":"2024-04-26T07:48:48.580289+0000","last_clean":"2024-04-26T07:48:48.580289+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:48:48.580289+0000","last_undegraded":"2024-04-26T07:48:48.580289+0000","last_fullsized":"2024-04-26T07:48:48.580289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225956+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:48:48.225956+0000","last_peered":"2024-04-26T07:48:48.225956+0000","last_clean":"2024-04-26T07:48:48.225956+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:48:48.225956+0000","last_undegraded":"2024-04-26T07:48:48.225956+0000","last_fullsized":"2024-04-26T07:48:48.225956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559867+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:48:47.559867+0000","last_peered":"2024-04-26T07:48:47.559867+0000","last_clean":"2024-04-26T07:48:47.559867+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:48:47.559867+0000","last_undegraded":"2024-04-26T07:48:47.559867+0000","last_fullsized":"2024-04-26T07:48:47.559867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420926+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:48:48.420926+0000","last_peered":"2024-04-26T07:48:48.420926+0000","last_clean":"2024-04-26T07:48:48.420926+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:48:48.420926+0000","last_undegraded":"2024-04-26T07:48:48.420926+0000","last_fullsized":"2024-04-26T07:48:48.420926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218423+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:48:48.218423+0000","last_peered":"2024-04-26T07:48:48.218423+0000","last_clean":"2024-04-26T07:48:48.218423+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:48:48.218423+0000","last_undegraded":"2024-04-26T07:48:48.218423+0000","last_fullsized":"2024-04-26T07:48:48.218423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223626+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:48:48.223626+0000","last_peered":"2024-04-26T07:48:48.223626+0000","last_clean":"2024-04-26T07:48:48.223626+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:48:48.223626+0000","last_undegraded":"2024-04-26T07:48:48.223626+0000","last_fullsized":"2024-04-26T07:48:48.223626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220947+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:48:48.220947+0000","last_peered":"2024-04-26T07:48:48.220947+0000","last_clean":"2024-04-26T07:48:48.220947+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:48:48.220947+0000","last_undegraded":"2024-04-26T07:48:48.220947+0000","last_fullsized":"2024-04-26T07:48:48.220947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421286+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:48:48.421286+0000","last_peered":"2024-04-26T07:48:48.421286+0000","last_clean":"2024-04-26T07:48:48.421286+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:48:48.421286+0000","last_undegraded":"2024-04-26T07:48:48.421286+0000","last_fullsized":"2024-04-26T07:48:48.421286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217106+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:48:48.217106+0000","last_peered":"2024-04-26T07:48:48.217106+0000","last_clean":"2024-04-26T07:48:48.217106+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:48:48.217106+0000","last_undegraded":"2024-04-26T07:48:48.217106+0000","last_fullsized":"2024-04-26T07:48:48.217106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561863+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:48:47.561863+0000","last_peered":"2024-04-26T07:48:47.561863+0000","last_clean":"2024-04-26T07:48:47.561863+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:48:47.561863+0000","last_undegraded":"2024-04-26T07:48:47.561863+0000","last_fullsized":"2024-04-26T07:48:47.561863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522091+0000","last_change":"2024-04-26T07:48:23.552189+0000","last_active":"2024-04-26T07:48:47.522091+0000","last_peered":"2024-04-26T07:48:47.522091+0000","last_clean":"2024-04-26T07:48:47.522091+0000","last_became_active":"2024-04-26T07:48:23.547277+0000","last_became_peered":"2024-04-26T07:48:23.547277+0000","last_unstale":"2024-04-26T07:48:47.522091+0000","last_undegraded":"2024-04-26T07:48:47.522091+0000","last_fullsized":"2024-04-26T07:48:47.522091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581576+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:48:48.581576+0000","last_peered":"2024-04-26T07:48:48.581576+0000","last_clean":"2024-04-26T07:48:48.581576+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:48:48.581576+0000","last_undegraded":"2024-04-26T07:48:48.581576+0000","last_fullsized":"2024-04-26T07:48:48.581576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560498+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:48:47.560498+0000","last_peered":"2024-04-26T07:48:47.560498+0000","last_clean":"2024-04-26T07:48:47.560498+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:48:47.560498+0000","last_undegraded":"2024-04-26T07:48:47.560498+0000","last_fullsized":"2024-04-26T07:48:47.560498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523594+0000","last_change":"2024-04-26T07:48:21.521908+0000","last_active":"2024-04-26T07:48:47.523594+0000","last_peered":"2024-04-26T07:48:47.523594+0000","last_clean":"2024-04-26T07:48:47.523594+0000","last_became_active":"2024-04-26T07:48:21.520599+0000","last_became_peered":"2024-04-26T07:48:21.520599+0000","last_unstale":"2024-04-26T07:48:47.523594+0000","last_undegraded":"2024-04-26T07:48:47.523594+0000","last_fullsized":"2024-04-26T07:48:47.523594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222573+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:48:48.222573+0000","last_peered":"2024-04-26T07:48:48.222573+0000","last_clean":"2024-04-26T07:48:48.222573+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:48:48.222573+0000","last_undegraded":"2024-04-26T07:48:48.222573+0000","last_fullsized":"2024-04-26T07:48:48.222573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222379+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:48:48.222379+0000","last_peered":"2024-04-26T07:48:48.222379+0000","last_clean":"2024-04-26T07:48:48.222379+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:48:48.222379+0000","last_undegraded":"2024-04-26T07:48:48.222379+0000","last_fullsized":"2024-04-26T07:48:48.222379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521392+0000","last_change":"2024-04-26T07:48:23.557177+0000","last_active":"2024-04-26T07:48:47.521392+0000","last_peered":"2024-04-26T07:48:47.521392+0000","last_clean":"2024-04-26T07:48:47.521392+0000","last_became_active":"2024-04-26T07:48:23.556564+0000","last_became_peered":"2024-04-26T07:48:23.556564+0000","last_unstale":"2024-04-26T07:48:47.521392+0000","last_undegraded":"2024-04-26T07:48:47.521392+0000","last_fullsized":"2024-04-26T07:48:47.521392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422719+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:48:48.422719+0000","last_peered":"2024-04-26T07:48:48.422719+0000","last_clean":"2024-04-26T07:48:48.422719+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:48:48.422719+0000","last_undegraded":"2024-04-26T07:48:48.422719+0000","last_fullsized":"2024-04-26T07:48:48.422719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420840+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:48:48.420840+0000","last_peered":"2024-04-26T07:48:48.420840+0000","last_clean":"2024-04-26T07:48:48.420840+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:48:48.420840+0000","last_undegraded":"2024-04-26T07:48:48.420840+0000","last_fullsized":"2024-04-26T07:48:48.420840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559886+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:48:47.559886+0000","last_peered":"2024-04-26T07:48:47.559886+0000","last_clean":"2024-04-26T07:48:47.559886+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:48:47.559886+0000","last_undegraded":"2024-04-26T07:48:47.559886+0000","last_fullsized":"2024-04-26T07:48:47.559886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781741+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:48:47.781741+0000","last_peered":"2024-04-26T07:48:47.781741+0000","last_clean":"2024-04-26T07:48:47.781741+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:48:47.781741+0000","last_undegraded":"2024-04-26T07:48:47.781741+0000","last_fullsized":"2024-04-26T07:48:47.781741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422244+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:48:48.422244+0000","last_peered":"2024-04-26T07:48:48.422244+0000","last_clean":"2024-04-26T07:48:48.422244+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:48:48.422244+0000","last_undegraded":"2024-04-26T07:48:48.422244+0000","last_fullsized":"2024-04-26T07:48:48.422244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":787911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":196883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":205353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":204023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":206350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":196445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":450560,"data_stored":197569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":788310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:48:49.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:48:49.841 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:49.841 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:48:49.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:48:49.841 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:48:49.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.841 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 20.225673091000001, 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:48:49.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:48:49.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:48:49.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.847 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.237765994, 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:48:49.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:49.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:49.853 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.218404348, 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:49.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:48:49.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:48:49.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.859 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.188275916999999, 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.860 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:48:49.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:48:49.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:48:49.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:48:49.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:48:49.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:48:49.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:48:49.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.166857821000001, 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.867 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:48:49.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.136858451999998, 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.873 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:48:49.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.118259199000001, 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:48:49.879 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.100276410999999, 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:48:49.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.068452016999998, 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.892 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:48:49.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:48:49.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:48:49.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:48:49.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:48:49.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:48:49.898 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.898 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.898 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.898 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.898 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.016597602000001, 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.899 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:49.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:48:49.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:48:49.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.907 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.007762295999999, 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.913 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.958748978999999, 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.914 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:600 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.920 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.955366092999999, 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002431356, 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.921 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 600 2024-04-26T07:48:49.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.922 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:49.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9299999999999996e-07 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886663+0000", 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1590000000000003e-06 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886672+0000", 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0739999999999999e-06 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886677+0000", 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.04e-06 2024-04-26T07:48:49.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887171+0000", 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00049419000000000004 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887299+0000", 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012773799999999999 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887554+0000", 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025523100000000002 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888312+0000", 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00075773799999999999 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888986+0000", 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00067451800000000004 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889055+0000", 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9109000000000005e-05 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889089+0000", 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3665999999999999e-05 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.904327078000001, 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.928 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:48:49.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:48:49.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:48:49.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:48:49.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.935 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.700597816999998, 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:48:49.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:48:49.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:48:49.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:48:49.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:48:49.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:48:49.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.696700666000002, 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:48:49.942 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:49.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.948 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.642656486, 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:49.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:48:49.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:48:49.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:48:49.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.638530326000001, 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:48:49.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.458336202000002, 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.961 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:48:49.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:48:49.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.454687082, 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:49.967 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:49.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:48:49.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:49.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:49.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:49.973 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:49.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:48:49.975 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:49.975+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:50.071 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:48:50.116 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:50.119+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:50.172 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:50.172 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:50.172 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:50.172 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:50.176 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:50.175+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:50.192 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:48:50.203 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:50.209 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:48:50.230 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-26T07:48:49.791021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241636,"kb_used_data":4652,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733084,"statfs":{"total":773094113280,"available":772846678016,"internally_reserved":0,"allocated":4763648,"data_stored":2782844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000860"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523196+0000","last_change":"2024-04-26T07:48:21.522910+0000","last_active":"2024-04-26T07:48:47.523196+0000","last_peered":"2024-04-26T07:48:47.523196+0000","last_clean":"2024-04-26T07:48:47.523196+0000","last_became_active":"2024-04-26T07:48:21.522270+0000","last_became_peered":"2024-04-26T07:48:21.522270+0000","last_unstale":"2024-04-26T07:48:47.523196+0000","last_undegraded":"2024-04-26T07:48:47.523196+0000","last_fullsized":"2024-04-26T07:48:47.523196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420262+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:48:48.420262+0000","last_peered":"2024-04-26T07:48:48.420262+0000","last_clean":"2024-04-26T07:48:48.420262+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:48:48.420262+0000","last_undegraded":"2024-04-26T07:48:48.420262+0000","last_fullsized":"2024-04-26T07:48:48.420262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.782267+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:48:47.782267+0000","last_peered":"2024-04-26T07:48:47.782267+0000","last_clean":"2024-04-26T07:48:47.782267+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:48:47.782267+0000","last_undegraded":"2024-04-26T07:48:47.782267+0000","last_fullsized":"2024-04-26T07:48:47.782267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521370+0000","last_change":"2024-04-26T07:48:23.546594+0000","last_active":"2024-04-26T07:48:47.521370+0000","last_peered":"2024-04-26T07:48:47.521370+0000","last_clean":"2024-04-26T07:48:47.521370+0000","last_became_active":"2024-04-26T07:48:23.545761+0000","last_became_peered":"2024-04-26T07:48:23.545761+0000","last_unstale":"2024-04-26T07:48:47.521370+0000","last_undegraded":"2024-04-26T07:48:47.521370+0000","last_fullsized":"2024-04-26T07:48:47.521370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561055+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:48:47.561055+0000","last_peered":"2024-04-26T07:48:47.561055+0000","last_clean":"2024-04-26T07:48:47.561055+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:48:47.561055+0000","last_undegraded":"2024-04-26T07:48:47.561055+0000","last_fullsized":"2024-04-26T07:48:47.561055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218795+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:48:48.218795+0000","last_peered":"2024-04-26T07:48:48.218795+0000","last_clean":"2024-04-26T07:48:48.218795+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:48:48.218795+0000","last_undegraded":"2024-04-26T07:48:48.218795+0000","last_fullsized":"2024-04-26T07:48:48.218795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421769+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:48:48.421769+0000","last_peered":"2024-04-26T07:48:48.421769+0000","last_clean":"2024-04-26T07:48:48.421769+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:48:48.421769+0000","last_undegraded":"2024-04-26T07:48:48.421769+0000","last_fullsized":"2024-04-26T07:48:48.421769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559504+0000","last_change":"2024-04-26T07:48:23.549877+0000","last_active":"2024-04-26T07:48:47.559504+0000","last_peered":"2024-04-26T07:48:47.559504+0000","last_clean":"2024-04-26T07:48:47.559504+0000","last_became_active":"2024-04-26T07:48:23.549563+0000","last_became_peered":"2024-04-26T07:48:23.549563+0000","last_unstale":"2024-04-26T07:48:47.559504+0000","last_undegraded":"2024-04-26T07:48:47.559504+0000","last_fullsized":"2024-04-26T07:48:47.559504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522319+0000","last_change":"2024-04-26T07:48:21.523373+0000","last_active":"2024-04-26T07:48:47.522319+0000","last_peered":"2024-04-26T07:48:47.522319+0000","last_clean":"2024-04-26T07:48:47.522319+0000","last_became_active":"2024-04-26T07:48:21.522623+0000","last_became_peered":"2024-04-26T07:48:21.522623+0000","last_unstale":"2024-04-26T07:48:47.522319+0000","last_undegraded":"2024-04-26T07:48:47.522319+0000","last_fullsized":"2024-04-26T07:48:47.522319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581437+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:48:48.581437+0000","last_peered":"2024-04-26T07:48:48.581437+0000","last_clean":"2024-04-26T07:48:48.581437+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:48:48.581437+0000","last_undegraded":"2024-04-26T07:48:48.581437+0000","last_fullsized":"2024-04-26T07:48:48.581437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421158+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:48:48.421158+0000","last_peered":"2024-04-26T07:48:48.421158+0000","last_clean":"2024-04-26T07:48:48.421158+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:48:48.421158+0000","last_undegraded":"2024-04-26T07:48:48.421158+0000","last_fullsized":"2024-04-26T07:48:48.421158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219457+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:48:48.219457+0000","last_peered":"2024-04-26T07:48:48.219457+0000","last_clean":"2024-04-26T07:48:48.219457+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:48:48.219457+0000","last_undegraded":"2024-04-26T07:48:48.219457+0000","last_fullsized":"2024-04-26T07:48:48.219457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521627+0000","last_change":"2024-04-26T07:48:21.521442+0000","last_active":"2024-04-26T07:48:47.521627+0000","last_peered":"2024-04-26T07:48:47.521627+0000","last_clean":"2024-04-26T07:48:47.521627+0000","last_became_active":"2024-04-26T07:48:21.520835+0000","last_became_peered":"2024-04-26T07:48:21.520835+0000","last_unstale":"2024-04-26T07:48:47.521627+0000","last_undegraded":"2024-04-26T07:48:47.521627+0000","last_fullsized":"2024-04-26T07:48:47.521627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422203+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:48:48.422203+0000","last_peered":"2024-04-26T07:48:48.422203+0000","last_clean":"2024-04-26T07:48:48.422203+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:48:48.422203+0000","last_undegraded":"2024-04-26T07:48:48.422203+0000","last_fullsized":"2024-04-26T07:48:48.422203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220533+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:48:48.220533+0000","last_peered":"2024-04-26T07:48:48.220533+0000","last_clean":"2024-04-26T07:48:48.220533+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:48:48.220533+0000","last_undegraded":"2024-04-26T07:48:48.220533+0000","last_fullsized":"2024-04-26T07:48:48.220533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222751+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:48:48.222751+0000","last_peered":"2024-04-26T07:48:48.222751+0000","last_clean":"2024-04-26T07:48:48.222751+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:48:48.222751+0000","last_undegraded":"2024-04-26T07:48:48.222751+0000","last_fullsized":"2024-04-26T07:48:48.222751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218222+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:48:48.218222+0000","last_peered":"2024-04-26T07:48:48.218222+0000","last_clean":"2024-04-26T07:48:48.218222+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:48:48.218222+0000","last_undegraded":"2024-04-26T07:48:48.218222+0000","last_fullsized":"2024-04-26T07:48:48.218222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523240+0000","last_change":"2024-04-26T07:48:21.530617+0000","last_active":"2024-04-26T07:48:47.523240+0000","last_peered":"2024-04-26T07:48:47.523240+0000","last_clean":"2024-04-26T07:48:47.523240+0000","last_became_active":"2024-04-26T07:48:21.529930+0000","last_became_peered":"2024-04-26T07:48:21.529930+0000","last_unstale":"2024-04-26T07:48:47.523240+0000","last_undegraded":"2024-04-26T07:48:47.523240+0000","last_fullsized":"2024-04-26T07:48:47.523240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.873875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521431+0000","last_change":"2024-04-26T07:48:23.553223+0000","last_active":"2024-04-26T07:48:47.521431+0000","last_peered":"2024-04-26T07:48:47.521431+0000","last_clean":"2024-04-26T07:48:47.521431+0000","last_became_active":"2024-04-26T07:48:23.547557+0000","last_became_peered":"2024-04-26T07:48:23.547557+0000","last_unstale":"2024-04-26T07:48:47.521431+0000","last_undegraded":"2024-04-26T07:48:47.521431+0000","last_fullsized":"2024-04-26T07:48:47.521431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581319+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:48:48.581319+0000","last_peered":"2024-04-26T07:48:48.581319+0000","last_clean":"2024-04-26T07:48:48.581319+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:48:48.581319+0000","last_undegraded":"2024-04-26T07:48:48.581319+0000","last_fullsized":"2024-04-26T07:48:48.581319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421282+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:48:48.421282+0000","last_peered":"2024-04-26T07:48:48.421282+0000","last_clean":"2024-04-26T07:48:48.421282+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:48:48.421282+0000","last_undegraded":"2024-04-26T07:48:48.421282+0000","last_fullsized":"2024-04-26T07:48:48.421282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.582033+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:48:48.582033+0000","last_peered":"2024-04-26T07:48:48.582033+0000","last_clean":"2024-04-26T07:48:48.582033+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:48:48.582033+0000","last_undegraded":"2024-04-26T07:48:48.582033+0000","last_fullsized":"2024-04-26T07:48:48.582033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220932+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:48:48.220932+0000","last_peered":"2024-04-26T07:48:48.220932+0000","last_clean":"2024-04-26T07:48:48.220932+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:48:48.220932+0000","last_undegraded":"2024-04-26T07:48:48.220932+0000","last_fullsized":"2024-04-26T07:48:48.220932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219303+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:48:48.219303+0000","last_peered":"2024-04-26T07:48:48.219303+0000","last_clean":"2024-04-26T07:48:48.219303+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:48:48.219303+0000","last_undegraded":"2024-04-26T07:48:48.219303+0000","last_fullsized":"2024-04-26T07:48:48.219303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219465+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:48:48.219465+0000","last_peered":"2024-04-26T07:48:48.219465+0000","last_clean":"2024-04-26T07:48:48.219465+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:48:48.219465+0000","last_undegraded":"2024-04-26T07:48:48.219465+0000","last_fullsized":"2024-04-26T07:48:48.219465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224993+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:48:48.224993+0000","last_peered":"2024-04-26T07:48:48.224993+0000","last_clean":"2024-04-26T07:48:48.224993+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:48:48.224993+0000","last_undegraded":"2024-04-26T07:48:48.224993+0000","last_fullsized":"2024-04-26T07:48:48.224993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219523+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:48:48.219523+0000","last_peered":"2024-04-26T07:48:48.219523+0000","last_clean":"2024-04-26T07:48:48.219523+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:48:48.219523+0000","last_undegraded":"2024-04-26T07:48:48.219523+0000","last_fullsized":"2024-04-26T07:48:48.219523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561399+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:48:47.561399+0000","last_peered":"2024-04-26T07:48:47.561399+0000","last_clean":"2024-04-26T07:48:47.561399+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:48:47.561399+0000","last_undegraded":"2024-04-26T07:48:47.561399+0000","last_fullsized":"2024-04-26T07:48:47.561399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217481+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:48:48.217481+0000","last_peered":"2024-04-26T07:48:48.217481+0000","last_clean":"2024-04-26T07:48:48.217481+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:48:48.217481+0000","last_undegraded":"2024-04-26T07:48:48.217481+0000","last_fullsized":"2024-04-26T07:48:48.217481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226104+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:48:48.226104+0000","last_peered":"2024-04-26T07:48:48.226104+0000","last_clean":"2024-04-26T07:48:48.226104+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:48:48.226104+0000","last_undegraded":"2024-04-26T07:48:48.226104+0000","last_fullsized":"2024-04-26T07:48:48.226104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522699+0000","last_change":"2024-04-26T07:48:21.532476+0000","last_active":"2024-04-26T07:48:47.522699+0000","last_peered":"2024-04-26T07:48:47.522699+0000","last_clean":"2024-04-26T07:48:47.522699+0000","last_became_active":"2024-04-26T07:48:21.531890+0000","last_became_peered":"2024-04-26T07:48:21.531890+0000","last_unstale":"2024-04-26T07:48:47.522699+0000","last_undegraded":"2024-04-26T07:48:47.522699+0000","last_fullsized":"2024-04-26T07:48:47.522699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421989+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:48:48.421989+0000","last_peered":"2024-04-26T07:48:48.421989+0000","last_clean":"2024-04-26T07:48:48.421989+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:48:48.421989+0000","last_undegraded":"2024-04-26T07:48:48.421989+0000","last_fullsized":"2024-04-26T07:48:48.421989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563796+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:48:47.563796+0000","last_peered":"2024-04-26T07:48:47.563796+0000","last_clean":"2024-04-26T07:48:47.563796+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:48:47.563796+0000","last_undegraded":"2024-04-26T07:48:47.563796+0000","last_fullsized":"2024-04-26T07:48:47.563796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522780+0000","last_change":"2024-04-26T07:48:29.585278+0000","last_active":"2024-04-26T07:48:47.522780+0000","last_peered":"2024-04-26T07:48:47.522780+0000","last_clean":"2024-04-26T07:48:47.522780+0000","last_became_active":"2024-04-26T07:48:29.584564+0000","last_became_peered":"2024-04-26T07:48:29.584564+0000","last_unstale":"2024-04-26T07:48:47.522780+0000","last_undegraded":"2024-04-26T07:48:47.522780+0000","last_fullsized":"2024-04-26T07:48:47.522780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420374+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:48:48.420374+0000","last_peered":"2024-04-26T07:48:48.420374+0000","last_clean":"2024-04-26T07:48:48.420374+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:48:48.420374+0000","last_undegraded":"2024-04-26T07:48:48.420374+0000","last_fullsized":"2024-04-26T07:48:48.420374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422464+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:48:48.422464+0000","last_peered":"2024-04-26T07:48:48.422464+0000","last_clean":"2024-04-26T07:48:48.422464+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:48:48.422464+0000","last_undegraded":"2024-04-26T07:48:48.422464+0000","last_fullsized":"2024-04-26T07:48:48.422464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561532+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:48:47.561532+0000","last_peered":"2024-04-26T07:48:47.561532+0000","last_clean":"2024-04-26T07:48:47.561532+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:48:47.561532+0000","last_undegraded":"2024-04-26T07:48:47.561532+0000","last_fullsized":"2024-04-26T07:48:47.561532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225526+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:48:48.225526+0000","last_peered":"2024-04-26T07:48:48.225526+0000","last_clean":"2024-04-26T07:48:48.225526+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:48:48.225526+0000","last_undegraded":"2024-04-26T07:48:48.225526+0000","last_fullsized":"2024-04-26T07:48:48.225526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219818+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:48:48.219818+0000","last_peered":"2024-04-26T07:48:48.219818+0000","last_clean":"2024-04-26T07:48:48.219818+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:48:48.219818+0000","last_undegraded":"2024-04-26T07:48:48.219818+0000","last_fullsized":"2024-04-26T07:48:48.219818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219637+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:48:48.219637+0000","last_peered":"2024-04-26T07:48:48.219637+0000","last_clean":"2024-04-26T07:48:48.219637+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:48:48.219637+0000","last_undegraded":"2024-04-26T07:48:48.219637+0000","last_fullsized":"2024-04-26T07:48:48.219637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560745+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:48:47.560745+0000","last_peered":"2024-04-26T07:48:47.560745+0000","last_clean":"2024-04-26T07:48:47.560745+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:48:47.560745+0000","last_undegraded":"2024-04-26T07:48:47.560745+0000","last_fullsized":"2024-04-26T07:48:47.560745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559740+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:48:47.559740+0000","last_peered":"2024-04-26T07:48:47.559740+0000","last_clean":"2024-04-26T07:48:47.559740+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:48:47.559740+0000","last_undegraded":"2024-04-26T07:48:47.559740+0000","last_fullsized":"2024-04-26T07:48:47.559740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521662+0000","last_change":"2024-04-26T07:48:21.532432+0000","last_active":"2024-04-26T07:48:47.521662+0000","last_peered":"2024-04-26T07:48:47.521662+0000","last_clean":"2024-04-26T07:48:47.521662+0000","last_became_active":"2024-04-26T07:48:21.531735+0000","last_became_peered":"2024-04-26T07:48:21.531735+0000","last_unstale":"2024-04-26T07:48:47.521662+0000","last_undegraded":"2024-04-26T07:48:47.521662+0000","last_fullsized":"2024-04-26T07:48:47.521662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:44.669301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226169+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:48:48.226169+0000","last_peered":"2024-04-26T07:48:48.226169+0000","last_clean":"2024-04-26T07:48:48.226169+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:48:48.226169+0000","last_undegraded":"2024-04-26T07:48:48.226169+0000","last_fullsized":"2024-04-26T07:48:48.226169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219978+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:48:48.219978+0000","last_peered":"2024-04-26T07:48:48.219978+0000","last_clean":"2024-04-26T07:48:48.219978+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:48:48.219978+0000","last_undegraded":"2024-04-26T07:48:48.219978+0000","last_fullsized":"2024-04-26T07:48:48.219978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522284+0000","last_change":"2024-04-26T07:48:29.580319+0000","last_active":"2024-04-26T07:48:47.522284+0000","last_peered":"2024-04-26T07:48:47.522284+0000","last_clean":"2024-04-26T07:48:47.522284+0000","last_became_active":"2024-04-26T07:48:29.579332+0000","last_became_peered":"2024-04-26T07:48:29.579332+0000","last_unstale":"2024-04-26T07:48:47.522284+0000","last_undegraded":"2024-04-26T07:48:47.522284+0000","last_fullsized":"2024-04-26T07:48:47.522284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217185+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:48:48.217185+0000","last_peered":"2024-04-26T07:48:48.217185+0000","last_clean":"2024-04-26T07:48:48.217185+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:48:48.217185+0000","last_undegraded":"2024-04-26T07:48:48.217185+0000","last_fullsized":"2024-04-26T07:48:48.217185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225898+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:48:48.225898+0000","last_peered":"2024-04-26T07:48:48.225898+0000","last_clean":"2024-04-26T07:48:48.225898+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:48:48.225898+0000","last_undegraded":"2024-04-26T07:48:48.225898+0000","last_fullsized":"2024-04-26T07:48:48.225898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580551+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:48:48.580551+0000","last_peered":"2024-04-26T07:48:48.580551+0000","last_clean":"2024-04-26T07:48:48.580551+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:48:48.580551+0000","last_undegraded":"2024-04-26T07:48:48.580551+0000","last_fullsized":"2024-04-26T07:48:48.580551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422086+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:48:48.422086+0000","last_peered":"2024-04-26T07:48:48.422086+0000","last_clean":"2024-04-26T07:48:48.422086+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:48:48.422086+0000","last_undegraded":"2024-04-26T07:48:48.422086+0000","last_fullsized":"2024-04-26T07:48:48.422086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522642+0000","last_change":"2024-04-26T07:48:27.656615+0000","last_active":"2024-04-26T07:48:47.522642+0000","last_peered":"2024-04-26T07:48:47.522642+0000","last_clean":"2024-04-26T07:48:47.522642+0000","last_became_active":"2024-04-26T07:48:27.655900+0000","last_became_peered":"2024-04-26T07:48:27.655900+0000","last_unstale":"2024-04-26T07:48:47.522642+0000","last_undegraded":"2024-04-26T07:48:47.522642+0000","last_fullsized":"2024-04-26T07:48:47.522642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225226+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:48:48.225226+0000","last_peered":"2024-04-26T07:48:48.225226+0000","last_clean":"2024-04-26T07:48:48.225226+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:48:48.225226+0000","last_undegraded":"2024-04-26T07:48:48.225226+0000","last_fullsized":"2024-04-26T07:48:48.225226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420814+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:48:48.420814+0000","last_peered":"2024-04-26T07:48:48.420814+0000","last_clean":"2024-04-26T07:48:48.420814+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:48:48.420814+0000","last_undegraded":"2024-04-26T07:48:48.420814+0000","last_fullsized":"2024-04-26T07:48:48.420814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523377+0000","last_change":"2024-04-26T07:48:21.532535+0000","last_active":"2024-04-26T07:48:47.523377+0000","last_peered":"2024-04-26T07:48:47.523377+0000","last_clean":"2024-04-26T07:48:47.523377+0000","last_became_active":"2024-04-26T07:48:21.531870+0000","last_became_peered":"2024-04-26T07:48:21.531870+0000","last_unstale":"2024-04-26T07:48:47.523377+0000","last_undegraded":"2024-04-26T07:48:47.523377+0000","last_fullsized":"2024-04-26T07:48:47.523377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:53.041052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521103+0000","last_change":"2024-04-26T07:48:25.580567+0000","last_active":"2024-04-26T07:48:47.521103+0000","last_peered":"2024-04-26T07:48:47.521103+0000","last_clean":"2024-04-26T07:48:47.521103+0000","last_became_active":"2024-04-26T07:48:25.579735+0000","last_became_peered":"2024-04-26T07:48:25.579735+0000","last_unstale":"2024-04-26T07:48:47.521103+0000","last_undegraded":"2024-04-26T07:48:47.521103+0000","last_fullsized":"2024-04-26T07:48:47.521103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421019+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:48:48.421019+0000","last_peered":"2024-04-26T07:48:48.421019+0000","last_clean":"2024-04-26T07:48:48.421019+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:48:48.421019+0000","last_undegraded":"2024-04-26T07:48:48.421019+0000","last_fullsized":"2024-04-26T07:48:48.421019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781263+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:48:47.781263+0000","last_peered":"2024-04-26T07:48:47.781263+0000","last_clean":"2024-04-26T07:48:47.781263+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:48:47.781263+0000","last_undegraded":"2024-04-26T07:48:47.781263+0000","last_fullsized":"2024-04-26T07:48:47.781263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420357+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:48:48.420357+0000","last_peered":"2024-04-26T07:48:48.420357+0000","last_clean":"2024-04-26T07:48:48.420357+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:48:48.420357+0000","last_undegraded":"2024-04-26T07:48:48.420357+0000","last_fullsized":"2024-04-26T07:48:48.420357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218394+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:48:48.218394+0000","last_peered":"2024-04-26T07:48:48.218394+0000","last_clean":"2024-04-26T07:48:48.218394+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:48:48.218394+0000","last_undegraded":"2024-04-26T07:48:48.218394+0000","last_fullsized":"2024-04-26T07:48:48.218394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523224+0000","last_change":"2024-04-26T07:48:21.531367+0000","last_active":"2024-04-26T07:48:47.523224+0000","last_peered":"2024-04-26T07:48:47.523224+0000","last_clean":"2024-04-26T07:48:47.523224+0000","last_became_active":"2024-04-26T07:48:21.530818+0000","last_became_peered":"2024-04-26T07:48:21.530818+0000","last_unstale":"2024-04-26T07:48:47.523224+0000","last_undegraded":"2024-04-26T07:48:47.523224+0000","last_fullsized":"2024-04-26T07:48:47.523224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218765+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:48:48.218765+0000","last_peered":"2024-04-26T07:48:48.218765+0000","last_clean":"2024-04-26T07:48:48.218765+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:48:48.218765+0000","last_undegraded":"2024-04-26T07:48:48.218765+0000","last_fullsized":"2024-04-26T07:48:48.218765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225328+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:48:48.225328+0000","last_peered":"2024-04-26T07:48:48.225328+0000","last_clean":"2024-04-26T07:48:48.225328+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:48:48.225328+0000","last_undegraded":"2024-04-26T07:48:48.225328+0000","last_fullsized":"2024-04-26T07:48:48.225328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220778+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:48:48.220778+0000","last_peered":"2024-04-26T07:48:48.220778+0000","last_clean":"2024-04-26T07:48:48.220778+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:48:48.220778+0000","last_undegraded":"2024-04-26T07:48:48.220778+0000","last_fullsized":"2024-04-26T07:48:48.220778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580061+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:48:48.580061+0000","last_peered":"2024-04-26T07:48:48.580061+0000","last_clean":"2024-04-26T07:48:48.580061+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:48:48.580061+0000","last_undegraded":"2024-04-26T07:48:48.580061+0000","last_fullsized":"2024-04-26T07:48:48.580061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580838+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:48:48.580838+0000","last_peered":"2024-04-26T07:48:48.580838+0000","last_clean":"2024-04-26T07:48:48.580838+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:48:48.580838+0000","last_undegraded":"2024-04-26T07:48:48.580838+0000","last_fullsized":"2024-04-26T07:48:48.580838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523358+0000","last_change":"2024-04-26T07:48:21.528922+0000","last_active":"2024-04-26T07:48:47.523358+0000","last_peered":"2024-04-26T07:48:47.523358+0000","last_clean":"2024-04-26T07:48:47.523358+0000","last_became_active":"2024-04-26T07:48:21.528409+0000","last_became_peered":"2024-04-26T07:48:21.528409+0000","last_unstale":"2024-04-26T07:48:47.523358+0000","last_undegraded":"2024-04-26T07:48:47.523358+0000","last_fullsized":"2024-04-26T07:48:47.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221569+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:48:48.221569+0000","last_peered":"2024-04-26T07:48:48.221569+0000","last_clean":"2024-04-26T07:48:48.221569+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:48:48.221569+0000","last_undegraded":"2024-04-26T07:48:48.221569+0000","last_fullsized":"2024-04-26T07:48:48.221569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521811+0000","last_change":"2024-04-26T07:48:27.575739+0000","last_active":"2024-04-26T07:48:47.521811+0000","last_peered":"2024-04-26T07:48:47.521811+0000","last_clean":"2024-04-26T07:48:47.521811+0000","last_became_active":"2024-04-26T07:48:27.574665+0000","last_became_peered":"2024-04-26T07:48:27.574665+0000","last_unstale":"2024-04-26T07:48:47.521811+0000","last_undegraded":"2024-04-26T07:48:47.521811+0000","last_fullsized":"2024-04-26T07:48:47.521811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560229+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:48:47.560229+0000","last_peered":"2024-04-26T07:48:47.560229+0000","last_clean":"2024-04-26T07:48:47.560229+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:48:47.560229+0000","last_undegraded":"2024-04-26T07:48:47.560229+0000","last_fullsized":"2024-04-26T07:48:47.560229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563956+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:48:47.563956+0000","last_peered":"2024-04-26T07:48:47.563956+0000","last_clean":"2024-04-26T07:48:47.563956+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:48:47.563956+0000","last_undegraded":"2024-04-26T07:48:47.563956+0000","last_fullsized":"2024-04-26T07:48:47.563956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.562149+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:48:47.562149+0000","last_peered":"2024-04-26T07:48:47.562149+0000","last_clean":"2024-04-26T07:48:47.562149+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:48:47.562149+0000","last_undegraded":"2024-04-26T07:48:47.562149+0000","last_fullsized":"2024-04-26T07:48:47.562149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421993+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:48:48.421993+0000","last_peered":"2024-04-26T07:48:48.421993+0000","last_clean":"2024-04-26T07:48:48.421993+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:48:48.421993+0000","last_undegraded":"2024-04-26T07:48:48.421993+0000","last_fullsized":"2024-04-26T07:48:48.421993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220276+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:48:48.220276+0000","last_peered":"2024-04-26T07:48:48.220276+0000","last_clean":"2024-04-26T07:48:48.220276+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:48:48.220276+0000","last_undegraded":"2024-04-26T07:48:48.220276+0000","last_fullsized":"2024-04-26T07:48:48.220276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560526+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:48:47.560526+0000","last_peered":"2024-04-26T07:48:47.560526+0000","last_clean":"2024-04-26T07:48:47.560526+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:48:47.560526+0000","last_undegraded":"2024-04-26T07:48:47.560526+0000","last_fullsized":"2024-04-26T07:48:47.560526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218523+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:48:48.218523+0000","last_peered":"2024-04-26T07:48:48.218523+0000","last_clean":"2024-04-26T07:48:48.218523+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:48:48.218523+0000","last_undegraded":"2024-04-26T07:48:48.218523+0000","last_fullsized":"2024-04-26T07:48:48.218523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780818+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:48:47.780818+0000","last_peered":"2024-04-26T07:48:47.780818+0000","last_clean":"2024-04-26T07:48:47.780818+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:48:47.780818+0000","last_undegraded":"2024-04-26T07:48:47.780818+0000","last_fullsized":"2024-04-26T07:48:47.780818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217308+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:48:48.217308+0000","last_peered":"2024-04-26T07:48:48.217308+0000","last_clean":"2024-04-26T07:48:48.217308+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:48:48.217308+0000","last_undegraded":"2024-04-26T07:48:48.217308+0000","last_fullsized":"2024-04-26T07:48:48.217308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220070+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:48:48.220070+0000","last_peered":"2024-04-26T07:48:48.220070+0000","last_clean":"2024-04-26T07:48:48.220070+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:48:48.220070+0000","last_undegraded":"2024-04-26T07:48:48.220070+0000","last_fullsized":"2024-04-26T07:48:48.220070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220464+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:48:48.220464+0000","last_peered":"2024-04-26T07:48:48.220464+0000","last_clean":"2024-04-26T07:48:48.220464+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:48:48.220464+0000","last_undegraded":"2024-04-26T07:48:48.220464+0000","last_fullsized":"2024-04-26T07:48:48.220464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219667+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:48:48.219667+0000","last_peered":"2024-04-26T07:48:48.219667+0000","last_clean":"2024-04-26T07:48:48.219667+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:48:48.219667+0000","last_undegraded":"2024-04-26T07:48:48.219667+0000","last_fullsized":"2024-04-26T07:48:48.219667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564001+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:48:47.564001+0000","last_peered":"2024-04-26T07:48:47.564001+0000","last_clean":"2024-04-26T07:48:47.564001+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:48:47.564001+0000","last_undegraded":"2024-04-26T07:48:47.564001+0000","last_fullsized":"2024-04-26T07:48:47.564001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219986+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:48:48.219986+0000","last_peered":"2024-04-26T07:48:48.219986+0000","last_clean":"2024-04-26T07:48:48.219986+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:48:48.219986+0000","last_undegraded":"2024-04-26T07:48:48.219986+0000","last_fullsized":"2024-04-26T07:48:48.219986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217792+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:48:48.217792+0000","last_peered":"2024-04-26T07:48:48.217792+0000","last_clean":"2024-04-26T07:48:48.217792+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:48:48.217792+0000","last_undegraded":"2024-04-26T07:48:48.217792+0000","last_fullsized":"2024-04-26T07:48:48.217792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580881+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:48:48.580881+0000","last_peered":"2024-04-26T07:48:48.580881+0000","last_clean":"2024-04-26T07:48:48.580881+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:48:48.580881+0000","last_undegraded":"2024-04-26T07:48:48.580881+0000","last_fullsized":"2024-04-26T07:48:48.580881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781393+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:48:47.781393+0000","last_peered":"2024-04-26T07:48:47.781393+0000","last_clean":"2024-04-26T07:48:47.781393+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:48:47.781393+0000","last_undegraded":"2024-04-26T07:48:47.781393+0000","last_fullsized":"2024-04-26T07:48:47.781393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222425+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:48:48.222425+0000","last_peered":"2024-04-26T07:48:48.222425+0000","last_clean":"2024-04-26T07:48:48.222425+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:48:48.222425+0000","last_undegraded":"2024-04-26T07:48:48.222425+0000","last_fullsized":"2024-04-26T07:48:48.222425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222028+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:48:48.222028+0000","last_peered":"2024-04-26T07:48:48.222028+0000","last_clean":"2024-04-26T07:48:48.222028+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:48:48.222028+0000","last_undegraded":"2024-04-26T07:48:48.222028+0000","last_fullsized":"2024-04-26T07:48:48.222028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780106+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:48:47.780106+0000","last_peered":"2024-04-26T07:48:47.780106+0000","last_clean":"2024-04-26T07:48:47.780106+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:48:47.780106+0000","last_undegraded":"2024-04-26T07:48:47.780106+0000","last_fullsized":"2024-04-26T07:48:47.780106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217745+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:48:48.217745+0000","last_peered":"2024-04-26T07:48:48.217745+0000","last_clean":"2024-04-26T07:48:48.217745+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:48:48.217745+0000","last_undegraded":"2024-04-26T07:48:48.217745+0000","last_fullsized":"2024-04-26T07:48:48.217745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218771+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:48:48.218771+0000","last_peered":"2024-04-26T07:48:48.218771+0000","last_clean":"2024-04-26T07:48:48.218771+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:48:48.218771+0000","last_undegraded":"2024-04-26T07:48:48.218771+0000","last_fullsized":"2024-04-26T07:48:48.218771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422232+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:48:48.422232+0000","last_peered":"2024-04-26T07:48:48.422232+0000","last_clean":"2024-04-26T07:48:48.422232+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:48:48.422232+0000","last_undegraded":"2024-04-26T07:48:48.422232+0000","last_fullsized":"2024-04-26T07:48:48.422232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225253+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:48:48.225253+0000","last_peered":"2024-04-26T07:48:48.225253+0000","last_clean":"2024-04-26T07:48:48.225253+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:48:48.225253+0000","last_undegraded":"2024-04-26T07:48:48.225253+0000","last_fullsized":"2024-04-26T07:48:48.225253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581328+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:48:48.581328+0000","last_peered":"2024-04-26T07:48:48.581328+0000","last_clean":"2024-04-26T07:48:48.581328+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:48:48.581328+0000","last_undegraded":"2024-04-26T07:48:48.581328+0000","last_fullsized":"2024-04-26T07:48:48.581328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217037+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:48:48.217037+0000","last_peered":"2024-04-26T07:48:48.217037+0000","last_clean":"2024-04-26T07:48:48.217037+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:48:48.217037+0000","last_undegraded":"2024-04-26T07:48:48.217037+0000","last_fullsized":"2024-04-26T07:48:48.217037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780596+0000","last_change":"2024-04-26T07:48:23.549303+0000","last_active":"2024-04-26T07:48:47.780596+0000","last_peered":"2024-04-26T07:48:47.780596+0000","last_clean":"2024-04-26T07:48:47.780596+0000","last_became_active":"2024-04-26T07:48:23.548989+0000","last_became_peered":"2024-04-26T07:48:23.548989+0000","last_unstale":"2024-04-26T07:48:47.780596+0000","last_undegraded":"2024-04-26T07:48:47.780596+0000","last_fullsized":"2024-04-26T07:48:47.780596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220689+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:48:48.220689+0000","last_peered":"2024-04-26T07:48:48.220689+0000","last_clean":"2024-04-26T07:48:48.220689+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:48:48.220689+0000","last_undegraded":"2024-04-26T07:48:48.220689+0000","last_fullsized":"2024-04-26T07:48:48.220689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219997+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:48:48.219997+0000","last_peered":"2024-04-26T07:48:48.219997+0000","last_clean":"2024-04-26T07:48:48.219997+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:48:48.219997+0000","last_undegraded":"2024-04-26T07:48:48.219997+0000","last_fullsized":"2024-04-26T07:48:48.219997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421860+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:48:48.421860+0000","last_peered":"2024-04-26T07:48:48.421860+0000","last_clean":"2024-04-26T07:48:48.421860+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:48:48.421860+0000","last_undegraded":"2024-04-26T07:48:48.421860+0000","last_fullsized":"2024-04-26T07:48:48.421860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580999+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:48:48.580999+0000","last_peered":"2024-04-26T07:48:48.580999+0000","last_clean":"2024-04-26T07:48:48.580999+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:48:48.580999+0000","last_undegraded":"2024-04-26T07:48:48.580999+0000","last_fullsized":"2024-04-26T07:48:48.580999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.779970+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:48:47.779970+0000","last_peered":"2024-04-26T07:48:47.779970+0000","last_clean":"2024-04-26T07:48:47.779970+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:48:47.779970+0000","last_undegraded":"2024-04-26T07:48:47.779970+0000","last_fullsized":"2024-04-26T07:48:47.779970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580007+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:48:48.580007+0000","last_peered":"2024-04-26T07:48:48.580007+0000","last_clean":"2024-04-26T07:48:48.580007+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:48:48.580007+0000","last_undegraded":"2024-04-26T07:48:48.580007+0000","last_fullsized":"2024-04-26T07:48:48.580007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521888+0000","last_change":"2024-04-26T07:48:15.519242+0000","last_active":"2024-04-26T07:48:47.521888+0000","last_peered":"2024-04-26T07:48:47.521888+0000","last_clean":"2024-04-26T07:48:47.521888+0000","last_became_active":"2024-04-26T07:48:15.516846+0000","last_became_peered":"2024-04-26T07:48:15.516846+0000","last_unstale":"2024-04-26T07:48:47.521888+0000","last_undegraded":"2024-04-26T07:48:47.521888+0000","last_fullsized":"2024-04-26T07:48:47.521888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:20.666857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421538+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:48:48.421538+0000","last_peered":"2024-04-26T07:48:48.421538+0000","last_clean":"2024-04-26T07:48:48.421538+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:48:48.421538+0000","last_undegraded":"2024-04-26T07:48:48.421538+0000","last_fullsized":"2024-04-26T07:48:48.421538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221036+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:48:48.221036+0000","last_peered":"2024-04-26T07:48:48.221036+0000","last_clean":"2024-04-26T07:48:48.221036+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:48:48.221036+0000","last_undegraded":"2024-04-26T07:48:48.221036+0000","last_fullsized":"2024-04-26T07:48:48.221036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522293+0000","last_change":"2024-04-26T07:48:25.573125+0000","last_active":"2024-04-26T07:48:47.522293+0000","last_peered":"2024-04-26T07:48:47.522293+0000","last_clean":"2024-04-26T07:48:47.522293+0000","last_became_active":"2024-04-26T07:48:25.572200+0000","last_became_peered":"2024-04-26T07:48:25.572200+0000","last_unstale":"2024-04-26T07:48:47.522293+0000","last_undegraded":"2024-04-26T07:48:47.522293+0000","last_fullsized":"2024-04-26T07:48:47.522293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422480+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:48:48.422480+0000","last_peered":"2024-04-26T07:48:48.422480+0000","last_clean":"2024-04-26T07:48:48.422480+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:48:48.422480+0000","last_undegraded":"2024-04-26T07:48:48.422480+0000","last_fullsized":"2024-04-26T07:48:48.422480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564125+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:48:47.564125+0000","last_peered":"2024-04-26T07:48:47.564125+0000","last_clean":"2024-04-26T07:48:47.564125+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:48:47.564125+0000","last_undegraded":"2024-04-26T07:48:47.564125+0000","last_fullsized":"2024-04-26T07:48:47.564125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580201+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:48:48.580201+0000","last_peered":"2024-04-26T07:48:48.580201+0000","last_clean":"2024-04-26T07:48:48.580201+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:48:48.580201+0000","last_undegraded":"2024-04-26T07:48:48.580201+0000","last_fullsized":"2024-04-26T07:48:48.580201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564325+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:48:47.564325+0000","last_peered":"2024-04-26T07:48:47.564325+0000","last_clean":"2024-04-26T07:48:47.564325+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:48:47.564325+0000","last_undegraded":"2024-04-26T07:48:47.564325+0000","last_fullsized":"2024-04-26T07:48:47.564325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521635+0000","last_change":"2024-04-26T07:48:15.450172+0000","last_active":"2024-04-26T07:48:47.521635+0000","last_peered":"2024-04-26T07:48:47.521635+0000","last_clean":"2024-04-26T07:48:47.521635+0000","last_became_active":"2024-04-26T07:48:15.449113+0000","last_became_peered":"2024-04-26T07:48:15.449113+0000","last_unstale":"2024-04-26T07:48:47.521635+0000","last_undegraded":"2024-04-26T07:48:47.521635+0000","last_fullsized":"2024-04-26T07:48:47.521635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:51.283507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560617+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:48:47.560617+0000","last_peered":"2024-04-26T07:48:47.560617+0000","last_clean":"2024-04-26T07:48:47.560617+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:48:47.560617+0000","last_undegraded":"2024-04-26T07:48:47.560617+0000","last_fullsized":"2024-04-26T07:48:47.560617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422590+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:48:48.422590+0000","last_peered":"2024-04-26T07:48:48.422590+0000","last_clean":"2024-04-26T07:48:48.422590+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:48:48.422590+0000","last_undegraded":"2024-04-26T07:48:48.422590+0000","last_fullsized":"2024-04-26T07:48:48.422590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781304+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:48:47.781304+0000","last_peered":"2024-04-26T07:48:47.781304+0000","last_clean":"2024-04-26T07:48:47.781304+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:48:47.781304+0000","last_undegraded":"2024-04-26T07:48:47.781304+0000","last_fullsized":"2024-04-26T07:48:47.781304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522338+0000","last_change":"2024-04-26T07:48:29.582371+0000","last_active":"2024-04-26T07:48:47.522338+0000","last_peered":"2024-04-26T07:48:47.522338+0000","last_clean":"2024-04-26T07:48:47.522338+0000","last_became_active":"2024-04-26T07:48:29.581770+0000","last_became_peered":"2024-04-26T07:48:29.581770+0000","last_unstale":"2024-04-26T07:48:47.522338+0000","last_undegraded":"2024-04-26T07:48:47.522338+0000","last_fullsized":"2024-04-26T07:48:47.522338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780258+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:48:47.780258+0000","last_peered":"2024-04-26T07:48:47.780258+0000","last_clean":"2024-04-26T07:48:47.780258+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:48:47.780258+0000","last_undegraded":"2024-04-26T07:48:47.780258+0000","last_fullsized":"2024-04-26T07:48:47.780258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780432+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:48:47.780432+0000","last_peered":"2024-04-26T07:48:47.780432+0000","last_clean":"2024-04-26T07:48:47.780432+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:48:47.780432+0000","last_undegraded":"2024-04-26T07:48:47.780432+0000","last_fullsized":"2024-04-26T07:48:47.780432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223855+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:48:48.223855+0000","last_peered":"2024-04-26T07:48:48.223855+0000","last_clean":"2024-04-26T07:48:48.223855+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:48:48.223855+0000","last_undegraded":"2024-04-26T07:48:48.223855+0000","last_fullsized":"2024-04-26T07:48:48.223855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781158+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:48:47.781158+0000","last_peered":"2024-04-26T07:48:47.781158+0000","last_clean":"2024-04-26T07:48:47.781158+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:48:47.781158+0000","last_undegraded":"2024-04-26T07:48:47.781158+0000","last_fullsized":"2024-04-26T07:48:47.781158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222138+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:48:48.222138+0000","last_peered":"2024-04-26T07:48:48.222138+0000","last_clean":"2024-04-26T07:48:48.222138+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:48:48.222138+0000","last_undegraded":"2024-04-26T07:48:48.222138+0000","last_fullsized":"2024-04-26T07:48:48.222138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522849+0000","last_change":"2024-04-26T07:48:27.651812+0000","last_active":"2024-04-26T07:48:47.522849+0000","last_peered":"2024-04-26T07:48:47.522849+0000","last_clean":"2024-04-26T07:48:47.522849+0000","last_became_active":"2024-04-26T07:48:27.651073+0000","last_became_peered":"2024-04-26T07:48:27.651073+0000","last_unstale":"2024-04-26T07:48:47.522849+0000","last_undegraded":"2024-04-26T07:48:47.522849+0000","last_fullsized":"2024-04-26T07:48:47.522849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561172+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:48:47.561172+0000","last_peered":"2024-04-26T07:48:47.561172+0000","last_clean":"2024-04-26T07:48:47.561172+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:48:47.561172+0000","last_undegraded":"2024-04-26T07:48:47.561172+0000","last_fullsized":"2024-04-26T07:48:47.561172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224666+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:48:48.224666+0000","last_peered":"2024-04-26T07:48:48.224666+0000","last_clean":"2024-04-26T07:48:48.224666+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:48:48.224666+0000","last_undegraded":"2024-04-26T07:48:48.224666+0000","last_fullsized":"2024-04-26T07:48:48.224666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780206+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:48:47.780206+0000","last_peered":"2024-04-26T07:48:47.780206+0000","last_clean":"2024-04-26T07:48:47.780206+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:48:47.780206+0000","last_undegraded":"2024-04-26T07:48:47.780206+0000","last_fullsized":"2024-04-26T07:48:47.780206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421440+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:48:48.421440+0000","last_peered":"2024-04-26T07:48:48.421440+0000","last_clean":"2024-04-26T07:48:48.421440+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:48:48.421440+0000","last_undegraded":"2024-04-26T07:48:48.421440+0000","last_fullsized":"2024-04-26T07:48:48.421440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219119+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:48:48.219119+0000","last_peered":"2024-04-26T07:48:48.219119+0000","last_clean":"2024-04-26T07:48:48.219119+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:48:48.219119+0000","last_undegraded":"2024-04-26T07:48:48.219119+0000","last_fullsized":"2024-04-26T07:48:48.219119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560935+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:48:47.560935+0000","last_peered":"2024-04-26T07:48:47.560935+0000","last_clean":"2024-04-26T07:48:47.560935+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:48:47.560935+0000","last_undegraded":"2024-04-26T07:48:47.560935+0000","last_fullsized":"2024-04-26T07:48:47.560935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225700+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:48:48.225700+0000","last_peered":"2024-04-26T07:48:48.225700+0000","last_clean":"2024-04-26T07:48:48.225700+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:48:48.225700+0000","last_undegraded":"2024-04-26T07:48:48.225700+0000","last_fullsized":"2024-04-26T07:48:48.225700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581583+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:48:48.581583+0000","last_peered":"2024-04-26T07:48:48.581583+0000","last_clean":"2024-04-26T07:48:48.581583+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:48:48.581583+0000","last_undegraded":"2024-04-26T07:48:48.581583+0000","last_fullsized":"2024-04-26T07:48:48.581583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420538+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:48:48.420538+0000","last_peered":"2024-04-26T07:48:48.420538+0000","last_clean":"2024-04-26T07:48:48.420538+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:48:48.420538+0000","last_undegraded":"2024-04-26T07:48:48.420538+0000","last_fullsized":"2024-04-26T07:48:48.420538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.779973+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:48:47.779973+0000","last_peered":"2024-04-26T07:48:47.779973+0000","last_clean":"2024-04-26T07:48:47.779973+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:48:47.779973+0000","last_undegraded":"2024-04-26T07:48:47.779973+0000","last_fullsized":"2024-04-26T07:48:47.779973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422573+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:48:48.422573+0000","last_peered":"2024-04-26T07:48:48.422573+0000","last_clean":"2024-04-26T07:48:48.422573+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:48:48.422573+0000","last_undegraded":"2024-04-26T07:48:48.422573+0000","last_fullsized":"2024-04-26T07:48:48.422573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781557+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:48:47.781557+0000","last_peered":"2024-04-26T07:48:47.781557+0000","last_clean":"2024-04-26T07:48:47.781557+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:48:47.781557+0000","last_undegraded":"2024-04-26T07:48:47.781557+0000","last_fullsized":"2024-04-26T07:48:47.781557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561824+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:48:47.561824+0000","last_peered":"2024-04-26T07:48:47.561824+0000","last_clean":"2024-04-26T07:48:47.561824+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:48:47.561824+0000","last_undegraded":"2024-04-26T07:48:47.561824+0000","last_fullsized":"2024-04-26T07:48:47.561824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561336+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:48:47.561336+0000","last_peered":"2024-04-26T07:48:47.561336+0000","last_clean":"2024-04-26T07:48:47.561336+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:48:47.561336+0000","last_undegraded":"2024-04-26T07:48:47.561336+0000","last_fullsized":"2024-04-26T07:48:47.561336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218110+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:48:48.218110+0000","last_peered":"2024-04-26T07:48:48.218110+0000","last_clean":"2024-04-26T07:48:48.218110+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:48:48.218110+0000","last_undegraded":"2024-04-26T07:48:48.218110+0000","last_fullsized":"2024-04-26T07:48:48.218110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563689+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:48:47.563689+0000","last_peered":"2024-04-26T07:48:47.563689+0000","last_clean":"2024-04-26T07:48:47.563689+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:48:47.563689+0000","last_undegraded":"2024-04-26T07:48:47.563689+0000","last_fullsized":"2024-04-26T07:48:47.563689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559694+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:48:47.559694+0000","last_peered":"2024-04-26T07:48:47.559694+0000","last_clean":"2024-04-26T07:48:47.559694+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:48:47.559694+0000","last_undegraded":"2024-04-26T07:48:47.559694+0000","last_fullsized":"2024-04-26T07:48:47.559694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781525+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:48:47.781525+0000","last_peered":"2024-04-26T07:48:47.781525+0000","last_clean":"2024-04-26T07:48:47.781525+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:48:47.781525+0000","last_undegraded":"2024-04-26T07:48:47.781525+0000","last_fullsized":"2024-04-26T07:48:47.781525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523686+0000","last_change":"2024-04-26T07:48:15.517260+0000","last_active":"2024-04-26T07:48:47.523686+0000","last_peered":"2024-04-26T07:48:47.523686+0000","last_clean":"2024-04-26T07:48:47.523686+0000","last_became_active":"2024-04-26T07:48:15.516567+0000","last_became_peered":"2024-04-26T07:48:15.516567+0000","last_unstale":"2024-04-26T07:48:47.523686+0000","last_undegraded":"2024-04-26T07:48:47.523686+0000","last_fullsized":"2024-04-26T07:48:47.523686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:31.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580552+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:48:48.580552+0000","last_peered":"2024-04-26T07:48:48.580552+0000","last_clean":"2024-04-26T07:48:48.580552+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:48:48.580552+0000","last_undegraded":"2024-04-26T07:48:48.580552+0000","last_fullsized":"2024-04-26T07:48:48.580552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781308+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:48:47.781308+0000","last_peered":"2024-04-26T07:48:47.781308+0000","last_clean":"2024-04-26T07:48:47.781308+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:48:47.781308+0000","last_undegraded":"2024-04-26T07:48:47.781308+0000","last_fullsized":"2024-04-26T07:48:47.781308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420694+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:48:48.420694+0000","last_peered":"2024-04-26T07:48:48.420694+0000","last_clean":"2024-04-26T07:48:48.420694+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:48:48.420694+0000","last_undegraded":"2024-04-26T07:48:48.420694+0000","last_fullsized":"2024-04-26T07:48:48.420694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225979+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:48:48.225979+0000","last_peered":"2024-04-26T07:48:48.225979+0000","last_clean":"2024-04-26T07:48:48.225979+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:48:48.225979+0000","last_undegraded":"2024-04-26T07:48:48.225979+0000","last_fullsized":"2024-04-26T07:48:48.225979+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220328+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:48:48.220328+0000","last_peered":"2024-04-26T07:48:48.220328+0000","last_clean":"2024-04-26T07:48:48.220328+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:48:48.220328+0000","last_undegraded":"2024-04-26T07:48:48.220328+0000","last_fullsized":"2024-04-26T07:48:48.220328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225759+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:48:48.225759+0000","last_peered":"2024-04-26T07:48:48.225759+0000","last_clean":"2024-04-26T07:48:48.225759+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:48:48.225759+0000","last_undegraded":"2024-04-26T07:48:48.225759+0000","last_fullsized":"2024-04-26T07:48:48.225759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780414+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:48:47.780414+0000","last_peered":"2024-04-26T07:48:47.780414+0000","last_clean":"2024-04-26T07:48:47.780414+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:48:47.780414+0000","last_undegraded":"2024-04-26T07:48:47.780414+0000","last_fullsized":"2024-04-26T07:48:47.780414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218413+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:48:48.218413+0000","last_peered":"2024-04-26T07:48:48.218413+0000","last_clean":"2024-04-26T07:48:48.218413+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:48:48.218413+0000","last_undegraded":"2024-04-26T07:48:48.218413+0000","last_fullsized":"2024-04-26T07:48:48.218413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218681+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:48:48.218681+0000","last_peered":"2024-04-26T07:48:48.218681+0000","last_clean":"2024-04-26T07:48:48.218681+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:48:48.218681+0000","last_undegraded":"2024-04-26T07:48:48.218681+0000","last_fullsized":"2024-04-26T07:48:48.218681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225812+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:48:48.225812+0000","last_peered":"2024-04-26T07:48:48.225812+0000","last_clean":"2024-04-26T07:48:48.225812+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:48:48.225812+0000","last_undegraded":"2024-04-26T07:48:48.225812+0000","last_fullsized":"2024-04-26T07:48:48.225812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561536+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:48:47.561536+0000","last_peered":"2024-04-26T07:48:47.561536+0000","last_clean":"2024-04-26T07:48:47.561536+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:48:47.561536+0000","last_undegraded":"2024-04-26T07:48:47.561536+0000","last_fullsized":"2024-04-26T07:48:47.561536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217383+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:48:48.217383+0000","last_peered":"2024-04-26T07:48:48.217383+0000","last_clean":"2024-04-26T07:48:48.217383+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:48:48.217383+0000","last_undegraded":"2024-04-26T07:48:48.217383+0000","last_fullsized":"2024-04-26T07:48:48.217383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564396+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:48:47.564396+0000","last_peered":"2024-04-26T07:48:47.564396+0000","last_clean":"2024-04-26T07:48:47.564396+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:48:47.564396+0000","last_undegraded":"2024-04-26T07:48:47.564396+0000","last_fullsized":"2024-04-26T07:48:47.564396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581983+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:48:48.581983+0000","last_peered":"2024-04-26T07:48:48.581983+0000","last_clean":"2024-04-26T07:48:48.581983+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:48:48.581983+0000","last_undegraded":"2024-04-26T07:48:48.581983+0000","last_fullsized":"2024-04-26T07:48:48.581983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220184+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:48:48.220184+0000","last_peered":"2024-04-26T07:48:48.220184+0000","last_clean":"2024-04-26T07:48:48.220184+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:48:48.220184+0000","last_undegraded":"2024-04-26T07:48:48.220184+0000","last_fullsized":"2024-04-26T07:48:48.220184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521597+0000","last_change":"2024-04-26T07:48:27.655376+0000","last_active":"2024-04-26T07:48:47.521597+0000","last_peered":"2024-04-26T07:48:47.521597+0000","last_clean":"2024-04-26T07:48:47.521597+0000","last_became_active":"2024-04-26T07:48:27.654669+0000","last_became_peered":"2024-04-26T07:48:27.654669+0000","last_unstale":"2024-04-26T07:48:47.521597+0000","last_undegraded":"2024-04-26T07:48:47.521597+0000","last_fullsized":"2024-04-26T07:48:47.521597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220860+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:48:48.220860+0000","last_peered":"2024-04-26T07:48:48.220860+0000","last_clean":"2024-04-26T07:48:48.220860+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:48:48.220860+0000","last_undegraded":"2024-04-26T07:48:48.220860+0000","last_fullsized":"2024-04-26T07:48:48.220860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421855+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:48:48.421855+0000","last_peered":"2024-04-26T07:48:48.421855+0000","last_clean":"2024-04-26T07:48:48.421855+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:48:48.421855+0000","last_undegraded":"2024-04-26T07:48:48.421855+0000","last_fullsized":"2024-04-26T07:48:48.421855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563834+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:48:47.563834+0000","last_peered":"2024-04-26T07:48:47.563834+0000","last_clean":"2024-04-26T07:48:47.563834+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:48:47.563834+0000","last_undegraded":"2024-04-26T07:48:47.563834+0000","last_fullsized":"2024-04-26T07:48:47.563834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216998+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:48:48.216998+0000","last_peered":"2024-04-26T07:48:48.216998+0000","last_clean":"2024-04-26T07:48:48.216998+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:48:48.216998+0000","last_undegraded":"2024-04-26T07:48:48.216998+0000","last_fullsized":"2024-04-26T07:48:48.216998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219173+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:48:48.219173+0000","last_peered":"2024-04-26T07:48:48.219173+0000","last_clean":"2024-04-26T07:48:48.219173+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:48:48.219173+0000","last_undegraded":"2024-04-26T07:48:48.219173+0000","last_fullsized":"2024-04-26T07:48:48.219173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781169+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:48:47.781169+0000","last_peered":"2024-04-26T07:48:47.781169+0000","last_clean":"2024-04-26T07:48:47.781169+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:48:47.781169+0000","last_undegraded":"2024-04-26T07:48:47.781169+0000","last_fullsized":"2024-04-26T07:48:47.781169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221980+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:48:48.221980+0000","last_peered":"2024-04-26T07:48:48.221980+0000","last_clean":"2024-04-26T07:48:48.221980+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:48:48.221980+0000","last_undegraded":"2024-04-26T07:48:48.221980+0000","last_fullsized":"2024-04-26T07:48:48.221980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220078+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:48:48.220078+0000","last_peered":"2024-04-26T07:48:48.220078+0000","last_clean":"2024-04-26T07:48:48.220078+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:48:48.220078+0000","last_undegraded":"2024-04-26T07:48:48.220078+0000","last_fullsized":"2024-04-26T07:48:48.220078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225475+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:48:48.225475+0000","last_peered":"2024-04-26T07:48:48.225475+0000","last_clean":"2024-04-26T07:48:48.225475+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:48:48.225475+0000","last_undegraded":"2024-04-26T07:48:48.225475+0000","last_fullsized":"2024-04-26T07:48:48.225475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780159+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:48:47.780159+0000","last_peered":"2024-04-26T07:48:47.780159+0000","last_clean":"2024-04-26T07:48:47.780159+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:48:47.780159+0000","last_undegraded":"2024-04-26T07:48:47.780159+0000","last_fullsized":"2024-04-26T07:48:47.780159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523135+0000","last_change":"2024-04-26T07:48:21.522429+0000","last_active":"2024-04-26T07:48:47.523135+0000","last_peered":"2024-04-26T07:48:47.523135+0000","last_clean":"2024-04-26T07:48:47.523135+0000","last_became_active":"2024-04-26T07:48:21.521246+0000","last_became_peered":"2024-04-26T07:48:21.521246+0000","last_unstale":"2024-04-26T07:48:47.523135+0000","last_undegraded":"2024-04-26T07:48:47.523135+0000","last_fullsized":"2024-04-26T07:48:47.523135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225015+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:48:48.225015+0000","last_peered":"2024-04-26T07:48:48.225015+0000","last_clean":"2024-04-26T07:48:48.225015+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:48:48.225015+0000","last_undegraded":"2024-04-26T07:48:48.225015+0000","last_fullsized":"2024-04-26T07:48:48.225015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'4","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561121+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:48:47.561121+0000","last_peered":"2024-04-26T07:48:47.561121+0000","last_clean":"2024-04-26T07:48:47.561121+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:48:47.561121+0000","last_undegraded":"2024-04-26T07:48:47.561121+0000","last_fullsized":"2024-04-26T07:48:47.561121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521305+0000","last_change":"2024-04-26T07:48:29.582765+0000","last_active":"2024-04-26T07:48:47.521305+0000","last_peered":"2024-04-26T07:48:47.521305+0000","last_clean":"2024-04-26T07:48:47.521305+0000","last_became_active":"2024-04-26T07:48:29.581836+0000","last_became_peered":"2024-04-26T07:48:29.581836+0000","last_unstale":"2024-04-26T07:48:47.521305+0000","last_undegraded":"2024-04-26T07:48:47.521305+0000","last_fullsized":"2024-04-26T07:48:47.521305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560834+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:48:47.560834+0000","last_peered":"2024-04-26T07:48:47.560834+0000","last_clean":"2024-04-26T07:48:47.560834+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:48:47.560834+0000","last_undegraded":"2024-04-26T07:48:47.560834+0000","last_fullsized":"2024-04-26T07:48:47.560834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223029+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:48:48.223029+0000","last_peered":"2024-04-26T07:48:48.223029+0000","last_clean":"2024-04-26T07:48:48.223029+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:48:48.223029+0000","last_undegraded":"2024-04-26T07:48:48.223029+0000","last_fullsized":"2024-04-26T07:48:48.223029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422422+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:48:48.422422+0000","last_peered":"2024-04-26T07:48:48.422422+0000","last_clean":"2024-04-26T07:48:48.422422+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:48:48.422422+0000","last_undegraded":"2024-04-26T07:48:48.422422+0000","last_fullsized":"2024-04-26T07:48:48.422422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.520911+0000","last_change":"2024-04-26T07:48:25.575678+0000","last_active":"2024-04-26T07:48:47.520911+0000","last_peered":"2024-04-26T07:48:47.520911+0000","last_clean":"2024-04-26T07:48:47.520911+0000","last_became_active":"2024-04-26T07:48:25.574985+0000","last_became_peered":"2024-04-26T07:48:25.574985+0000","last_unstale":"2024-04-26T07:48:47.520911+0000","last_undegraded":"2024-04-26T07:48:47.520911+0000","last_fullsized":"2024-04-26T07:48:47.520911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224176+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:48:48.224176+0000","last_peered":"2024-04-26T07:48:48.224176+0000","last_clean":"2024-04-26T07:48:48.224176+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:48:48.224176+0000","last_undegraded":"2024-04-26T07:48:48.224176+0000","last_fullsized":"2024-04-26T07:48:48.224176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580569+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:48:48.580569+0000","last_peered":"2024-04-26T07:48:48.580569+0000","last_clean":"2024-04-26T07:48:48.580569+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:48:48.580569+0000","last_undegraded":"2024-04-26T07:48:48.580569+0000","last_fullsized":"2024-04-26T07:48:48.580569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421523+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:48:48.421523+0000","last_peered":"2024-04-26T07:48:48.421523+0000","last_clean":"2024-04-26T07:48:48.421523+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:48:48.421523+0000","last_undegraded":"2024-04-26T07:48:48.421523+0000","last_fullsized":"2024-04-26T07:48:48.421523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220455+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:48:48.220455+0000","last_peered":"2024-04-26T07:48:48.220455+0000","last_clean":"2024-04-26T07:48:48.220455+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:48:48.220455+0000","last_undegraded":"2024-04-26T07:48:48.220455+0000","last_fullsized":"2024-04-26T07:48:48.220455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564209+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:48:47.564209+0000","last_peered":"2024-04-26T07:48:47.564209+0000","last_clean":"2024-04-26T07:48:47.564209+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:48:47.564209+0000","last_undegraded":"2024-04-26T07:48:47.564209+0000","last_fullsized":"2024-04-26T07:48:47.564209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580891+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:48:48.580891+0000","last_peered":"2024-04-26T07:48:48.580891+0000","last_clean":"2024-04-26T07:48:48.580891+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:48:48.580891+0000","last_undegraded":"2024-04-26T07:48:48.580891+0000","last_fullsized":"2024-04-26T07:48:48.580891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521577+0000","last_change":"2024-04-26T07:48:27.575530+0000","last_active":"2024-04-26T07:48:47.521577+0000","last_peered":"2024-04-26T07:48:47.521577+0000","last_clean":"2024-04-26T07:48:47.521577+0000","last_became_active":"2024-04-26T07:48:27.574659+0000","last_became_peered":"2024-04-26T07:48:27.574659+0000","last_unstale":"2024-04-26T07:48:47.521577+0000","last_undegraded":"2024-04-26T07:48:47.521577+0000","last_fullsized":"2024-04-26T07:48:47.521577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561663+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:48:47.561663+0000","last_peered":"2024-04-26T07:48:47.561663+0000","last_clean":"2024-04-26T07:48:47.561663+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:48:47.561663+0000","last_undegraded":"2024-04-26T07:48:47.561663+0000","last_fullsized":"2024-04-26T07:48:47.561663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581854+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:48:48.581854+0000","last_peered":"2024-04-26T07:48:48.581854+0000","last_clean":"2024-04-26T07:48:48.581854+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:48:48.581854+0000","last_undegraded":"2024-04-26T07:48:48.581854+0000","last_fullsized":"2024-04-26T07:48:48.581854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220611+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:48:48.220611+0000","last_peered":"2024-04-26T07:48:48.220611+0000","last_clean":"2024-04-26T07:48:48.220611+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:48:48.220611+0000","last_undegraded":"2024-04-26T07:48:48.220611+0000","last_fullsized":"2024-04-26T07:48:48.220611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564246+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:48:47.564246+0000","last_peered":"2024-04-26T07:48:47.564246+0000","last_clean":"2024-04-26T07:48:47.564246+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:48:47.564246+0000","last_undegraded":"2024-04-26T07:48:47.564246+0000","last_fullsized":"2024-04-26T07:48:47.564246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781504+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:48:47.781504+0000","last_peered":"2024-04-26T07:48:47.781504+0000","last_clean":"2024-04-26T07:48:47.781504+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:48:47.781504+0000","last_undegraded":"2024-04-26T07:48:47.781504+0000","last_fullsized":"2024-04-26T07:48:47.781504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421702+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:48:48.421702+0000","last_peered":"2024-04-26T07:48:48.421702+0000","last_clean":"2024-04-26T07:48:48.421702+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:48:48.421702+0000","last_undegraded":"2024-04-26T07:48:48.421702+0000","last_fullsized":"2024-04-26T07:48:48.421702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219892+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:48:48.219892+0000","last_peered":"2024-04-26T07:48:48.219892+0000","last_clean":"2024-04-26T07:48:48.219892+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:48:48.219892+0000","last_undegraded":"2024-04-26T07:48:48.219892+0000","last_fullsized":"2024-04-26T07:48:48.219892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559861+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:48:47.559861+0000","last_peered":"2024-04-26T07:48:47.559861+0000","last_clean":"2024-04-26T07:48:47.559861+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:48:47.559861+0000","last_undegraded":"2024-04-26T07:48:47.559861+0000","last_fullsized":"2024-04-26T07:48:47.559861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781841+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:48:47.781841+0000","last_peered":"2024-04-26T07:48:47.781841+0000","last_clean":"2024-04-26T07:48:47.781841+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:48:47.781841+0000","last_undegraded":"2024-04-26T07:48:47.781841+0000","last_fullsized":"2024-04-26T07:48:47.781841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581638+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:48:48.581638+0000","last_peered":"2024-04-26T07:48:48.581638+0000","last_clean":"2024-04-26T07:48:48.581638+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:48:48.581638+0000","last_undegraded":"2024-04-26T07:48:48.581638+0000","last_fullsized":"2024-04-26T07:48:48.581638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522129+0000","last_change":"2024-04-26T07:48:27.578601+0000","last_active":"2024-04-26T07:48:47.522129+0000","last_peered":"2024-04-26T07:48:47.522129+0000","last_clean":"2024-04-26T07:48:47.522129+0000","last_became_active":"2024-04-26T07:48:27.577870+0000","last_became_peered":"2024-04-26T07:48:27.577870+0000","last_unstale":"2024-04-26T07:48:47.522129+0000","last_undegraded":"2024-04-26T07:48:47.522129+0000","last_fullsized":"2024-04-26T07:48:47.522129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781671+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:48:47.781671+0000","last_peered":"2024-04-26T07:48:47.781671+0000","last_clean":"2024-04-26T07:48:47.781671+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:48:47.781671+0000","last_undegraded":"2024-04-26T07:48:47.781671+0000","last_fullsized":"2024-04-26T07:48:47.781671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580388+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:48:48.580388+0000","last_peered":"2024-04-26T07:48:48.580388+0000","last_clean":"2024-04-26T07:48:48.580388+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:48:48.580388+0000","last_undegraded":"2024-04-26T07:48:48.580388+0000","last_fullsized":"2024-04-26T07:48:48.580388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225793+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:48:48.225793+0000","last_peered":"2024-04-26T07:48:48.225793+0000","last_clean":"2024-04-26T07:48:48.225793+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:48:48.225793+0000","last_undegraded":"2024-04-26T07:48:48.225793+0000","last_fullsized":"2024-04-26T07:48:48.225793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218974+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:48:48.218974+0000","last_peered":"2024-04-26T07:48:48.218974+0000","last_clean":"2024-04-26T07:48:48.218974+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:48:48.218974+0000","last_undegraded":"2024-04-26T07:48:48.218974+0000","last_fullsized":"2024-04-26T07:48:48.218974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219853+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:48:48.219853+0000","last_peered":"2024-04-26T07:48:48.219853+0000","last_clean":"2024-04-26T07:48:48.219853+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:48:48.219853+0000","last_undegraded":"2024-04-26T07:48:48.219853+0000","last_fullsized":"2024-04-26T07:48:48.219853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226120+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:48:48.226120+0000","last_peered":"2024-04-26T07:48:48.226120+0000","last_clean":"2024-04-26T07:48:48.226120+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:48:48.226120+0000","last_undegraded":"2024-04-26T07:48:48.226120+0000","last_fullsized":"2024-04-26T07:48:48.226120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781903+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:48:47.781903+0000","last_peered":"2024-04-26T07:48:47.781903+0000","last_clean":"2024-04-26T07:48:47.781903+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:48:47.781903+0000","last_undegraded":"2024-04-26T07:48:47.781903+0000","last_fullsized":"2024-04-26T07:48:47.781903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420933+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:48:48.420933+0000","last_peered":"2024-04-26T07:48:48.420933+0000","last_clean":"2024-04-26T07:48:48.420933+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:48:48.420933+0000","last_undegraded":"2024-04-26T07:48:48.420933+0000","last_fullsized":"2024-04-26T07:48:48.420933+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221787+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:48:48.221787+0000","last_peered":"2024-04-26T07:48:48.221787+0000","last_clean":"2024-04-26T07:48:48.221787+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:48:48.221787+0000","last_undegraded":"2024-04-26T07:48:48.221787+0000","last_fullsized":"2024-04-26T07:48:48.221787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561703+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:48:47.561703+0000","last_peered":"2024-04-26T07:48:47.561703+0000","last_clean":"2024-04-26T07:48:47.561703+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:48:47.561703+0000","last_undegraded":"2024-04-26T07:48:47.561703+0000","last_fullsized":"2024-04-26T07:48:47.561703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781824+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:48:47.781824+0000","last_peered":"2024-04-26T07:48:47.781824+0000","last_clean":"2024-04-26T07:48:47.781824+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:48:47.781824+0000","last_undegraded":"2024-04-26T07:48:47.781824+0000","last_fullsized":"2024-04-26T07:48:47.781824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219878+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:48:48.219878+0000","last_peered":"2024-04-26T07:48:48.219878+0000","last_clean":"2024-04-26T07:48:48.219878+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:48:48.219878+0000","last_undegraded":"2024-04-26T07:48:48.219878+0000","last_fullsized":"2024-04-26T07:48:48.219878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581144+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:48:48.581144+0000","last_peered":"2024-04-26T07:48:48.581144+0000","last_clean":"2024-04-26T07:48:48.581144+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:48:48.581144+0000","last_undegraded":"2024-04-26T07:48:48.581144+0000","last_fullsized":"2024-04-26T07:48:48.581144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.520862+0000","last_change":"2024-04-26T07:48:31.605556+0000","last_active":"2024-04-26T07:48:47.520862+0000","last_peered":"2024-04-26T07:48:47.520862+0000","last_clean":"2024-04-26T07:48:47.520862+0000","last_became_active":"2024-04-26T07:48:31.604886+0000","last_became_peered":"2024-04-26T07:48:31.604886+0000","last_unstale":"2024-04-26T07:48:47.520862+0000","last_undegraded":"2024-04-26T07:48:47.520862+0000","last_fullsized":"2024-04-26T07:48:47.520862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217537+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:48:48.217537+0000","last_peered":"2024-04-26T07:48:48.217537+0000","last_clean":"2024-04-26T07:48:48.217537+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:48:48.217537+0000","last_undegraded":"2024-04-26T07:48:48.217537+0000","last_fullsized":"2024-04-26T07:48:48.217537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421869+0000","last_change":"2024-04-26T07:48:21.523345+0000","last_active":"2024-04-26T07:48:48.421869+0000","last_peered":"2024-04-26T07:48:48.421869+0000","last_clean":"2024-04-26T07:48:48.421869+0000","last_became_active":"2024-04-26T07:48:21.521160+0000","last_became_peered":"2024-04-26T07:48:21.521160+0000","last_unstale":"2024-04-26T07:48:48.421869+0000","last_undegraded":"2024-04-26T07:48:48.421869+0000","last_fullsized":"2024-04-26T07:48:48.421869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521831+0000","last_change":"2024-04-26T07:48:25.576286+0000","last_active":"2024-04-26T07:48:47.521831+0000","last_peered":"2024-04-26T07:48:47.521831+0000","last_clean":"2024-04-26T07:48:47.521831+0000","last_became_active":"2024-04-26T07:48:25.575505+0000","last_became_peered":"2024-04-26T07:48:25.575505+0000","last_unstale":"2024-04-26T07:48:47.521831+0000","last_undegraded":"2024-04-26T07:48:47.521831+0000","last_fullsized":"2024-04-26T07:48:47.521831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421124+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:48:48.421124+0000","last_peered":"2024-04-26T07:48:48.421124+0000","last_clean":"2024-04-26T07:48:48.421124+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:48:48.421124+0000","last_undegraded":"2024-04-26T07:48:48.421124+0000","last_fullsized":"2024-04-26T07:48:48.421124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560163+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:48:47.560163+0000","last_peered":"2024-04-26T07:48:47.560163+0000","last_clean":"2024-04-26T07:48:47.560163+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:48:47.560163+0000","last_undegraded":"2024-04-26T07:48:47.560163+0000","last_fullsized":"2024-04-26T07:48:47.560163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523466+0000","last_change":"2024-04-26T07:48:31.598704+0000","last_active":"2024-04-26T07:48:47.523466+0000","last_peered":"2024-04-26T07:48:47.523466+0000","last_clean":"2024-04-26T07:48:47.523466+0000","last_became_active":"2024-04-26T07:48:31.597882+0000","last_became_peered":"2024-04-26T07:48:31.597882+0000","last_unstale":"2024-04-26T07:48:47.523466+0000","last_undegraded":"2024-04-26T07:48:47.523466+0000","last_fullsized":"2024-04-26T07:48:47.523466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217112+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:48:48.217112+0000","last_peered":"2024-04-26T07:48:48.217112+0000","last_clean":"2024-04-26T07:48:48.217112+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:48:48.217112+0000","last_undegraded":"2024-04-26T07:48:48.217112+0000","last_fullsized":"2024-04-26T07:48:48.217112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422501+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:48:48.422501+0000","last_peered":"2024-04-26T07:48:48.422501+0000","last_clean":"2024-04-26T07:48:48.422501+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:48:48.422501+0000","last_undegraded":"2024-04-26T07:48:48.422501+0000","last_fullsized":"2024-04-26T07:48:48.422501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421357+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:48:48.421357+0000","last_peered":"2024-04-26T07:48:48.421357+0000","last_clean":"2024-04-26T07:48:48.421357+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:48:48.421357+0000","last_undegraded":"2024-04-26T07:48:48.421357+0000","last_fullsized":"2024-04-26T07:48:48.421357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560444+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:48:47.560444+0000","last_peered":"2024-04-26T07:48:47.560444+0000","last_clean":"2024-04-26T07:48:47.560444+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:48:47.560444+0000","last_undegraded":"2024-04-26T07:48:47.560444+0000","last_fullsized":"2024-04-26T07:48:47.560444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580520+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:48:48.580520+0000","last_peered":"2024-04-26T07:48:48.580520+0000","last_clean":"2024-04-26T07:48:48.580520+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:48:48.580520+0000","last_undegraded":"2024-04-26T07:48:48.580520+0000","last_fullsized":"2024-04-26T07:48:48.580520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225548+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:48:48.225548+0000","last_peered":"2024-04-26T07:48:48.225548+0000","last_clean":"2024-04-26T07:48:48.225548+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:48:48.225548+0000","last_undegraded":"2024-04-26T07:48:48.225548+0000","last_fullsized":"2024-04-26T07:48:48.225548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223401+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:48:48.223401+0000","last_peered":"2024-04-26T07:48:48.223401+0000","last_clean":"2024-04-26T07:48:48.223401+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:48:48.223401+0000","last_undegraded":"2024-04-26T07:48:48.223401+0000","last_fullsized":"2024-04-26T07:48:48.223401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225814+0000","last_change":"2024-04-26T07:48:21.503786+0000","last_active":"2024-04-26T07:48:48.225814+0000","last_peered":"2024-04-26T07:48:48.225814+0000","last_clean":"2024-04-26T07:48:48.225814+0000","last_became_active":"2024-04-26T07:48:21.503422+0000","last_became_peered":"2024-04-26T07:48:21.503422+0000","last_unstale":"2024-04-26T07:48:48.225814+0000","last_undegraded":"2024-04-26T07:48:48.225814+0000","last_fullsized":"2024-04-26T07:48:48.225814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217954+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:48:48.217954+0000","last_peered":"2024-04-26T07:48:48.217954+0000","last_clean":"2024-04-26T07:48:48.217954+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:48:48.217954+0000","last_undegraded":"2024-04-26T07:48:48.217954+0000","last_fullsized":"2024-04-26T07:48:48.217954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225592+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:48:48.225592+0000","last_peered":"2024-04-26T07:48:48.225592+0000","last_clean":"2024-04-26T07:48:48.225592+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:48:48.225592+0000","last_undegraded":"2024-04-26T07:48:48.225592+0000","last_fullsized":"2024-04-26T07:48:48.225592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218107+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:48:48.218107+0000","last_peered":"2024-04-26T07:48:48.218107+0000","last_clean":"2024-04-26T07:48:48.218107+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:48:48.218107+0000","last_undegraded":"2024-04-26T07:48:48.218107+0000","last_fullsized":"2024-04-26T07:48:48.218107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522599+0000","last_change":"2024-04-26T07:48:31.591594+0000","last_active":"2024-04-26T07:48:47.522599+0000","last_peered":"2024-04-26T07:48:47.522599+0000","last_clean":"2024-04-26T07:48:47.522599+0000","last_became_active":"2024-04-26T07:48:31.590889+0000","last_became_peered":"2024-04-26T07:48:31.590889+0000","last_unstale":"2024-04-26T07:48:47.522599+0000","last_undegraded":"2024-04-26T07:48:47.522599+0000","last_fullsized":"2024-04-26T07:48:47.522599+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216928+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:48:48.216928+0000","last_peered":"2024-04-26T07:48:48.216928+0000","last_clean":"2024-04-26T07:48:48.216928+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:48:48.216928+0000","last_undegraded":"2024-04-26T07:48:48.216928+0000","last_fullsized":"2024-04-26T07:48:48.216928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564045+0000","last_change":"2024-04-26T07:48:21.506013+0000","last_active":"2024-04-26T07:48:47.564045+0000","last_peered":"2024-04-26T07:48:47.564045+0000","last_clean":"2024-04-26T07:48:47.564045+0000","last_became_active":"2024-04-26T07:48:21.505104+0000","last_became_peered":"2024-04-26T07:48:21.505104+0000","last_unstale":"2024-04-26T07:48:47.564045+0000","last_undegraded":"2024-04-26T07:48:47.564045+0000","last_fullsized":"2024-04-26T07:48:47.564045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781418+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:48:47.781418+0000","last_peered":"2024-04-26T07:48:47.781418+0000","last_clean":"2024-04-26T07:48:47.781418+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:48:47.781418+0000","last_undegraded":"2024-04-26T07:48:47.781418+0000","last_fullsized":"2024-04-26T07:48:47.781418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218297+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:48:48.218297+0000","last_peered":"2024-04-26T07:48:48.218297+0000","last_clean":"2024-04-26T07:48:48.218297+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:48:48.218297+0000","last_undegraded":"2024-04-26T07:48:48.218297+0000","last_fullsized":"2024-04-26T07:48:48.218297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561608+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:48:47.561608+0000","last_peered":"2024-04-26T07:48:47.561608+0000","last_clean":"2024-04-26T07:48:47.561608+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:48:47.561608+0000","last_undegraded":"2024-04-26T07:48:47.561608+0000","last_fullsized":"2024-04-26T07:48:47.561608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217300+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:48:48.217300+0000","last_peered":"2024-04-26T07:48:48.217300+0000","last_clean":"2024-04-26T07:48:48.217300+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:48:48.217300+0000","last_undegraded":"2024-04-26T07:48:48.217300+0000","last_fullsized":"2024-04-26T07:48:48.217300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780758+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:48:47.780758+0000","last_peered":"2024-04-26T07:48:47.780758+0000","last_clean":"2024-04-26T07:48:47.780758+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:48:47.780758+0000","last_undegraded":"2024-04-26T07:48:47.780758+0000","last_fullsized":"2024-04-26T07:48:47.780758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580366+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:48:48.580366+0000","last_peered":"2024-04-26T07:48:48.580366+0000","last_clean":"2024-04-26T07:48:48.580366+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:48:48.580366+0000","last_undegraded":"2024-04-26T07:48:48.580366+0000","last_fullsized":"2024-04-26T07:48:48.580366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780572+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:48:47.780572+0000","last_peered":"2024-04-26T07:48:47.780572+0000","last_clean":"2024-04-26T07:48:47.780572+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:48:47.780572+0000","last_undegraded":"2024-04-26T07:48:47.780572+0000","last_fullsized":"2024-04-26T07:48:47.780572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219048+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:48:48.219048+0000","last_peered":"2024-04-26T07:48:48.219048+0000","last_clean":"2024-04-26T07:48:48.219048+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:48:48.219048+0000","last_undegraded":"2024-04-26T07:48:48.219048+0000","last_fullsized":"2024-04-26T07:48:48.219048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422101+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:48:48.422101+0000","last_peered":"2024-04-26T07:48:48.422101+0000","last_clean":"2024-04-26T07:48:48.422101+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:48:48.422101+0000","last_undegraded":"2024-04-26T07:48:48.422101+0000","last_fullsized":"2024-04-26T07:48:48.422101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421396+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:48:48.421396+0000","last_peered":"2024-04-26T07:48:48.421396+0000","last_clean":"2024-04-26T07:48:48.421396+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:48:48.421396+0000","last_undegraded":"2024-04-26T07:48:48.421396+0000","last_fullsized":"2024-04-26T07:48:48.421396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780001+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:48:47.780001+0000","last_peered":"2024-04-26T07:48:47.780001+0000","last_clean":"2024-04-26T07:48:47.780001+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:48:47.780001+0000","last_undegraded":"2024-04-26T07:48:47.780001+0000","last_fullsized":"2024-04-26T07:48:47.780001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561785+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:48:47.561785+0000","last_peered":"2024-04-26T07:48:47.561785+0000","last_clean":"2024-04-26T07:48:47.561785+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:48:47.561785+0000","last_undegraded":"2024-04-26T07:48:47.561785+0000","last_fullsized":"2024-04-26T07:48:47.561785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225243+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:48:48.225243+0000","last_peered":"2024-04-26T07:48:48.225243+0000","last_clean":"2024-04-26T07:48:48.225243+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:48:48.225243+0000","last_undegraded":"2024-04-26T07:48:48.225243+0000","last_fullsized":"2024-04-26T07:48:48.225243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226483+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:48:48.226483+0000","last_peered":"2024-04-26T07:48:48.226483+0000","last_clean":"2024-04-26T07:48:48.226483+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:48:48.226483+0000","last_undegraded":"2024-04-26T07:48:48.226483+0000","last_fullsized":"2024-04-26T07:48:48.226483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216813+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:48:48.216813+0000","last_peered":"2024-04-26T07:48:48.216813+0000","last_clean":"2024-04-26T07:48:48.216813+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:48:48.216813+0000","last_undegraded":"2024-04-26T07:48:48.216813+0000","last_fullsized":"2024-04-26T07:48:48.216813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.782020+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:48:47.782020+0000","last_peered":"2024-04-26T07:48:47.782020+0000","last_clean":"2024-04-26T07:48:47.782020+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:48:47.782020+0000","last_undegraded":"2024-04-26T07:48:47.782020+0000","last_fullsized":"2024-04-26T07:48:47.782020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222804+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:48:48.222804+0000","last_peered":"2024-04-26T07:48:48.222804+0000","last_clean":"2024-04-26T07:48:48.222804+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:48:48.222804+0000","last_undegraded":"2024-04-26T07:48:48.222804+0000","last_fullsized":"2024-04-26T07:48:48.222804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581758+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:48:48.581758+0000","last_peered":"2024-04-26T07:48:48.581758+0000","last_clean":"2024-04-26T07:48:48.581758+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:48:48.581758+0000","last_undegraded":"2024-04-26T07:48:48.581758+0000","last_fullsized":"2024-04-26T07:48:48.581758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580289+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:48:48.580289+0000","last_peered":"2024-04-26T07:48:48.580289+0000","last_clean":"2024-04-26T07:48:48.580289+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:48:48.580289+0000","last_undegraded":"2024-04-26T07:48:48.580289+0000","last_fullsized":"2024-04-26T07:48:48.580289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225956+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:48:48.225956+0000","last_peered":"2024-04-26T07:48:48.225956+0000","last_clean":"2024-04-26T07:48:48.225956+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:48:48.225956+0000","last_undegraded":"2024-04-26T07:48:48.225956+0000","last_fullsized":"2024-04-26T07:48:48.225956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559867+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:48:47.559867+0000","last_peered":"2024-04-26T07:48:47.559867+0000","last_clean":"2024-04-26T07:48:47.559867+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:48:47.559867+0000","last_undegraded":"2024-04-26T07:48:47.559867+0000","last_fullsized":"2024-04-26T07:48:47.559867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420926+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:48:48.420926+0000","last_peered":"2024-04-26T07:48:48.420926+0000","last_clean":"2024-04-26T07:48:48.420926+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:48:48.420926+0000","last_undegraded":"2024-04-26T07:48:48.420926+0000","last_fullsized":"2024-04-26T07:48:48.420926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218423+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:48:48.218423+0000","last_peered":"2024-04-26T07:48:48.218423+0000","last_clean":"2024-04-26T07:48:48.218423+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:48:48.218423+0000","last_undegraded":"2024-04-26T07:48:48.218423+0000","last_fullsized":"2024-04-26T07:48:48.218423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223626+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:48:48.223626+0000","last_peered":"2024-04-26T07:48:48.223626+0000","last_clean":"2024-04-26T07:48:48.223626+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:48:48.223626+0000","last_undegraded":"2024-04-26T07:48:48.223626+0000","last_fullsized":"2024-04-26T07:48:48.223626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220947+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:48:48.220947+0000","last_peered":"2024-04-26T07:48:48.220947+0000","last_clean":"2024-04-26T07:48:48.220947+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:48:48.220947+0000","last_undegraded":"2024-04-26T07:48:48.220947+0000","last_fullsized":"2024-04-26T07:48:48.220947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421286+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:48:48.421286+0000","last_peered":"2024-04-26T07:48:48.421286+0000","last_clean":"2024-04-26T07:48:48.421286+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:48:48.421286+0000","last_undegraded":"2024-04-26T07:48:48.421286+0000","last_fullsized":"2024-04-26T07:48:48.421286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217106+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:48:48.217106+0000","last_peered":"2024-04-26T07:48:48.217106+0000","last_clean":"2024-04-26T07:48:48.217106+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:48:48.217106+0000","last_undegraded":"2024-04-26T07:48:48.217106+0000","last_fullsized":"2024-04-26T07:48:48.217106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561863+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:48:47.561863+0000","last_peered":"2024-04-26T07:48:47.561863+0000","last_clean":"2024-04-26T07:48:47.561863+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:48:47.561863+0000","last_undegraded":"2024-04-26T07:48:47.561863+0000","last_fullsized":"2024-04-26T07:48:47.561863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522091+0000","last_change":"2024-04-26T07:48:23.552189+0000","last_active":"2024-04-26T07:48:47.522091+0000","last_peered":"2024-04-26T07:48:47.522091+0000","last_clean":"2024-04-26T07:48:47.522091+0000","last_became_active":"2024-04-26T07:48:23.547277+0000","last_became_peered":"2024-04-26T07:48:23.547277+0000","last_unstale":"2024-04-26T07:48:47.522091+0000","last_undegraded":"2024-04-26T07:48:47.522091+0000","last_fullsized":"2024-04-26T07:48:47.522091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581576+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:48:48.581576+0000","last_peered":"2024-04-26T07:48:48.581576+0000","last_clean":"2024-04-26T07:48:48.581576+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:48:48.581576+0000","last_undegraded":"2024-04-26T07:48:48.581576+0000","last_fullsized":"2024-04-26T07:48:48.581576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560498+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:48:47.560498+0000","last_peered":"2024-04-26T07:48:47.560498+0000","last_clean":"2024-04-26T07:48:47.560498+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:48:47.560498+0000","last_undegraded":"2024-04-26T07:48:47.560498+0000","last_fullsized":"2024-04-26T07:48:47.560498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523594+0000","last_change":"2024-04-26T07:48:21.521908+0000","last_active":"2024-04-26T07:48:47.523594+0000","last_peered":"2024-04-26T07:48:47.523594+0000","last_clean":"2024-04-26T07:48:47.523594+0000","last_became_active":"2024-04-26T07:48:21.520599+0000","last_became_peered":"2024-04-26T07:48:21.520599+0000","last_unstale":"2024-04-26T07:48:47.523594+0000","last_undegraded":"2024-04-26T07:48:47.523594+0000","last_fullsized":"2024-04-26T07:48:47.523594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222573+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:48:48.222573+0000","last_peered":"2024-04-26T07:48:48.222573+0000","last_clean":"2024-04-26T07:48:48.222573+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:48:48.222573+0000","last_undegraded":"2024-04-26T07:48:48.222573+0000","last_fullsized":"2024-04-26T07:48:48.222573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222379+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:48:48.222379+0000","last_peered":"2024-04-26T07:48:48.222379+0000","last_clean":"2024-04-26T07:48:48.222379+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:48:48.222379+0000","last_undegraded":"2024-04-26T07:48:48.222379+0000","last_fullsized":"2024-04-26T07:48:48.222379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521392+0000","last_change":"2024-04-26T07:48:23.557177+0000","last_active":"2024-04-26T07:48:47.521392+0000","last_peered":"2024-04-26T07:48:47.521392+0000","last_clean":"2024-04-26T07:48:47.521392+0000","last_became_active":"2024-04-26T07:48:23.556564+0000","last_became_peered":"2024-04-26T07:48:23.556564+0000","last_unstale":"2024-04-26T07:48:47.521392+0000","last_undegraded":"2024-04-26T07:48:47.521392+0000","last_fullsized":"2024-04-26T07:48:47.521392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422719+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:48:48.422719+0000","last_peered":"2024-04-26T07:48:48.422719+0000","last_clean":"2024-04-26T07:48:48.422719+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:48:48.422719+0000","last_undegraded":"2024-04-26T07:48:48.422719+0000","last_fullsized":"2024-04-26T07:48:48.422719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420840+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:48:48.420840+0000","last_peered":"2024-04-26T07:48:48.420840+0000","last_clean":"2024-04-26T07:48:48.420840+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:48:48.420840+0000","last_undegraded":"2024-04-26T07:48:48.420840+0000","last_fullsized":"2024-04-26T07:48:48.420840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559886+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:48:47.559886+0000","last_peered":"2024-04-26T07:48:47.559886+0000","last_clean":"2024-04-26T07:48:47.559886+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:48:47.559886+0000","last_undegraded":"2024-04-26T07:48:47.559886+0000","last_fullsized":"2024-04-26T07:48:47.559886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781741+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:48:47.781741+0000","last_peered":"2024-04-26T07:48:47.781741+0000","last_clean":"2024-04-26T07:48:47.781741+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:48:47.781741+0000","last_undegraded":"2024-04-26T07:48:47.781741+0000","last_fullsized":"2024-04-26T07:48:47.781741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422244+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:48:48.422244+0000","last_peered":"2024-04-26T07:48:48.422244+0000","last_clean":"2024-04-26T07:48:48.422244+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:48:48.422244+0000","last_undegraded":"2024-04-26T07:48:48.422244+0000","last_fullsized":"2024-04-26T07:48:48.422244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":787911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":196883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":205353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":204023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":206350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":196445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":450560,"data_stored":197569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":788310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:48:50.239 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T07:48:50.239 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T07:48:50.239 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T07:48:50.239 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T07:48:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:48:50.277 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:50.275+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:50.288 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:50.310 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:50.310 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:50.325 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:50.326 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:50.331 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:50.331 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:50.343 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:50.344 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:50.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:48:50.365 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:50.386 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:50.387 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:50.387 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:50.387+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:50.407 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:50.408 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:50.427 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:50.492 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:50.495+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:50.498 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:50.498 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:50.515 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:48:50.579 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:50.575+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:50.658 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:50.658 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:50.658 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 39, 2024-04-26T07:48:50.658 INFO:teuthology.orchestra.run.smithi053.stdout: "fsid": "49487ed9-d16e-45ed-bfa2-5a4b8da36b24", 2024-04-26T07:48:50.658 INFO:teuthology.orchestra.run.smithi053.stdout: "created": "2024-04-26T07:48:02.780799+0000", 2024-04-26T07:48:50.658 INFO:teuthology.orchestra.run.smithi053.stdout: "modified": "2024-04-26T07:48:50.228381+0000", 2024-04-26T07:48:50.658 INFO:teuthology.orchestra.run.smithi053.stdout: "last_up_change": "2024-04-26T07:48:13.428691+0000", 2024-04-26T07:48:50.658 INFO:teuthology.orchestra.run.smithi053.stdout: "last_in_change": "2024-04-26T07:48:05.145685+0000", 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_num": 5799936, 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_set": [ 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "pglog_hardlimit", 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "purged_snapdirs", 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_deletes", 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "sortbitwise" 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_version": 4, 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T07:48:50.659 INFO:teuthology.orchestra.run.smithi053.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_snapshot": "", 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_max": 8, 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "max_osd": 8, 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "require_min_compat_client": "luminous", 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "min_compat_client": "jewel", 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "require_osd_release": "squid", 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_crimson": false, 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "pools": [ 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 1, 2024-04-26T07:48:50.660 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": ".mgr", 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-04-26T07:48:13.824353+0000", 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T07:48:50.661 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 1, 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 1, 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 1, 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 1, 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 1, 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-04-26T07:48:50.662 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "16", 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-04-26T07:48:50.663 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-04-26T07:48:50.664 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-04-26T07:48:50.665 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "options": { 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_max": 32, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_min": 1 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-04-26T07:48:50.666 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": {} 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 8, 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 8, 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 0.25, 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 2, 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 2, 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 2, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "rbd", 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-04-26T07:48:13.909036+0000", 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T07:48:50.668 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 8, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 8, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 8, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 8, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 8, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.669 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "16", 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-04-26T07:48:50.670 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-04-26T07:48:50.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd": {} 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.672 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.9900000095367432, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.9900000095367432, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 0.87999999523162842, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.75, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.75, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 3, 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "default.rgw.buckets.data", 2024-04-26T07:48:50.673 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-04-26T07:48:20.264760+0000", 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-04-26T07:48:50.674 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 64, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 64, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 64, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 64, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 64, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "19", 2024-04-26T07:48:50.675 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-04-26T07:48:50.676 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-04-26T07:48:50.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-04-26T07:48:50.678 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw": {} 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.5, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.5, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.5, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.5, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-04-26T07:48:50.679 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 4, 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "default.rgw.buckets.index", 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-04-26T07:48:21.834004+0000", 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-04-26T07:48:50.680 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 64, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 64, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 64, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 64, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 64, 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-04-26T07:48:50.681 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "21", 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-04-26T07:48:50.682 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T07:48:50.683 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-04-26T07:48:50.684 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw": {} 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 2, 2024-04-26T07:48:50.685 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 2, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 2, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 2, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 5, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": ".rgw.root", 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-04-26T07:48:23.784334+0000", 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-04-26T07:48:50.686 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 32, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 32, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 32, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 32, 2024-04-26T07:48:50.687 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 32, 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "23", 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-04-26T07:48:50.688 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T07:48:50.689 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T07:48:50.690 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw": {} 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.25, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.25, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.25, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.25, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-04-26T07:48:50.691 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 6, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "default.rgw.log", 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-04-26T07:48:25.689056+0000", 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-04-26T07:48:50.692 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 32, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 32, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 32, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 32, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 32, 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-04-26T07:48:50.693 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "25", 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-04-26T07:48:50.694 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T07:48:50.695 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-04-26T07:48:50.696 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw": {} 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.75, 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.75, 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-04-26T07:48:50.697 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.75, 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.75, 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 7, 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "default.rgw.control", 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-04-26T07:48:27.593594+0000", 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-04-26T07:48:50.698 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 32, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 32, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 32, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 32, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 32, 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-04-26T07:48:50.699 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "27", 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T07:48:50.700 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-04-26T07:48:50.701 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-04-26T07:48:50.702 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "options": {}, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw": {} 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.75, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.75, 2024-04-26T07:48:50.703 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.75, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.75, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "pool": 8, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": "default.rgw.meta", 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "create_time": "2024-04-26T07:48:29.723741+0000", 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "flags_names": "hashpspool", 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "type": 1, 2024-04-26T07:48:50.704 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 2, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": 1, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_rule": 0, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_count": 0, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_target": 0, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "object_hash": 2, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_mode": "off", 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": 32, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num": 32, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_placement_num_target": 32, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_target": 32, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num_pending": 32, 2024-04-26T07:48:50.705 INFO:teuthology.orchestra.run.smithi053.stdout: "last_pg_merge_meta": { 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "source_pgid": "0.0", 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "ready_epoch": 0, 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_started": 0, 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "last_epoch_clean": 0, 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "source_version": "0'0", 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "target_version": "0'0" 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "last_change": "29", 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend": "0", 2024-04-26T07:48:50.706 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "auid": 0, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_mode": "selfmanaged", 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_seq": 0, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "snap_epoch": 0, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_snaps": [], 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps": "[]", 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_bytes": 0, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "quota_max_objects": 0, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "tiers": [], 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "tier_of": -1, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "read_tier": -1, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "write_tier": -1, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_mode": "none", 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_bytes": 0, 2024-04-26T07:48:50.707 INFO:teuthology.orchestra.run.smithi053.stdout: "target_max_objects": 0, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_flush_age": 0, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "cache_min_evict_age": 0, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profile": "", 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_params": { 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "none" 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_period": 0, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_count": 0, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "use_gmt_hitset": true, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "min_read_recency_for_promote": 0, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "min_write_recency_for_promote": 0, 2024-04-26T07:48:50.708 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "hit_set_search_last_n": 0, 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "grade_table": [], 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "stripe_width": 0, 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "expected_num_objects": 0, 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "fast_read": false, 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "options": { 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscale_bias": 4 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "application_metadata": { 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "rgw": {} 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "read_balance": { 2024-04-26T07:48:50.709 INFO:teuthology.orchestra.run.smithi053.stdout: "score_type": "Fair distribution", 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "score_acting": 1.5, 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "score_stable": 1.5, 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "optimal_score": 1, 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_acting": 1.5, 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "raw_score_stable": 1.5, 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity_weighted": 1, 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity": 1, 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "average_primary_affinity_weighted": 1 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "osds": [ 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-04-26T07:48:50.710 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "6c19b301-d4c3-4075-aea7-ab2ee53aaf3a", 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 13, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 27, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.711 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6816", 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3522703831 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6818", 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3522703831 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6820", 2024-04-26T07:48:50.712 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3522703831 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6822", 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3522703831 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6830", 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3522703831 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6831", 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3522703831 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6825", 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3522703831 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6827", 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3522703831 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.53:6818/3522703831", 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.53:6822/3522703831", 2024-04-26T07:48:50.715 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.53:6831/3522703831", 2024-04-26T07:48:50.718 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.53:6827/3522703831", 2024-04-26T07:48:50.718 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-04-26T07:48:50.718 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-04-26T07:48:50.718 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-04-26T07:48:50.718 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.718 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "639db176-ee73-4aa3-aa4b-e1e713fb0026", 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 13, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 27, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-04-26T07:48:50.719 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6800", 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4143904497 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6802", 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4143904497 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6804", 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4143904497 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6806", 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4143904497 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-04-26T07:48:50.721 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6812", 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4143904497 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6814", 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4143904497 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6808", 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4143904497 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6810", 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4143904497 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.53:6802/4143904497", 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.53:6806/4143904497", 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.53:6814/4143904497", 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.53:6810/4143904497", 2024-04-26T07:48:50.723 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "f2832add-3da3-4a41-b7eb-80c0b58a6166", 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 13, 2024-04-26T07:48:50.724 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 25, 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6817", 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2446521991 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6819", 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2446521991 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6821", 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2446521991 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6823", 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2446521991 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.726 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6828", 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2446521991 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6829", 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2446521991 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6824", 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2446521991 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6826", 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2446521991 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.53:6819/2446521991", 2024-04-26T07:48:50.728 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.53:6823/2446521991", 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.53:6829/2446521991", 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.53:6826/2446521991", 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 3, 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "e532d54a-ed1f-4177-8289-2eea90fe5d27", 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-04-26T07:48:50.729 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 13, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 27, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6801", 2024-04-26T07:48:50.730 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3123753498 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6803", 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3123753498 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6805", 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3123753498 2024-04-26T07:48:50.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6807", 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3123753498 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6813", 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3123753498 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6815", 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3123753498 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6809", 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3123753498 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6811", 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3123753498 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.53:6803/3123753498", 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.53:6807/3123753498", 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.53:6815/3123753498", 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.53:6811/3123753498", 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-04-26T07:48:50.734 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 4, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "17337c8b-3ed8-41fb-900b-e7068a4cc2e4", 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 13, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 27, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-04-26T07:48:50.735 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6816", 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4225192245 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6817", 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4225192245 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6818", 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4225192245 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6820", 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4225192245 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.737 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6825", 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4225192245 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6827", 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4225192245 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.738 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6822", 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4225192245 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6823", 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4225192245 2024-04-26T07:48:50.739 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.191:6817/4225192245", 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.191:6820/4225192245", 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.191:6827/4225192245", 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.191:6823/4225192245", 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 5, 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "99310d57-c1a3-4935-9bbf-908dd237036d", 2024-04-26T07:48:50.740 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 13, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 27, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-04-26T07:48:50.741 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6800", 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1158804178 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6801", 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1158804178 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.742 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6802", 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1158804178 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6803", 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1158804178 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.743 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6806", 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1158804178 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6808", 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1158804178 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-04-26T07:48:50.744 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6804", 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1158804178 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6805", 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1158804178 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.191:6801/1158804178", 2024-04-26T07:48:50.745 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.191:6803/1158804178", 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.191:6808/1158804178", 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.191:6805/1158804178", 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 6, 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "2fef5c6a-e83d-4ab2-b571-794295b6fe31", 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-04-26T07:48:50.746 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 13, 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 27, 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6807", 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 451207779 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6809", 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 451207779 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.748 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6810", 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 451207779 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6811", 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 451207779 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6814", 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 451207779 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6815", 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 451207779 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.750 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6812", 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 451207779 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6813", 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 451207779 2024-04-26T07:48:50.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.191:6809/451207779", 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.191:6811/451207779", 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.191:6815/451207779", 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.191:6813/451207779", 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 7, 2024-04-26T07:48:50.752 INFO:teuthology.orchestra.run.smithi053.stdout: "uuid": "82fb2b9a-7a8d-4af8-ab0e-94da703625ef", 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "up": 1, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "in": 1, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "weight": 1, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_affinity": 1, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_begin": 0, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "last_clean_end": 0, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "up_from": 13, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "up_thru": 27, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "down_at": 0, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "lost_at": 0, 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addrs": { 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.753 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6819", 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2025100830 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6821", 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2025100830 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addrs": { 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.754 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6824", 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2025100830 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6826", 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2025100830 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addrs": { 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6830", 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2025100830 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6831", 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2025100830 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addrs": { 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.756 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6828", 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2025100830 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.191:6829", 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2025100830 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "public_addr": "172.21.15.191:6821/2025100830", 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_addr": "172.21.15.191:6826/2025100830", 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_back_addr": "172.21.15.191:6831/2025100830", 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "heartbeat_front_addr": "172.21.15.191:6829/2025100830", 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "state": [ 2024-04-26T07:48:50.757 INFO:teuthology.orchestra.run.smithi053.stdout: "exists", 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "up" 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_xinfo": [ 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 0, 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-04-26T07:48:50.758 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-04-26T07:48:10.773775+0000", 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 1, 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-04-26T07:48:10.751314+0000", 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-04-26T07:48:50.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 2, 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-04-26T07:48:10.751251+0000", 2024-04-26T07:48:50.760 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 3, 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-04-26T07:48:10.671594+0000", 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 4, 2024-04-26T07:48:50.761 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-04-26T07:48:10.697516+0000", 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 5, 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-04-26T07:48:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-04-26T07:48:10.606898+0000", 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 6, 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-04-26T07:48:10.566440+0000", 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-04-26T07:48:50.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": 7, 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "down_stamp": "0.000000", 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_probability": 0, 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "laggy_interval": 0, 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "features": 4540701547738038271, 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "old_weight": 0, 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "last_purged_snaps_scrub": "2024-04-26T07:48:10.783389+0000", 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "dead_epoch": 0 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap": [], 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap_items": [], 2024-04-26T07:48:50.764 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_upmap_primaries": [], 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_temp": [], 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "primary_temp": [], 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklist": {}, 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "range_blocklist": {}, 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "erasure_code_profiles": { 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "default": { 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "crush-failure-domain": "osd", 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "k": "2", 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "m": "1", 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "plugin": "jerasure", 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "technique": "reed_sol_van" 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:50.765 INFO:teuthology.orchestra.run.smithi053.stdout: "removed_snaps_queue": [], 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "new_removed_snaps": [], 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "new_purged_snaps": [], 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_node_flags": {}, 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "device_class_flags": {}, 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode": { 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode_enabled": false, 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_bucket_count": 0, 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "degraded_stretch_mode": 0, 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "recovering_stretch_mode": 0, 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: "stretch_mode_bucket": 0 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:50.766 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:50.767 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:50.767 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:50.769 INFO:tasks.thrashosds.thrasher:j is {'epoch': 39, 'fsid': '49487ed9-d16e-45ed-bfa2-5a4b8da36b24', 'created': '2024-04-26T07:48:02.780799+0000', 'modified': '2024-04-26T07:48:50.228381+0000', 'last_up_change': '2024-04-26T07:48:13.428691+0000', 'last_in_change': '2024-04-26T07:48:05.145685+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T07:48:13.824353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T07:48:13.909036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-04-26T07:48:20.264760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-04-26T07:48:21.834004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-04-26T07:48:23.784334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-04-26T07:48:25.689056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-04-26T07:48:27.593594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-04-26T07:48:29.723741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '6c19b301-d4c3-4075-aea7-ab2ee53aaf3a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6816', 'nonce': 3522703831}, {'type': 'v1', 'addr': '172.21.15.53:6818', 'nonce': 3522703831}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6820', 'nonce': 3522703831}, {'type': 'v1', 'addr': '172.21.15.53:6822', 'nonce': 3522703831}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6830', 'nonce': 3522703831}, {'type': 'v1', 'addr': '172.21.15.53:6831', 'nonce': 3522703831}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6825', 'nonce': 3522703831}, {'type': 'v1', 'addr': '172.21.15.53:6827', 'nonce': 3522703831}]}, 'public_addr': '172.21.15.53:6818/3522703831', 'cluster_addr': '172.21.15.53:6822/3522703831', 'heartbeat_back_addr': '172.21.15.53:6831/3522703831', 'heartbeat_front_addr': '172.21.15.53:6827/3522703831', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '639db176-ee73-4aa3-aa4b-e1e713fb0026', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6800', 'nonce': 4143904497}, {'type': 'v1', 'addr': '172.21.15.53:6802', 'nonce': 4143904497}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6804', 'nonce': 4143904497}, {'type': 'v1', 'addr': '172.21.15.53:6806', 'nonce': 4143904497}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6812', 'nonce': 4143904497}, {'type': 'v1', 'addr': '172.21.15.53:6814', 'nonce': 4143904497}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6808', 'nonce': 4143904497}, {'type': 'v1', 'addr': '172.21.15.53:6810', 'nonce': 4143904497}]}, 'public_addr': '172.21.15.53:6802/4143904497', 'cluster_addr': '172.21.15.53:6806/4143904497', 'heartbeat_back_addr': '172.21.15.53:6814/4143904497', 'heartbeat_front_addr': '172.21.15.53:6810/4143904497', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f2832add-3da3-4a41-b7eb-80c0b58a6166', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 25, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6817', 'nonce': 2446521991}, {'type': 'v1', 'addr': '172.21.15.53:6819', 'nonce': 2446521991}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6821', 'nonce': 2446521991}, {'type': 'v1', 'addr': '172.21.15.53:6823', 'nonce': 2446521991}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6828', 'nonce': 2446521991}, {'type': 'v1', 'addr': '172.21.15.53:6829', 'nonce': 2446521991}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6824', 'nonce': 2446521991}, {'type': 'v1', 'addr': '172.21.15.53:6826', 'nonce': 2446521991}]}, 'public_addr': '172.21.15.53:6819/2446521991', 'cluster_addr': '172.21.15.53:6823/2446521991', 'heartbeat_back_addr': '172.21.15.53:6829/2446521991', 'heartbeat_front_addr': '172.21.15.53:6826/2446521991', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e532d54a-ed1f-4177-8289-2eea90fe5d27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6801', 'nonce': 3123753498}, {'type': 'v1', 'addr': '172.21.15.53:6803', 'nonce': 3123753498}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6805', 'nonce': 3123753498}, {'type': 'v1', 'addr': '172.21.15.53:6807', 'nonce': 3123753498}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6813', 'nonce': 3123753498}, {'type': 'v1', 'addr': '172.21.15.53:6815', 'nonce': 3123753498}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6809', 'nonce': 3123753498}, {'type': 'v1', 'addr': '172.21.15.53:6811', 'nonce': 3123753498}]}, 'public_addr': '172.21.15.53:6803/3123753498', 'cluster_addr': '172.21.15.53:6807/3123753498', 'heartbeat_back_addr': '172.21.15.53:6815/3123753498', 'heartbeat_front_addr': '172.21.15.53:6811/3123753498', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '17337c8b-3ed8-41fb-900b-e7068a4cc2e4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6816', 'nonce': 4225192245}, {'type': 'v1', 'addr': '172.21.15.191:6817', 'nonce': 4225192245}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6818', 'nonce': 4225192245}, {'type': 'v1', 'addr': '172.21.15.191:6820', 'nonce': 4225192245}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6825', 'nonce': 4225192245}, {'type': 'v1', 'addr': '172.21.15.191:6827', 'nonce': 4225192245}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6822', 'nonce': 4225192245}, {'type': 'v1', 'addr': '172.21.15.191:6823', 'nonce': 4225192245}]}, 'public_addr': '172.21.15.191:6817/4225192245', 'cluster_addr': '172.21.15.191:6820/4225192245', 'heartbeat_back_addr': '172.21.15.191:6827/4225192245', 'heartbeat_front_addr': '172.21.15.191:6823/4225192245', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '99310d57-c1a3-4935-9bbf-908dd237036d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6800', 'nonce': 1158804178}, {'type': 'v1', 'addr': '172.21.15.191:6801', 'nonce': 1158804178}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6802', 'nonce': 1158804178}, {'type': 'v1', 'addr': '172.21.15.191:6803', 'nonce': 1158804178}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6806', 'nonce': 1158804178}, {'type': 'v1', 'addr': '172.21.15.191:6808', 'nonce': 1158804178}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6804', 'nonce': 1158804178}, {'type': 'v1', 'addr': '172.21.15.191:6805', 'nonce': 1158804178}]}, 'public_addr': '172.21.15.191:6801/1158804178', 'cluster_addr': '172.21.15.191:6803/1158804178', 'heartbeat_back_addr': '172.21.15.191:6808/1158804178', 'heartbeat_front_addr': '172.21.15.191:6805/1158804178', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2fef5c6a-e83d-4ab2-b571-794295b6fe31', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6807', 'nonce': 451207779}, {'type': 'v1', 'addr': '172.21.15.191:6809', 'nonce': 451207779}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6810', 'nonce': 451207779}, {'type': 'v1', 'addr': '172.21.15.191:6811', 'nonce': 451207779}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6814', 'nonce': 451207779}, {'type': 'v1', 'addr': '172.21.15.191:6815', 'nonce': 451207779}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6812', 'nonce': 451207779}, {'type': 'v1', 'addr': '172.21.15.191:6813', 'nonce': 451207779}]}, 'public_addr': '172.21.15.191:6809/451207779', 'cluster_addr': '172.21.15.191:6811/451207779', 'heartbeat_back_addr': '172.21.15.191:6815/451207779', 'heartbeat_front_addr': '172.21.15.191:6813/451207779', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '82fb2b9a-7a8d-4af8-ab0e-94da703625ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6819', 'nonce': 2025100830}, {'type': 'v1', 'addr': '172.21.15.191:6821', 'nonce': 2025100830}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6824', 'nonce': 2025100830}, {'type': 'v1', 'addr': '172.21.15.191:6826', 'nonce': 2025100830}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6830', 'nonce': 2025100830}, {'type': 'v1', 'addr': '172.21.15.191:6831', 'nonce': 2025100830}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6828', 'nonce': 2025100830}, {'type': 'v1', 'addr': '172.21.15.191:6829', 'nonce': 2025100830}]}, 'public_addr': '172.21.15.191:6821/2025100830', 'cluster_addr': '172.21.15.191:6826/2025100830', 'heartbeat_back_addr': '172.21.15.191:6831/2025100830', 'heartbeat_front_addr': '172.21.15.191:6829/2025100830', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T07:48:10.773775+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T07:48:10.751314+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T07:48:10.751251+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T07:48:10.671594+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T07:48:10.697516+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T07:48:10.606898+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T07:48:10.566440+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T07:48:10.783389+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T07:48:50.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:48:50.771 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:48:50.771 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:50.766+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:50.869 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:50.870+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:50.925 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:50.925 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:50.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:48:50.970 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:50.967+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:51.071 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:51.071+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:51.098 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:51.098 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:51.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:48:51.122 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:48:51.130 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:48:51.139 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-26T07:48:50.236775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241636,"kb_used_data":4652,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733084,"statfs":{"total":773094113280,"available":772846678016,"internally_reserved":0,"allocated":4763648,"data_stored":2782844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.047156"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523196+0000","last_change":"2024-04-26T07:48:21.522910+0000","last_active":"2024-04-26T07:48:47.523196+0000","last_peered":"2024-04-26T07:48:47.523196+0000","last_clean":"2024-04-26T07:48:47.523196+0000","last_became_active":"2024-04-26T07:48:21.522270+0000","last_became_peered":"2024-04-26T07:48:21.522270+0000","last_unstale":"2024-04-26T07:48:47.523196+0000","last_undegraded":"2024-04-26T07:48:47.523196+0000","last_fullsized":"2024-04-26T07:48:47.523196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420262+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:48:48.420262+0000","last_peered":"2024-04-26T07:48:48.420262+0000","last_clean":"2024-04-26T07:48:48.420262+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:48:48.420262+0000","last_undegraded":"2024-04-26T07:48:48.420262+0000","last_fullsized":"2024-04-26T07:48:48.420262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.782267+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:48:47.782267+0000","last_peered":"2024-04-26T07:48:47.782267+0000","last_clean":"2024-04-26T07:48:47.782267+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:48:47.782267+0000","last_undegraded":"2024-04-26T07:48:47.782267+0000","last_fullsized":"2024-04-26T07:48:47.782267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521370+0000","last_change":"2024-04-26T07:48:23.546594+0000","last_active":"2024-04-26T07:48:47.521370+0000","last_peered":"2024-04-26T07:48:47.521370+0000","last_clean":"2024-04-26T07:48:47.521370+0000","last_became_active":"2024-04-26T07:48:23.545761+0000","last_became_peered":"2024-04-26T07:48:23.545761+0000","last_unstale":"2024-04-26T07:48:47.521370+0000","last_undegraded":"2024-04-26T07:48:47.521370+0000","last_fullsized":"2024-04-26T07:48:47.521370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561055+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:48:47.561055+0000","last_peered":"2024-04-26T07:48:47.561055+0000","last_clean":"2024-04-26T07:48:47.561055+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:48:47.561055+0000","last_undegraded":"2024-04-26T07:48:47.561055+0000","last_fullsized":"2024-04-26T07:48:47.561055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218795+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:48:48.218795+0000","last_peered":"2024-04-26T07:48:48.218795+0000","last_clean":"2024-04-26T07:48:48.218795+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:48:48.218795+0000","last_undegraded":"2024-04-26T07:48:48.218795+0000","last_fullsized":"2024-04-26T07:48:48.218795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421769+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:48:48.421769+0000","last_peered":"2024-04-26T07:48:48.421769+0000","last_clean":"2024-04-26T07:48:48.421769+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:48:48.421769+0000","last_undegraded":"2024-04-26T07:48:48.421769+0000","last_fullsized":"2024-04-26T07:48:48.421769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559504+0000","last_change":"2024-04-26T07:48:23.549877+0000","last_active":"2024-04-26T07:48:47.559504+0000","last_peered":"2024-04-26T07:48:47.559504+0000","last_clean":"2024-04-26T07:48:47.559504+0000","last_became_active":"2024-04-26T07:48:23.549563+0000","last_became_peered":"2024-04-26T07:48:23.549563+0000","last_unstale":"2024-04-26T07:48:47.559504+0000","last_undegraded":"2024-04-26T07:48:47.559504+0000","last_fullsized":"2024-04-26T07:48:47.559504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522319+0000","last_change":"2024-04-26T07:48:21.523373+0000","last_active":"2024-04-26T07:48:47.522319+0000","last_peered":"2024-04-26T07:48:47.522319+0000","last_clean":"2024-04-26T07:48:47.522319+0000","last_became_active":"2024-04-26T07:48:21.522623+0000","last_became_peered":"2024-04-26T07:48:21.522623+0000","last_unstale":"2024-04-26T07:48:47.522319+0000","last_undegraded":"2024-04-26T07:48:47.522319+0000","last_fullsized":"2024-04-26T07:48:47.522319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581437+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:48:48.581437+0000","last_peered":"2024-04-26T07:48:48.581437+0000","last_clean":"2024-04-26T07:48:48.581437+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:48:48.581437+0000","last_undegraded":"2024-04-26T07:48:48.581437+0000","last_fullsized":"2024-04-26T07:48:48.581437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421158+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:48:48.421158+0000","last_peered":"2024-04-26T07:48:48.421158+0000","last_clean":"2024-04-26T07:48:48.421158+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:48:48.421158+0000","last_undegraded":"2024-04-26T07:48:48.421158+0000","last_fullsized":"2024-04-26T07:48:48.421158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219457+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:48:48.219457+0000","last_peered":"2024-04-26T07:48:48.219457+0000","last_clean":"2024-04-26T07:48:48.219457+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:48:48.219457+0000","last_undegraded":"2024-04-26T07:48:48.219457+0000","last_fullsized":"2024-04-26T07:48:48.219457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521627+0000","last_change":"2024-04-26T07:48:21.521442+0000","last_active":"2024-04-26T07:48:47.521627+0000","last_peered":"2024-04-26T07:48:47.521627+0000","last_clean":"2024-04-26T07:48:47.521627+0000","last_became_active":"2024-04-26T07:48:21.520835+0000","last_became_peered":"2024-04-26T07:48:21.520835+0000","last_unstale":"2024-04-26T07:48:47.521627+0000","last_undegraded":"2024-04-26T07:48:47.521627+0000","last_fullsized":"2024-04-26T07:48:47.521627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422203+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:48:48.422203+0000","last_peered":"2024-04-26T07:48:48.422203+0000","last_clean":"2024-04-26T07:48:48.422203+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:48:48.422203+0000","last_undegraded":"2024-04-26T07:48:48.422203+0000","last_fullsized":"2024-04-26T07:48:48.422203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220533+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:48:48.220533+0000","last_peered":"2024-04-26T07:48:48.220533+0000","last_clean":"2024-04-26T07:48:48.220533+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:48:48.220533+0000","last_undegraded":"2024-04-26T07:48:48.220533+0000","last_fullsized":"2024-04-26T07:48:48.220533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222751+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:48:48.222751+0000","last_peered":"2024-04-26T07:48:48.222751+0000","last_clean":"2024-04-26T07:48:48.222751+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:48:48.222751+0000","last_undegraded":"2024-04-26T07:48:48.222751+0000","last_fullsized":"2024-04-26T07:48:48.222751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218222+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:48:48.218222+0000","last_peered":"2024-04-26T07:48:48.218222+0000","last_clean":"2024-04-26T07:48:48.218222+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:48:48.218222+0000","last_undegraded":"2024-04-26T07:48:48.218222+0000","last_fullsized":"2024-04-26T07:48:48.218222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523240+0000","last_change":"2024-04-26T07:48:21.530617+0000","last_active":"2024-04-26T07:48:47.523240+0000","last_peered":"2024-04-26T07:48:47.523240+0000","last_clean":"2024-04-26T07:48:47.523240+0000","last_became_active":"2024-04-26T07:48:21.529930+0000","last_became_peered":"2024-04-26T07:48:21.529930+0000","last_unstale":"2024-04-26T07:48:47.523240+0000","last_undegraded":"2024-04-26T07:48:47.523240+0000","last_fullsized":"2024-04-26T07:48:47.523240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.873875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521431+0000","last_change":"2024-04-26T07:48:23.553223+0000","last_active":"2024-04-26T07:48:47.521431+0000","last_peered":"2024-04-26T07:48:47.521431+0000","last_clean":"2024-04-26T07:48:47.521431+0000","last_became_active":"2024-04-26T07:48:23.547557+0000","last_became_peered":"2024-04-26T07:48:23.547557+0000","last_unstale":"2024-04-26T07:48:47.521431+0000","last_undegraded":"2024-04-26T07:48:47.521431+0000","last_fullsized":"2024-04-26T07:48:47.521431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581319+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:48:48.581319+0000","last_peered":"2024-04-26T07:48:48.581319+0000","last_clean":"2024-04-26T07:48:48.581319+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:48:48.581319+0000","last_undegraded":"2024-04-26T07:48:48.581319+0000","last_fullsized":"2024-04-26T07:48:48.581319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421282+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:48:48.421282+0000","last_peered":"2024-04-26T07:48:48.421282+0000","last_clean":"2024-04-26T07:48:48.421282+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:48:48.421282+0000","last_undegraded":"2024-04-26T07:48:48.421282+0000","last_fullsized":"2024-04-26T07:48:48.421282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.582033+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:48:48.582033+0000","last_peered":"2024-04-26T07:48:48.582033+0000","last_clean":"2024-04-26T07:48:48.582033+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:48:48.582033+0000","last_undegraded":"2024-04-26T07:48:48.582033+0000","last_fullsized":"2024-04-26T07:48:48.582033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220932+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:48:48.220932+0000","last_peered":"2024-04-26T07:48:48.220932+0000","last_clean":"2024-04-26T07:48:48.220932+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:48:48.220932+0000","last_undegraded":"2024-04-26T07:48:48.220932+0000","last_fullsized":"2024-04-26T07:48:48.220932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219303+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:48:48.219303+0000","last_peered":"2024-04-26T07:48:48.219303+0000","last_clean":"2024-04-26T07:48:48.219303+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:48:48.219303+0000","last_undegraded":"2024-04-26T07:48:48.219303+0000","last_fullsized":"2024-04-26T07:48:48.219303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219465+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:48:48.219465+0000","last_peered":"2024-04-26T07:48:48.219465+0000","last_clean":"2024-04-26T07:48:48.219465+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:48:48.219465+0000","last_undegraded":"2024-04-26T07:48:48.219465+0000","last_fullsized":"2024-04-26T07:48:48.219465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224993+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:48:48.224993+0000","last_peered":"2024-04-26T07:48:48.224993+0000","last_clean":"2024-04-26T07:48:48.224993+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:48:48.224993+0000","last_undegraded":"2024-04-26T07:48:48.224993+0000","last_fullsized":"2024-04-26T07:48:48.224993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219523+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:48:48.219523+0000","last_peered":"2024-04-26T07:48:48.219523+0000","last_clean":"2024-04-26T07:48:48.219523+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:48:48.219523+0000","last_undegraded":"2024-04-26T07:48:48.219523+0000","last_fullsized":"2024-04-26T07:48:48.219523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561399+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:48:47.561399+0000","last_peered":"2024-04-26T07:48:47.561399+0000","last_clean":"2024-04-26T07:48:47.561399+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:48:47.561399+0000","last_undegraded":"2024-04-26T07:48:47.561399+0000","last_fullsized":"2024-04-26T07:48:47.561399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217481+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:48:48.217481+0000","last_peered":"2024-04-26T07:48:48.217481+0000","last_clean":"2024-04-26T07:48:48.217481+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:48:48.217481+0000","last_undegraded":"2024-04-26T07:48:48.217481+0000","last_fullsized":"2024-04-26T07:48:48.217481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226104+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:48:48.226104+0000","last_peered":"2024-04-26T07:48:48.226104+0000","last_clean":"2024-04-26T07:48:48.226104+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:48:48.226104+0000","last_undegraded":"2024-04-26T07:48:48.226104+0000","last_fullsized":"2024-04-26T07:48:48.226104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522699+0000","last_change":"2024-04-26T07:48:21.532476+0000","last_active":"2024-04-26T07:48:47.522699+0000","last_peered":"2024-04-26T07:48:47.522699+0000","last_clean":"2024-04-26T07:48:47.522699+0000","last_became_active":"2024-04-26T07:48:21.531890+0000","last_became_peered":"2024-04-26T07:48:21.531890+0000","last_unstale":"2024-04-26T07:48:47.522699+0000","last_undegraded":"2024-04-26T07:48:47.522699+0000","last_fullsized":"2024-04-26T07:48:47.522699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421989+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:48:48.421989+0000","last_peered":"2024-04-26T07:48:48.421989+0000","last_clean":"2024-04-26T07:48:48.421989+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:48:48.421989+0000","last_undegraded":"2024-04-26T07:48:48.421989+0000","last_fullsized":"2024-04-26T07:48:48.421989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563796+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:48:47.563796+0000","last_peered":"2024-04-26T07:48:47.563796+0000","last_clean":"2024-04-26T07:48:47.563796+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:48:47.563796+0000","last_undegraded":"2024-04-26T07:48:47.563796+0000","last_fullsized":"2024-04-26T07:48:47.563796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522780+0000","last_change":"2024-04-26T07:48:29.585278+0000","last_active":"2024-04-26T07:48:47.522780+0000","last_peered":"2024-04-26T07:48:47.522780+0000","last_clean":"2024-04-26T07:48:47.522780+0000","last_became_active":"2024-04-26T07:48:29.584564+0000","last_became_peered":"2024-04-26T07:48:29.584564+0000","last_unstale":"2024-04-26T07:48:47.522780+0000","last_undegraded":"2024-04-26T07:48:47.522780+0000","last_fullsized":"2024-04-26T07:48:47.522780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420374+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:48:48.420374+0000","last_peered":"2024-04-26T07:48:48.420374+0000","last_clean":"2024-04-26T07:48:48.420374+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:48:48.420374+0000","last_undegraded":"2024-04-26T07:48:48.420374+0000","last_fullsized":"2024-04-26T07:48:48.420374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422464+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:48:48.422464+0000","last_peered":"2024-04-26T07:48:48.422464+0000","last_clean":"2024-04-26T07:48:48.422464+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:48:48.422464+0000","last_undegraded":"2024-04-26T07:48:48.422464+0000","last_fullsized":"2024-04-26T07:48:48.422464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561532+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:48:47.561532+0000","last_peered":"2024-04-26T07:48:47.561532+0000","last_clean":"2024-04-26T07:48:47.561532+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:48:47.561532+0000","last_undegraded":"2024-04-26T07:48:47.561532+0000","last_fullsized":"2024-04-26T07:48:47.561532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225526+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:48:48.225526+0000","last_peered":"2024-04-26T07:48:48.225526+0000","last_clean":"2024-04-26T07:48:48.225526+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:48:48.225526+0000","last_undegraded":"2024-04-26T07:48:48.225526+0000","last_fullsized":"2024-04-26T07:48:48.225526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219818+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:48:48.219818+0000","last_peered":"2024-04-26T07:48:48.219818+0000","last_clean":"2024-04-26T07:48:48.219818+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:48:48.219818+0000","last_undegraded":"2024-04-26T07:48:48.219818+0000","last_fullsized":"2024-04-26T07:48:48.219818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219637+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:48:48.219637+0000","last_peered":"2024-04-26T07:48:48.219637+0000","last_clean":"2024-04-26T07:48:48.219637+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:48:48.219637+0000","last_undegraded":"2024-04-26T07:48:48.219637+0000","last_fullsized":"2024-04-26T07:48:48.219637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560745+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:48:47.560745+0000","last_peered":"2024-04-26T07:48:47.560745+0000","last_clean":"2024-04-26T07:48:47.560745+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:48:47.560745+0000","last_undegraded":"2024-04-26T07:48:47.560745+0000","last_fullsized":"2024-04-26T07:48:47.560745+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559740+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:48:47.559740+0000","last_peered":"2024-04-26T07:48:47.559740+0000","last_clean":"2024-04-26T07:48:47.559740+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:48:47.559740+0000","last_undegraded":"2024-04-26T07:48:47.559740+0000","last_fullsized":"2024-04-26T07:48:47.559740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521662+0000","last_change":"2024-04-26T07:48:21.532432+0000","last_active":"2024-04-26T07:48:47.521662+0000","last_peered":"2024-04-26T07:48:47.521662+0000","last_clean":"2024-04-26T07:48:47.521662+0000","last_became_active":"2024-04-26T07:48:21.531735+0000","last_became_peered":"2024-04-26T07:48:21.531735+0000","last_unstale":"2024-04-26T07:48:47.521662+0000","last_undegraded":"2024-04-26T07:48:47.521662+0000","last_fullsized":"2024-04-26T07:48:47.521662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:44.669301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226169+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:48:48.226169+0000","last_peered":"2024-04-26T07:48:48.226169+0000","last_clean":"2024-04-26T07:48:48.226169+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:48:48.226169+0000","last_undegraded":"2024-04-26T07:48:48.226169+0000","last_fullsized":"2024-04-26T07:48:48.226169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219978+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:48:48.219978+0000","last_peered":"2024-04-26T07:48:48.219978+0000","last_clean":"2024-04-26T07:48:48.219978+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:48:48.219978+0000","last_undegraded":"2024-04-26T07:48:48.219978+0000","last_fullsized":"2024-04-26T07:48:48.219978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522284+0000","last_change":"2024-04-26T07:48:29.580319+0000","last_active":"2024-04-26T07:48:47.522284+0000","last_peered":"2024-04-26T07:48:47.522284+0000","last_clean":"2024-04-26T07:48:47.522284+0000","last_became_active":"2024-04-26T07:48:29.579332+0000","last_became_peered":"2024-04-26T07:48:29.579332+0000","last_unstale":"2024-04-26T07:48:47.522284+0000","last_undegraded":"2024-04-26T07:48:47.522284+0000","last_fullsized":"2024-04-26T07:48:47.522284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217185+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:48:48.217185+0000","last_peered":"2024-04-26T07:48:48.217185+0000","last_clean":"2024-04-26T07:48:48.217185+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:48:48.217185+0000","last_undegraded":"2024-04-26T07:48:48.217185+0000","last_fullsized":"2024-04-26T07:48:48.217185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225898+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:48:48.225898+0000","last_peered":"2024-04-26T07:48:48.225898+0000","last_clean":"2024-04-26T07:48:48.225898+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:48:48.225898+0000","last_undegraded":"2024-04-26T07:48:48.225898+0000","last_fullsized":"2024-04-26T07:48:48.225898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580551+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:48:48.580551+0000","last_peered":"2024-04-26T07:48:48.580551+0000","last_clean":"2024-04-26T07:48:48.580551+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:48:48.580551+0000","last_undegraded":"2024-04-26T07:48:48.580551+0000","last_fullsized":"2024-04-26T07:48:48.580551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422086+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:48:48.422086+0000","last_peered":"2024-04-26T07:48:48.422086+0000","last_clean":"2024-04-26T07:48:48.422086+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:48:48.422086+0000","last_undegraded":"2024-04-26T07:48:48.422086+0000","last_fullsized":"2024-04-26T07:48:48.422086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522642+0000","last_change":"2024-04-26T07:48:27.656615+0000","last_active":"2024-04-26T07:48:47.522642+0000","last_peered":"2024-04-26T07:48:47.522642+0000","last_clean":"2024-04-26T07:48:47.522642+0000","last_became_active":"2024-04-26T07:48:27.655900+0000","last_became_peered":"2024-04-26T07:48:27.655900+0000","last_unstale":"2024-04-26T07:48:47.522642+0000","last_undegraded":"2024-04-26T07:48:47.522642+0000","last_fullsized":"2024-04-26T07:48:47.522642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225226+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:48:48.225226+0000","last_peered":"2024-04-26T07:48:48.225226+0000","last_clean":"2024-04-26T07:48:48.225226+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:48:48.225226+0000","last_undegraded":"2024-04-26T07:48:48.225226+0000","last_fullsized":"2024-04-26T07:48:48.225226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420814+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:48:48.420814+0000","last_peered":"2024-04-26T07:48:48.420814+0000","last_clean":"2024-04-26T07:48:48.420814+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:48:48.420814+0000","last_undegraded":"2024-04-26T07:48:48.420814+0000","last_fullsized":"2024-04-26T07:48:48.420814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523377+0000","last_change":"2024-04-26T07:48:21.532535+0000","last_active":"2024-04-26T07:48:47.523377+0000","last_peered":"2024-04-26T07:48:47.523377+0000","last_clean":"2024-04-26T07:48:47.523377+0000","last_became_active":"2024-04-26T07:48:21.531870+0000","last_became_peered":"2024-04-26T07:48:21.531870+0000","last_unstale":"2024-04-26T07:48:47.523377+0000","last_undegraded":"2024-04-26T07:48:47.523377+0000","last_fullsized":"2024-04-26T07:48:47.523377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:53.041052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521103+0000","last_change":"2024-04-26T07:48:25.580567+0000","last_active":"2024-04-26T07:48:47.521103+0000","last_peered":"2024-04-26T07:48:47.521103+0000","last_clean":"2024-04-26T07:48:47.521103+0000","last_became_active":"2024-04-26T07:48:25.579735+0000","last_became_peered":"2024-04-26T07:48:25.579735+0000","last_unstale":"2024-04-26T07:48:47.521103+0000","last_undegraded":"2024-04-26T07:48:47.521103+0000","last_fullsized":"2024-04-26T07:48:47.521103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421019+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:48:48.421019+0000","last_peered":"2024-04-26T07:48:48.421019+0000","last_clean":"2024-04-26T07:48:48.421019+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:48:48.421019+0000","last_undegraded":"2024-04-26T07:48:48.421019+0000","last_fullsized":"2024-04-26T07:48:48.421019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781263+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:48:47.781263+0000","last_peered":"2024-04-26T07:48:47.781263+0000","last_clean":"2024-04-26T07:48:47.781263+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:48:47.781263+0000","last_undegraded":"2024-04-26T07:48:47.781263+0000","last_fullsized":"2024-04-26T07:48:47.781263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420357+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:48:48.420357+0000","last_peered":"2024-04-26T07:48:48.420357+0000","last_clean":"2024-04-26T07:48:48.420357+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:48:48.420357+0000","last_undegraded":"2024-04-26T07:48:48.420357+0000","last_fullsized":"2024-04-26T07:48:48.420357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218394+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:48:48.218394+0000","last_peered":"2024-04-26T07:48:48.218394+0000","last_clean":"2024-04-26T07:48:48.218394+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:48:48.218394+0000","last_undegraded":"2024-04-26T07:48:48.218394+0000","last_fullsized":"2024-04-26T07:48:48.218394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523224+0000","last_change":"2024-04-26T07:48:21.531367+0000","last_active":"2024-04-26T07:48:47.523224+0000","last_peered":"2024-04-26T07:48:47.523224+0000","last_clean":"2024-04-26T07:48:47.523224+0000","last_became_active":"2024-04-26T07:48:21.530818+0000","last_became_peered":"2024-04-26T07:48:21.530818+0000","last_unstale":"2024-04-26T07:48:47.523224+0000","last_undegraded":"2024-04-26T07:48:47.523224+0000","last_fullsized":"2024-04-26T07:48:47.523224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218765+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:48:48.218765+0000","last_peered":"2024-04-26T07:48:48.218765+0000","last_clean":"2024-04-26T07:48:48.218765+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:48:48.218765+0000","last_undegraded":"2024-04-26T07:48:48.218765+0000","last_fullsized":"2024-04-26T07:48:48.218765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225328+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:48:48.225328+0000","last_peered":"2024-04-26T07:48:48.225328+0000","last_clean":"2024-04-26T07:48:48.225328+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:48:48.225328+0000","last_undegraded":"2024-04-26T07:48:48.225328+0000","last_fullsized":"2024-04-26T07:48:48.225328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220778+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:48:48.220778+0000","last_peered":"2024-04-26T07:48:48.220778+0000","last_clean":"2024-04-26T07:48:48.220778+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:48:48.220778+0000","last_undegraded":"2024-04-26T07:48:48.220778+0000","last_fullsized":"2024-04-26T07:48:48.220778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580061+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:48:48.580061+0000","last_peered":"2024-04-26T07:48:48.580061+0000","last_clean":"2024-04-26T07:48:48.580061+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:48:48.580061+0000","last_undegraded":"2024-04-26T07:48:48.580061+0000","last_fullsized":"2024-04-26T07:48:48.580061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580838+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:48:48.580838+0000","last_peered":"2024-04-26T07:48:48.580838+0000","last_clean":"2024-04-26T07:48:48.580838+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:48:48.580838+0000","last_undegraded":"2024-04-26T07:48:48.580838+0000","last_fullsized":"2024-04-26T07:48:48.580838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523358+0000","last_change":"2024-04-26T07:48:21.528922+0000","last_active":"2024-04-26T07:48:47.523358+0000","last_peered":"2024-04-26T07:48:47.523358+0000","last_clean":"2024-04-26T07:48:47.523358+0000","last_became_active":"2024-04-26T07:48:21.528409+0000","last_became_peered":"2024-04-26T07:48:21.528409+0000","last_unstale":"2024-04-26T07:48:47.523358+0000","last_undegraded":"2024-04-26T07:48:47.523358+0000","last_fullsized":"2024-04-26T07:48:47.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221569+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:48:48.221569+0000","last_peered":"2024-04-26T07:48:48.221569+0000","last_clean":"2024-04-26T07:48:48.221569+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:48:48.221569+0000","last_undegraded":"2024-04-26T07:48:48.221569+0000","last_fullsized":"2024-04-26T07:48:48.221569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521811+0000","last_change":"2024-04-26T07:48:27.575739+0000","last_active":"2024-04-26T07:48:47.521811+0000","last_peered":"2024-04-26T07:48:47.521811+0000","last_clean":"2024-04-26T07:48:47.521811+0000","last_became_active":"2024-04-26T07:48:27.574665+0000","last_became_peered":"2024-04-26T07:48:27.574665+0000","last_unstale":"2024-04-26T07:48:47.521811+0000","last_undegraded":"2024-04-26T07:48:47.521811+0000","last_fullsized":"2024-04-26T07:48:47.521811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560229+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:48:47.560229+0000","last_peered":"2024-04-26T07:48:47.560229+0000","last_clean":"2024-04-26T07:48:47.560229+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:48:47.560229+0000","last_undegraded":"2024-04-26T07:48:47.560229+0000","last_fullsized":"2024-04-26T07:48:47.560229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563956+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:48:47.563956+0000","last_peered":"2024-04-26T07:48:47.563956+0000","last_clean":"2024-04-26T07:48:47.563956+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:48:47.563956+0000","last_undegraded":"2024-04-26T07:48:47.563956+0000","last_fullsized":"2024-04-26T07:48:47.563956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.562149+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:48:47.562149+0000","last_peered":"2024-04-26T07:48:47.562149+0000","last_clean":"2024-04-26T07:48:47.562149+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:48:47.562149+0000","last_undegraded":"2024-04-26T07:48:47.562149+0000","last_fullsized":"2024-04-26T07:48:47.562149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421993+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:48:48.421993+0000","last_peered":"2024-04-26T07:48:48.421993+0000","last_clean":"2024-04-26T07:48:48.421993+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:48:48.421993+0000","last_undegraded":"2024-04-26T07:48:48.421993+0000","last_fullsized":"2024-04-26T07:48:48.421993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220276+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:48:48.220276+0000","last_peered":"2024-04-26T07:48:48.220276+0000","last_clean":"2024-04-26T07:48:48.220276+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:48:48.220276+0000","last_undegraded":"2024-04-26T07:48:48.220276+0000","last_fullsized":"2024-04-26T07:48:48.220276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560526+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:48:47.560526+0000","last_peered":"2024-04-26T07:48:47.560526+0000","last_clean":"2024-04-26T07:48:47.560526+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:48:47.560526+0000","last_undegraded":"2024-04-26T07:48:47.560526+0000","last_fullsized":"2024-04-26T07:48:47.560526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218523+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:48:48.218523+0000","last_peered":"2024-04-26T07:48:48.218523+0000","last_clean":"2024-04-26T07:48:48.218523+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:48:48.218523+0000","last_undegraded":"2024-04-26T07:48:48.218523+0000","last_fullsized":"2024-04-26T07:48:48.218523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780818+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:48:47.780818+0000","last_peered":"2024-04-26T07:48:47.780818+0000","last_clean":"2024-04-26T07:48:47.780818+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:48:47.780818+0000","last_undegraded":"2024-04-26T07:48:47.780818+0000","last_fullsized":"2024-04-26T07:48:47.780818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217308+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:48:48.217308+0000","last_peered":"2024-04-26T07:48:48.217308+0000","last_clean":"2024-04-26T07:48:48.217308+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:48:48.217308+0000","last_undegraded":"2024-04-26T07:48:48.217308+0000","last_fullsized":"2024-04-26T07:48:48.217308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220070+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:48:48.220070+0000","last_peered":"2024-04-26T07:48:48.220070+0000","last_clean":"2024-04-26T07:48:48.220070+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:48:48.220070+0000","last_undegraded":"2024-04-26T07:48:48.220070+0000","last_fullsized":"2024-04-26T07:48:48.220070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220464+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:48:48.220464+0000","last_peered":"2024-04-26T07:48:48.220464+0000","last_clean":"2024-04-26T07:48:48.220464+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:48:48.220464+0000","last_undegraded":"2024-04-26T07:48:48.220464+0000","last_fullsized":"2024-04-26T07:48:48.220464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219667+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:48:48.219667+0000","last_peered":"2024-04-26T07:48:48.219667+0000","last_clean":"2024-04-26T07:48:48.219667+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:48:48.219667+0000","last_undegraded":"2024-04-26T07:48:48.219667+0000","last_fullsized":"2024-04-26T07:48:48.219667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564001+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:48:47.564001+0000","last_peered":"2024-04-26T07:48:47.564001+0000","last_clean":"2024-04-26T07:48:47.564001+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:48:47.564001+0000","last_undegraded":"2024-04-26T07:48:47.564001+0000","last_fullsized":"2024-04-26T07:48:47.564001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219986+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:48:48.219986+0000","last_peered":"2024-04-26T07:48:48.219986+0000","last_clean":"2024-04-26T07:48:48.219986+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:48:48.219986+0000","last_undegraded":"2024-04-26T07:48:48.219986+0000","last_fullsized":"2024-04-26T07:48:48.219986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217792+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:48:48.217792+0000","last_peered":"2024-04-26T07:48:48.217792+0000","last_clean":"2024-04-26T07:48:48.217792+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:48:48.217792+0000","last_undegraded":"2024-04-26T07:48:48.217792+0000","last_fullsized":"2024-04-26T07:48:48.217792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580881+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:48:48.580881+0000","last_peered":"2024-04-26T07:48:48.580881+0000","last_clean":"2024-04-26T07:48:48.580881+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:48:48.580881+0000","last_undegraded":"2024-04-26T07:48:48.580881+0000","last_fullsized":"2024-04-26T07:48:48.580881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781393+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:48:47.781393+0000","last_peered":"2024-04-26T07:48:47.781393+0000","last_clean":"2024-04-26T07:48:47.781393+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:48:47.781393+0000","last_undegraded":"2024-04-26T07:48:47.781393+0000","last_fullsized":"2024-04-26T07:48:47.781393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222425+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:48:48.222425+0000","last_peered":"2024-04-26T07:48:48.222425+0000","last_clean":"2024-04-26T07:48:48.222425+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:48:48.222425+0000","last_undegraded":"2024-04-26T07:48:48.222425+0000","last_fullsized":"2024-04-26T07:48:48.222425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222028+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:48:48.222028+0000","last_peered":"2024-04-26T07:48:48.222028+0000","last_clean":"2024-04-26T07:48:48.222028+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:48:48.222028+0000","last_undegraded":"2024-04-26T07:48:48.222028+0000","last_fullsized":"2024-04-26T07:48:48.222028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780106+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:48:47.780106+0000","last_peered":"2024-04-26T07:48:47.780106+0000","last_clean":"2024-04-26T07:48:47.780106+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:48:47.780106+0000","last_undegraded":"2024-04-26T07:48:47.780106+0000","last_fullsized":"2024-04-26T07:48:47.780106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217745+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:48:48.217745+0000","last_peered":"2024-04-26T07:48:48.217745+0000","last_clean":"2024-04-26T07:48:48.217745+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:48:48.217745+0000","last_undegraded":"2024-04-26T07:48:48.217745+0000","last_fullsized":"2024-04-26T07:48:48.217745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218771+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:48:48.218771+0000","last_peered":"2024-04-26T07:48:48.218771+0000","last_clean":"2024-04-26T07:48:48.218771+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:48:48.218771+0000","last_undegraded":"2024-04-26T07:48:48.218771+0000","last_fullsized":"2024-04-26T07:48:48.218771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422232+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:48:48.422232+0000","last_peered":"2024-04-26T07:48:48.422232+0000","last_clean":"2024-04-26T07:48:48.422232+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:48:48.422232+0000","last_undegraded":"2024-04-26T07:48:48.422232+0000","last_fullsized":"2024-04-26T07:48:48.422232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225253+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:48:48.225253+0000","last_peered":"2024-04-26T07:48:48.225253+0000","last_clean":"2024-04-26T07:48:48.225253+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:48:48.225253+0000","last_undegraded":"2024-04-26T07:48:48.225253+0000","last_fullsized":"2024-04-26T07:48:48.225253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581328+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:48:48.581328+0000","last_peered":"2024-04-26T07:48:48.581328+0000","last_clean":"2024-04-26T07:48:48.581328+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:48:48.581328+0000","last_undegraded":"2024-04-26T07:48:48.581328+0000","last_fullsized":"2024-04-26T07:48:48.581328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217037+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:48:48.217037+0000","last_peered":"2024-04-26T07:48:48.217037+0000","last_clean":"2024-04-26T07:48:48.217037+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:48:48.217037+0000","last_undegraded":"2024-04-26T07:48:48.217037+0000","last_fullsized":"2024-04-26T07:48:48.217037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780596+0000","last_change":"2024-04-26T07:48:23.549303+0000","last_active":"2024-04-26T07:48:47.780596+0000","last_peered":"2024-04-26T07:48:47.780596+0000","last_clean":"2024-04-26T07:48:47.780596+0000","last_became_active":"2024-04-26T07:48:23.548989+0000","last_became_peered":"2024-04-26T07:48:23.548989+0000","last_unstale":"2024-04-26T07:48:47.780596+0000","last_undegraded":"2024-04-26T07:48:47.780596+0000","last_fullsized":"2024-04-26T07:48:47.780596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220689+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:48:48.220689+0000","last_peered":"2024-04-26T07:48:48.220689+0000","last_clean":"2024-04-26T07:48:48.220689+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:48:48.220689+0000","last_undegraded":"2024-04-26T07:48:48.220689+0000","last_fullsized":"2024-04-26T07:48:48.220689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219997+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:48:48.219997+0000","last_peered":"2024-04-26T07:48:48.219997+0000","last_clean":"2024-04-26T07:48:48.219997+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:48:48.219997+0000","last_undegraded":"2024-04-26T07:48:48.219997+0000","last_fullsized":"2024-04-26T07:48:48.219997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421860+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:48:48.421860+0000","last_peered":"2024-04-26T07:48:48.421860+0000","last_clean":"2024-04-26T07:48:48.421860+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:48:48.421860+0000","last_undegraded":"2024-04-26T07:48:48.421860+0000","last_fullsized":"2024-04-26T07:48:48.421860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580999+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:48:48.580999+0000","last_peered":"2024-04-26T07:48:48.580999+0000","last_clean":"2024-04-26T07:48:48.580999+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:48:48.580999+0000","last_undegraded":"2024-04-26T07:48:48.580999+0000","last_fullsized":"2024-04-26T07:48:48.580999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.779970+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:48:47.779970+0000","last_peered":"2024-04-26T07:48:47.779970+0000","last_clean":"2024-04-26T07:48:47.779970+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:48:47.779970+0000","last_undegraded":"2024-04-26T07:48:47.779970+0000","last_fullsized":"2024-04-26T07:48:47.779970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580007+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:48:48.580007+0000","last_peered":"2024-04-26T07:48:48.580007+0000","last_clean":"2024-04-26T07:48:48.580007+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:48:48.580007+0000","last_undegraded":"2024-04-26T07:48:48.580007+0000","last_fullsized":"2024-04-26T07:48:48.580007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521888+0000","last_change":"2024-04-26T07:48:15.519242+0000","last_active":"2024-04-26T07:48:47.521888+0000","last_peered":"2024-04-26T07:48:47.521888+0000","last_clean":"2024-04-26T07:48:47.521888+0000","last_became_active":"2024-04-26T07:48:15.516846+0000","last_became_peered":"2024-04-26T07:48:15.516846+0000","last_unstale":"2024-04-26T07:48:47.521888+0000","last_undegraded":"2024-04-26T07:48:47.521888+0000","last_fullsized":"2024-04-26T07:48:47.521888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:20.666857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421538+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:48:48.421538+0000","last_peered":"2024-04-26T07:48:48.421538+0000","last_clean":"2024-04-26T07:48:48.421538+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:48:48.421538+0000","last_undegraded":"2024-04-26T07:48:48.421538+0000","last_fullsized":"2024-04-26T07:48:48.421538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221036+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:48:48.221036+0000","last_peered":"2024-04-26T07:48:48.221036+0000","last_clean":"2024-04-26T07:48:48.221036+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:48:48.221036+0000","last_undegraded":"2024-04-26T07:48:48.221036+0000","last_fullsized":"2024-04-26T07:48:48.221036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522293+0000","last_change":"2024-04-26T07:48:25.573125+0000","last_active":"2024-04-26T07:48:47.522293+0000","last_peered":"2024-04-26T07:48:47.522293+0000","last_clean":"2024-04-26T07:48:47.522293+0000","last_became_active":"2024-04-26T07:48:25.572200+0000","last_became_peered":"2024-04-26T07:48:25.572200+0000","last_unstale":"2024-04-26T07:48:47.522293+0000","last_undegraded":"2024-04-26T07:48:47.522293+0000","last_fullsized":"2024-04-26T07:48:47.522293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422480+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:48:48.422480+0000","last_peered":"2024-04-26T07:48:48.422480+0000","last_clean":"2024-04-26T07:48:48.422480+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:48:48.422480+0000","last_undegraded":"2024-04-26T07:48:48.422480+0000","last_fullsized":"2024-04-26T07:48:48.422480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564125+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:48:47.564125+0000","last_peered":"2024-04-26T07:48:47.564125+0000","last_clean":"2024-04-26T07:48:47.564125+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:48:47.564125+0000","last_undegraded":"2024-04-26T07:48:47.564125+0000","last_fullsized":"2024-04-26T07:48:47.564125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580201+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:48:48.580201+0000","last_peered":"2024-04-26T07:48:48.580201+0000","last_clean":"2024-04-26T07:48:48.580201+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:48:48.580201+0000","last_undegraded":"2024-04-26T07:48:48.580201+0000","last_fullsized":"2024-04-26T07:48:48.580201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564325+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:48:47.564325+0000","last_peered":"2024-04-26T07:48:47.564325+0000","last_clean":"2024-04-26T07:48:47.564325+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:48:47.564325+0000","last_undegraded":"2024-04-26T07:48:47.564325+0000","last_fullsized":"2024-04-26T07:48:47.564325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521635+0000","last_change":"2024-04-26T07:48:15.450172+0000","last_active":"2024-04-26T07:48:47.521635+0000","last_peered":"2024-04-26T07:48:47.521635+0000","last_clean":"2024-04-26T07:48:47.521635+0000","last_became_active":"2024-04-26T07:48:15.449113+0000","last_became_peered":"2024-04-26T07:48:15.449113+0000","last_unstale":"2024-04-26T07:48:47.521635+0000","last_undegraded":"2024-04-26T07:48:47.521635+0000","last_fullsized":"2024-04-26T07:48:47.521635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:51.283507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560617+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:48:47.560617+0000","last_peered":"2024-04-26T07:48:47.560617+0000","last_clean":"2024-04-26T07:48:47.560617+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:48:47.560617+0000","last_undegraded":"2024-04-26T07:48:47.560617+0000","last_fullsized":"2024-04-26T07:48:47.560617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422590+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:48:48.422590+0000","last_peered":"2024-04-26T07:48:48.422590+0000","last_clean":"2024-04-26T07:48:48.422590+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:48:48.422590+0000","last_undegraded":"2024-04-26T07:48:48.422590+0000","last_fullsized":"2024-04-26T07:48:48.422590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781304+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:48:47.781304+0000","last_peered":"2024-04-26T07:48:47.781304+0000","last_clean":"2024-04-26T07:48:47.781304+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:48:47.781304+0000","last_undegraded":"2024-04-26T07:48:47.781304+0000","last_fullsized":"2024-04-26T07:48:47.781304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522338+0000","last_change":"2024-04-26T07:48:29.582371+0000","last_active":"2024-04-26T07:48:47.522338+0000","last_peered":"2024-04-26T07:48:47.522338+0000","last_clean":"2024-04-26T07:48:47.522338+0000","last_became_active":"2024-04-26T07:48:29.581770+0000","last_became_peered":"2024-04-26T07:48:29.581770+0000","last_unstale":"2024-04-26T07:48:47.522338+0000","last_undegraded":"2024-04-26T07:48:47.522338+0000","last_fullsized":"2024-04-26T07:48:47.522338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780258+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:48:47.780258+0000","last_peered":"2024-04-26T07:48:47.780258+0000","last_clean":"2024-04-26T07:48:47.780258+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:48:47.780258+0000","last_undegraded":"2024-04-26T07:48:47.780258+0000","last_fullsized":"2024-04-26T07:48:47.780258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780432+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:48:47.780432+0000","last_peered":"2024-04-26T07:48:47.780432+0000","last_clean":"2024-04-26T07:48:47.780432+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:48:47.780432+0000","last_undegraded":"2024-04-26T07:48:47.780432+0000","last_fullsized":"2024-04-26T07:48:47.780432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223855+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:48:48.223855+0000","last_peered":"2024-04-26T07:48:48.223855+0000","last_clean":"2024-04-26T07:48:48.223855+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:48:48.223855+0000","last_undegraded":"2024-04-26T07:48:48.223855+0000","last_fullsized":"2024-04-26T07:48:48.223855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781158+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:48:47.781158+0000","last_peered":"2024-04-26T07:48:47.781158+0000","last_clean":"2024-04-26T07:48:47.781158+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:48:47.781158+0000","last_undegraded":"2024-04-26T07:48:47.781158+0000","last_fullsized":"2024-04-26T07:48:47.781158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222138+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:48:48.222138+0000","last_peered":"2024-04-26T07:48:48.222138+0000","last_clean":"2024-04-26T07:48:48.222138+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:48:48.222138+0000","last_undegraded":"2024-04-26T07:48:48.222138+0000","last_fullsized":"2024-04-26T07:48:48.222138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522849+0000","last_change":"2024-04-26T07:48:27.651812+0000","last_active":"2024-04-26T07:48:47.522849+0000","last_peered":"2024-04-26T07:48:47.522849+0000","last_clean":"2024-04-26T07:48:47.522849+0000","last_became_active":"2024-04-26T07:48:27.651073+0000","last_became_peered":"2024-04-26T07:48:27.651073+0000","last_unstale":"2024-04-26T07:48:47.522849+0000","last_undegraded":"2024-04-26T07:48:47.522849+0000","last_fullsized":"2024-04-26T07:48:47.522849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561172+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:48:47.561172+0000","last_peered":"2024-04-26T07:48:47.561172+0000","last_clean":"2024-04-26T07:48:47.561172+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:48:47.561172+0000","last_undegraded":"2024-04-26T07:48:47.561172+0000","last_fullsized":"2024-04-26T07:48:47.561172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224666+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:48:48.224666+0000","last_peered":"2024-04-26T07:48:48.224666+0000","last_clean":"2024-04-26T07:48:48.224666+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:48:48.224666+0000","last_undegraded":"2024-04-26T07:48:48.224666+0000","last_fullsized":"2024-04-26T07:48:48.224666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780206+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:48:47.780206+0000","last_peered":"2024-04-26T07:48:47.780206+0000","last_clean":"2024-04-26T07:48:47.780206+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:48:47.780206+0000","last_undegraded":"2024-04-26T07:48:47.780206+0000","last_fullsized":"2024-04-26T07:48:47.780206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421440+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:48:48.421440+0000","last_peered":"2024-04-26T07:48:48.421440+0000","last_clean":"2024-04-26T07:48:48.421440+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:48:48.421440+0000","last_undegraded":"2024-04-26T07:48:48.421440+0000","last_fullsized":"2024-04-26T07:48:48.421440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219119+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:48:48.219119+0000","last_peered":"2024-04-26T07:48:48.219119+0000","last_clean":"2024-04-26T07:48:48.219119+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:48:48.219119+0000","last_undegraded":"2024-04-26T07:48:48.219119+0000","last_fullsized":"2024-04-26T07:48:48.219119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560935+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:48:47.560935+0000","last_peered":"2024-04-26T07:48:47.560935+0000","last_clean":"2024-04-26T07:48:47.560935+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:48:47.560935+0000","last_undegraded":"2024-04-26T07:48:47.560935+0000","last_fullsized":"2024-04-26T07:48:47.560935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225700+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:48:48.225700+0000","last_peered":"2024-04-26T07:48:48.225700+0000","last_clean":"2024-04-26T07:48:48.225700+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:48:48.225700+0000","last_undegraded":"2024-04-26T07:48:48.225700+0000","last_fullsized":"2024-04-26T07:48:48.225700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581583+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:48:48.581583+0000","last_peered":"2024-04-26T07:48:48.581583+0000","last_clean":"2024-04-26T07:48:48.581583+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:48:48.581583+0000","last_undegraded":"2024-04-26T07:48:48.581583+0000","last_fullsized":"2024-04-26T07:48:48.581583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420538+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:48:48.420538+0000","last_peered":"2024-04-26T07:48:48.420538+0000","last_clean":"2024-04-26T07:48:48.420538+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:48:48.420538+0000","last_undegraded":"2024-04-26T07:48:48.420538+0000","last_fullsized":"2024-04-26T07:48:48.420538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.779973+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:48:47.779973+0000","last_peered":"2024-04-26T07:48:47.779973+0000","last_clean":"2024-04-26T07:48:47.779973+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:48:47.779973+0000","last_undegraded":"2024-04-26T07:48:47.779973+0000","last_fullsized":"2024-04-26T07:48:47.779973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422573+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:48:48.422573+0000","last_peered":"2024-04-26T07:48:48.422573+0000","last_clean":"2024-04-26T07:48:48.422573+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:48:48.422573+0000","last_undegraded":"2024-04-26T07:48:48.422573+0000","last_fullsized":"2024-04-26T07:48:48.422573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781557+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:48:47.781557+0000","last_peered":"2024-04-26T07:48:47.781557+0000","last_clean":"2024-04-26T07:48:47.781557+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:48:47.781557+0000","last_undegraded":"2024-04-26T07:48:47.781557+0000","last_fullsized":"2024-04-26T07:48:47.781557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561824+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:48:47.561824+0000","last_peered":"2024-04-26T07:48:47.561824+0000","last_clean":"2024-04-26T07:48:47.561824+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:48:47.561824+0000","last_undegraded":"2024-04-26T07:48:47.561824+0000","last_fullsized":"2024-04-26T07:48:47.561824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561336+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:48:47.561336+0000","last_peered":"2024-04-26T07:48:47.561336+0000","last_clean":"2024-04-26T07:48:47.561336+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:48:47.561336+0000","last_undegraded":"2024-04-26T07:48:47.561336+0000","last_fullsized":"2024-04-26T07:48:47.561336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218110+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:48:48.218110+0000","last_peered":"2024-04-26T07:48:48.218110+0000","last_clean":"2024-04-26T07:48:48.218110+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:48:48.218110+0000","last_undegraded":"2024-04-26T07:48:48.218110+0000","last_fullsized":"2024-04-26T07:48:48.218110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563689+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:48:47.563689+0000","last_peered":"2024-04-26T07:48:47.563689+0000","last_clean":"2024-04-26T07:48:47.563689+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:48:47.563689+0000","last_undegraded":"2024-04-26T07:48:47.563689+0000","last_fullsized":"2024-04-26T07:48:47.563689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559694+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:48:47.559694+0000","last_peered":"2024-04-26T07:48:47.559694+0000","last_clean":"2024-04-26T07:48:47.559694+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:48:47.559694+0000","last_undegraded":"2024-04-26T07:48:47.559694+0000","last_fullsized":"2024-04-26T07:48:47.559694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781525+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:48:47.781525+0000","last_peered":"2024-04-26T07:48:47.781525+0000","last_clean":"2024-04-26T07:48:47.781525+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:48:47.781525+0000","last_undegraded":"2024-04-26T07:48:47.781525+0000","last_fullsized":"2024-04-26T07:48:47.781525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523686+0000","last_change":"2024-04-26T07:48:15.517260+0000","last_active":"2024-04-26T07:48:47.523686+0000","last_peered":"2024-04-26T07:48:47.523686+0000","last_clean":"2024-04-26T07:48:47.523686+0000","last_became_active":"2024-04-26T07:48:15.516567+0000","last_became_peered":"2024-04-26T07:48:15.516567+0000","last_unstale":"2024-04-26T07:48:47.523686+0000","last_undegraded":"2024-04-26T07:48:47.523686+0000","last_fullsized":"2024-04-26T07:48:47.523686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:31.670456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580552+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:48:48.580552+0000","last_peered":"2024-04-26T07:48:48.580552+0000","last_clean":"2024-04-26T07:48:48.580552+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:48:48.580552+0000","last_undegraded":"2024-04-26T07:48:48.580552+0000","last_fullsized":"2024-04-26T07:48:48.580552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781308+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:48:47.781308+0000","last_peered":"2024-04-26T07:48:47.781308+0000","last_clean":"2024-04-26T07:48:47.781308+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:48:47.781308+0000","last_undegraded":"2024-04-26T07:48:47.781308+0000","last_fullsized":"2024-04-26T07:48:47.781308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420694+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:48:48.420694+0000","last_peered":"2024-04-26T07:48:48.420694+0000","last_clean":"2024-04-26T07:48:48.420694+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:48:48.420694+0000","last_undegraded":"2024-04-26T07:48:48.420694+0000","last_fullsized":"2024-04-26T07:48:48.420694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225979+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:48:48.225979+0000","last_peered":"2024-04-26T07:48:48.225979+0000","last_clean":"2024-04-26T07:48:48.225979+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:48:48.225979+0000","last_undegraded":"2024-04-26T07:48:48.225979+0000","last_fullsized":"2024-04-26T07:48:48.225979+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220328+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:48:48.220328+0000","last_peered":"2024-04-26T07:48:48.220328+0000","last_clean":"2024-04-26T07:48:48.220328+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:48:48.220328+0000","last_undegraded":"2024-04-26T07:48:48.220328+0000","last_fullsized":"2024-04-26T07:48:48.220328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225759+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:48:48.225759+0000","last_peered":"2024-04-26T07:48:48.225759+0000","last_clean":"2024-04-26T07:48:48.225759+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:48:48.225759+0000","last_undegraded":"2024-04-26T07:48:48.225759+0000","last_fullsized":"2024-04-26T07:48:48.225759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780414+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:48:47.780414+0000","last_peered":"2024-04-26T07:48:47.780414+0000","last_clean":"2024-04-26T07:48:47.780414+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:48:47.780414+0000","last_undegraded":"2024-04-26T07:48:47.780414+0000","last_fullsized":"2024-04-26T07:48:47.780414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218413+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:48:48.218413+0000","last_peered":"2024-04-26T07:48:48.218413+0000","last_clean":"2024-04-26T07:48:48.218413+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:48:48.218413+0000","last_undegraded":"2024-04-26T07:48:48.218413+0000","last_fullsized":"2024-04-26T07:48:48.218413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218681+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:48:48.218681+0000","last_peered":"2024-04-26T07:48:48.218681+0000","last_clean":"2024-04-26T07:48:48.218681+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:48:48.218681+0000","last_undegraded":"2024-04-26T07:48:48.218681+0000","last_fullsized":"2024-04-26T07:48:48.218681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225812+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:48:48.225812+0000","last_peered":"2024-04-26T07:48:48.225812+0000","last_clean":"2024-04-26T07:48:48.225812+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:48:48.225812+0000","last_undegraded":"2024-04-26T07:48:48.225812+0000","last_fullsized":"2024-04-26T07:48:48.225812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561536+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:48:47.561536+0000","last_peered":"2024-04-26T07:48:47.561536+0000","last_clean":"2024-04-26T07:48:47.561536+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:48:47.561536+0000","last_undegraded":"2024-04-26T07:48:47.561536+0000","last_fullsized":"2024-04-26T07:48:47.561536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217383+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:48:48.217383+0000","last_peered":"2024-04-26T07:48:48.217383+0000","last_clean":"2024-04-26T07:48:48.217383+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:48:48.217383+0000","last_undegraded":"2024-04-26T07:48:48.217383+0000","last_fullsized":"2024-04-26T07:48:48.217383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564396+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:48:47.564396+0000","last_peered":"2024-04-26T07:48:47.564396+0000","last_clean":"2024-04-26T07:48:47.564396+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:48:47.564396+0000","last_undegraded":"2024-04-26T07:48:47.564396+0000","last_fullsized":"2024-04-26T07:48:47.564396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581983+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:48:48.581983+0000","last_peered":"2024-04-26T07:48:48.581983+0000","last_clean":"2024-04-26T07:48:48.581983+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:48:48.581983+0000","last_undegraded":"2024-04-26T07:48:48.581983+0000","last_fullsized":"2024-04-26T07:48:48.581983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220184+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:48:48.220184+0000","last_peered":"2024-04-26T07:48:48.220184+0000","last_clean":"2024-04-26T07:48:48.220184+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:48:48.220184+0000","last_undegraded":"2024-04-26T07:48:48.220184+0000","last_fullsized":"2024-04-26T07:48:48.220184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521597+0000","last_change":"2024-04-26T07:48:27.655376+0000","last_active":"2024-04-26T07:48:47.521597+0000","last_peered":"2024-04-26T07:48:47.521597+0000","last_clean":"2024-04-26T07:48:47.521597+0000","last_became_active":"2024-04-26T07:48:27.654669+0000","last_became_peered":"2024-04-26T07:48:27.654669+0000","last_unstale":"2024-04-26T07:48:47.521597+0000","last_undegraded":"2024-04-26T07:48:47.521597+0000","last_fullsized":"2024-04-26T07:48:47.521597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220860+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:48:48.220860+0000","last_peered":"2024-04-26T07:48:48.220860+0000","last_clean":"2024-04-26T07:48:48.220860+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:48:48.220860+0000","last_undegraded":"2024-04-26T07:48:48.220860+0000","last_fullsized":"2024-04-26T07:48:48.220860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421855+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:48:48.421855+0000","last_peered":"2024-04-26T07:48:48.421855+0000","last_clean":"2024-04-26T07:48:48.421855+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:48:48.421855+0000","last_undegraded":"2024-04-26T07:48:48.421855+0000","last_fullsized":"2024-04-26T07:48:48.421855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.563834+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:48:47.563834+0000","last_peered":"2024-04-26T07:48:47.563834+0000","last_clean":"2024-04-26T07:48:47.563834+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:48:47.563834+0000","last_undegraded":"2024-04-26T07:48:47.563834+0000","last_fullsized":"2024-04-26T07:48:47.563834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216998+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:48:48.216998+0000","last_peered":"2024-04-26T07:48:48.216998+0000","last_clean":"2024-04-26T07:48:48.216998+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:48:48.216998+0000","last_undegraded":"2024-04-26T07:48:48.216998+0000","last_fullsized":"2024-04-26T07:48:48.216998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219173+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:48:48.219173+0000","last_peered":"2024-04-26T07:48:48.219173+0000","last_clean":"2024-04-26T07:48:48.219173+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:48:48.219173+0000","last_undegraded":"2024-04-26T07:48:48.219173+0000","last_fullsized":"2024-04-26T07:48:48.219173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781169+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:48:47.781169+0000","last_peered":"2024-04-26T07:48:47.781169+0000","last_clean":"2024-04-26T07:48:47.781169+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:48:47.781169+0000","last_undegraded":"2024-04-26T07:48:47.781169+0000","last_fullsized":"2024-04-26T07:48:47.781169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221980+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:48:48.221980+0000","last_peered":"2024-04-26T07:48:48.221980+0000","last_clean":"2024-04-26T07:48:48.221980+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:48:48.221980+0000","last_undegraded":"2024-04-26T07:48:48.221980+0000","last_fullsized":"2024-04-26T07:48:48.221980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220078+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:48:48.220078+0000","last_peered":"2024-04-26T07:48:48.220078+0000","last_clean":"2024-04-26T07:48:48.220078+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:48:48.220078+0000","last_undegraded":"2024-04-26T07:48:48.220078+0000","last_fullsized":"2024-04-26T07:48:48.220078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225475+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:48:48.225475+0000","last_peered":"2024-04-26T07:48:48.225475+0000","last_clean":"2024-04-26T07:48:48.225475+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:48:48.225475+0000","last_undegraded":"2024-04-26T07:48:48.225475+0000","last_fullsized":"2024-04-26T07:48:48.225475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780159+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:48:47.780159+0000","last_peered":"2024-04-26T07:48:47.780159+0000","last_clean":"2024-04-26T07:48:47.780159+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:48:47.780159+0000","last_undegraded":"2024-04-26T07:48:47.780159+0000","last_fullsized":"2024-04-26T07:48:47.780159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523135+0000","last_change":"2024-04-26T07:48:21.522429+0000","last_active":"2024-04-26T07:48:47.523135+0000","last_peered":"2024-04-26T07:48:47.523135+0000","last_clean":"2024-04-26T07:48:47.523135+0000","last_became_active":"2024-04-26T07:48:21.521246+0000","last_became_peered":"2024-04-26T07:48:21.521246+0000","last_unstale":"2024-04-26T07:48:47.523135+0000","last_undegraded":"2024-04-26T07:48:47.523135+0000","last_fullsized":"2024-04-26T07:48:47.523135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225015+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:48:48.225015+0000","last_peered":"2024-04-26T07:48:48.225015+0000","last_clean":"2024-04-26T07:48:48.225015+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:48:48.225015+0000","last_undegraded":"2024-04-26T07:48:48.225015+0000","last_fullsized":"2024-04-26T07:48:48.225015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'4","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561121+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:48:47.561121+0000","last_peered":"2024-04-26T07:48:47.561121+0000","last_clean":"2024-04-26T07:48:47.561121+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:48:47.561121+0000","last_undegraded":"2024-04-26T07:48:47.561121+0000","last_fullsized":"2024-04-26T07:48:47.561121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521305+0000","last_change":"2024-04-26T07:48:29.582765+0000","last_active":"2024-04-26T07:48:47.521305+0000","last_peered":"2024-04-26T07:48:47.521305+0000","last_clean":"2024-04-26T07:48:47.521305+0000","last_became_active":"2024-04-26T07:48:29.581836+0000","last_became_peered":"2024-04-26T07:48:29.581836+0000","last_unstale":"2024-04-26T07:48:47.521305+0000","last_undegraded":"2024-04-26T07:48:47.521305+0000","last_fullsized":"2024-04-26T07:48:47.521305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560834+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:48:47.560834+0000","last_peered":"2024-04-26T07:48:47.560834+0000","last_clean":"2024-04-26T07:48:47.560834+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:48:47.560834+0000","last_undegraded":"2024-04-26T07:48:47.560834+0000","last_fullsized":"2024-04-26T07:48:47.560834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223029+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:48:48.223029+0000","last_peered":"2024-04-26T07:48:48.223029+0000","last_clean":"2024-04-26T07:48:48.223029+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:48:48.223029+0000","last_undegraded":"2024-04-26T07:48:48.223029+0000","last_fullsized":"2024-04-26T07:48:48.223029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422422+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:48:48.422422+0000","last_peered":"2024-04-26T07:48:48.422422+0000","last_clean":"2024-04-26T07:48:48.422422+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:48:48.422422+0000","last_undegraded":"2024-04-26T07:48:48.422422+0000","last_fullsized":"2024-04-26T07:48:48.422422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.520911+0000","last_change":"2024-04-26T07:48:25.575678+0000","last_active":"2024-04-26T07:48:47.520911+0000","last_peered":"2024-04-26T07:48:47.520911+0000","last_clean":"2024-04-26T07:48:47.520911+0000","last_became_active":"2024-04-26T07:48:25.574985+0000","last_became_peered":"2024-04-26T07:48:25.574985+0000","last_unstale":"2024-04-26T07:48:47.520911+0000","last_undegraded":"2024-04-26T07:48:47.520911+0000","last_fullsized":"2024-04-26T07:48:47.520911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.224176+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:48:48.224176+0000","last_peered":"2024-04-26T07:48:48.224176+0000","last_clean":"2024-04-26T07:48:48.224176+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:48:48.224176+0000","last_undegraded":"2024-04-26T07:48:48.224176+0000","last_fullsized":"2024-04-26T07:48:48.224176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580569+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:48:48.580569+0000","last_peered":"2024-04-26T07:48:48.580569+0000","last_clean":"2024-04-26T07:48:48.580569+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:48:48.580569+0000","last_undegraded":"2024-04-26T07:48:48.580569+0000","last_fullsized":"2024-04-26T07:48:48.580569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421523+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:48:48.421523+0000","last_peered":"2024-04-26T07:48:48.421523+0000","last_clean":"2024-04-26T07:48:48.421523+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:48:48.421523+0000","last_undegraded":"2024-04-26T07:48:48.421523+0000","last_fullsized":"2024-04-26T07:48:48.421523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220455+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:48:48.220455+0000","last_peered":"2024-04-26T07:48:48.220455+0000","last_clean":"2024-04-26T07:48:48.220455+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:48:48.220455+0000","last_undegraded":"2024-04-26T07:48:48.220455+0000","last_fullsized":"2024-04-26T07:48:48.220455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564209+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:48:47.564209+0000","last_peered":"2024-04-26T07:48:47.564209+0000","last_clean":"2024-04-26T07:48:47.564209+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:48:47.564209+0000","last_undegraded":"2024-04-26T07:48:47.564209+0000","last_fullsized":"2024-04-26T07:48:47.564209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580891+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:48:48.580891+0000","last_peered":"2024-04-26T07:48:48.580891+0000","last_clean":"2024-04-26T07:48:48.580891+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:48:48.580891+0000","last_undegraded":"2024-04-26T07:48:48.580891+0000","last_fullsized":"2024-04-26T07:48:48.580891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521577+0000","last_change":"2024-04-26T07:48:27.575530+0000","last_active":"2024-04-26T07:48:47.521577+0000","last_peered":"2024-04-26T07:48:47.521577+0000","last_clean":"2024-04-26T07:48:47.521577+0000","last_became_active":"2024-04-26T07:48:27.574659+0000","last_became_peered":"2024-04-26T07:48:27.574659+0000","last_unstale":"2024-04-26T07:48:47.521577+0000","last_undegraded":"2024-04-26T07:48:47.521577+0000","last_fullsized":"2024-04-26T07:48:47.521577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561663+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:48:47.561663+0000","last_peered":"2024-04-26T07:48:47.561663+0000","last_clean":"2024-04-26T07:48:47.561663+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:48:47.561663+0000","last_undegraded":"2024-04-26T07:48:47.561663+0000","last_fullsized":"2024-04-26T07:48:47.561663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581854+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:48:48.581854+0000","last_peered":"2024-04-26T07:48:48.581854+0000","last_clean":"2024-04-26T07:48:48.581854+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:48:48.581854+0000","last_undegraded":"2024-04-26T07:48:48.581854+0000","last_fullsized":"2024-04-26T07:48:48.581854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220611+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:48:48.220611+0000","last_peered":"2024-04-26T07:48:48.220611+0000","last_clean":"2024-04-26T07:48:48.220611+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:48:48.220611+0000","last_undegraded":"2024-04-26T07:48:48.220611+0000","last_fullsized":"2024-04-26T07:48:48.220611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564246+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:48:47.564246+0000","last_peered":"2024-04-26T07:48:47.564246+0000","last_clean":"2024-04-26T07:48:47.564246+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:48:47.564246+0000","last_undegraded":"2024-04-26T07:48:47.564246+0000","last_fullsized":"2024-04-26T07:48:47.564246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781504+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:48:47.781504+0000","last_peered":"2024-04-26T07:48:47.781504+0000","last_clean":"2024-04-26T07:48:47.781504+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:48:47.781504+0000","last_undegraded":"2024-04-26T07:48:47.781504+0000","last_fullsized":"2024-04-26T07:48:47.781504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421702+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:48:48.421702+0000","last_peered":"2024-04-26T07:48:48.421702+0000","last_clean":"2024-04-26T07:48:48.421702+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:48:48.421702+0000","last_undegraded":"2024-04-26T07:48:48.421702+0000","last_fullsized":"2024-04-26T07:48:48.421702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219892+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:48:48.219892+0000","last_peered":"2024-04-26T07:48:48.219892+0000","last_clean":"2024-04-26T07:48:48.219892+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:48:48.219892+0000","last_undegraded":"2024-04-26T07:48:48.219892+0000","last_fullsized":"2024-04-26T07:48:48.219892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559861+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:48:47.559861+0000","last_peered":"2024-04-26T07:48:47.559861+0000","last_clean":"2024-04-26T07:48:47.559861+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:48:47.559861+0000","last_undegraded":"2024-04-26T07:48:47.559861+0000","last_fullsized":"2024-04-26T07:48:47.559861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781841+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:48:47.781841+0000","last_peered":"2024-04-26T07:48:47.781841+0000","last_clean":"2024-04-26T07:48:47.781841+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:48:47.781841+0000","last_undegraded":"2024-04-26T07:48:47.781841+0000","last_fullsized":"2024-04-26T07:48:47.781841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581638+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:48:48.581638+0000","last_peered":"2024-04-26T07:48:48.581638+0000","last_clean":"2024-04-26T07:48:48.581638+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:48:48.581638+0000","last_undegraded":"2024-04-26T07:48:48.581638+0000","last_fullsized":"2024-04-26T07:48:48.581638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522129+0000","last_change":"2024-04-26T07:48:27.578601+0000","last_active":"2024-04-26T07:48:47.522129+0000","last_peered":"2024-04-26T07:48:47.522129+0000","last_clean":"2024-04-26T07:48:47.522129+0000","last_became_active":"2024-04-26T07:48:27.577870+0000","last_became_peered":"2024-04-26T07:48:27.577870+0000","last_unstale":"2024-04-26T07:48:47.522129+0000","last_undegraded":"2024-04-26T07:48:47.522129+0000","last_fullsized":"2024-04-26T07:48:47.522129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781671+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:48:47.781671+0000","last_peered":"2024-04-26T07:48:47.781671+0000","last_clean":"2024-04-26T07:48:47.781671+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:48:47.781671+0000","last_undegraded":"2024-04-26T07:48:47.781671+0000","last_fullsized":"2024-04-26T07:48:47.781671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580388+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:48:48.580388+0000","last_peered":"2024-04-26T07:48:48.580388+0000","last_clean":"2024-04-26T07:48:48.580388+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:48:48.580388+0000","last_undegraded":"2024-04-26T07:48:48.580388+0000","last_fullsized":"2024-04-26T07:48:48.580388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225793+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:48:48.225793+0000","last_peered":"2024-04-26T07:48:48.225793+0000","last_clean":"2024-04-26T07:48:48.225793+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:48:48.225793+0000","last_undegraded":"2024-04-26T07:48:48.225793+0000","last_fullsized":"2024-04-26T07:48:48.225793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218974+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:48:48.218974+0000","last_peered":"2024-04-26T07:48:48.218974+0000","last_clean":"2024-04-26T07:48:48.218974+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:48:48.218974+0000","last_undegraded":"2024-04-26T07:48:48.218974+0000","last_fullsized":"2024-04-26T07:48:48.218974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219853+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:48:48.219853+0000","last_peered":"2024-04-26T07:48:48.219853+0000","last_clean":"2024-04-26T07:48:48.219853+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:48:48.219853+0000","last_undegraded":"2024-04-26T07:48:48.219853+0000","last_fullsized":"2024-04-26T07:48:48.219853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226120+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:48:48.226120+0000","last_peered":"2024-04-26T07:48:48.226120+0000","last_clean":"2024-04-26T07:48:48.226120+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:48:48.226120+0000","last_undegraded":"2024-04-26T07:48:48.226120+0000","last_fullsized":"2024-04-26T07:48:48.226120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781903+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:48:47.781903+0000","last_peered":"2024-04-26T07:48:47.781903+0000","last_clean":"2024-04-26T07:48:47.781903+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:48:47.781903+0000","last_undegraded":"2024-04-26T07:48:47.781903+0000","last_fullsized":"2024-04-26T07:48:47.781903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420933+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:48:48.420933+0000","last_peered":"2024-04-26T07:48:48.420933+0000","last_clean":"2024-04-26T07:48:48.420933+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:48:48.420933+0000","last_undegraded":"2024-04-26T07:48:48.420933+0000","last_fullsized":"2024-04-26T07:48:48.420933+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.221787+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:48:48.221787+0000","last_peered":"2024-04-26T07:48:48.221787+0000","last_clean":"2024-04-26T07:48:48.221787+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:48:48.221787+0000","last_undegraded":"2024-04-26T07:48:48.221787+0000","last_fullsized":"2024-04-26T07:48:48.221787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561703+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:48:47.561703+0000","last_peered":"2024-04-26T07:48:47.561703+0000","last_clean":"2024-04-26T07:48:47.561703+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:48:47.561703+0000","last_undegraded":"2024-04-26T07:48:47.561703+0000","last_fullsized":"2024-04-26T07:48:47.561703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781824+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:48:47.781824+0000","last_peered":"2024-04-26T07:48:47.781824+0000","last_clean":"2024-04-26T07:48:47.781824+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:48:47.781824+0000","last_undegraded":"2024-04-26T07:48:47.781824+0000","last_fullsized":"2024-04-26T07:48:47.781824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219878+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:48:48.219878+0000","last_peered":"2024-04-26T07:48:48.219878+0000","last_clean":"2024-04-26T07:48:48.219878+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:48:48.219878+0000","last_undegraded":"2024-04-26T07:48:48.219878+0000","last_fullsized":"2024-04-26T07:48:48.219878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581144+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:48:48.581144+0000","last_peered":"2024-04-26T07:48:48.581144+0000","last_clean":"2024-04-26T07:48:48.581144+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:48:48.581144+0000","last_undegraded":"2024-04-26T07:48:48.581144+0000","last_fullsized":"2024-04-26T07:48:48.581144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.520862+0000","last_change":"2024-04-26T07:48:31.605556+0000","last_active":"2024-04-26T07:48:47.520862+0000","last_peered":"2024-04-26T07:48:47.520862+0000","last_clean":"2024-04-26T07:48:47.520862+0000","last_became_active":"2024-04-26T07:48:31.604886+0000","last_became_peered":"2024-04-26T07:48:31.604886+0000","last_unstale":"2024-04-26T07:48:47.520862+0000","last_undegraded":"2024-04-26T07:48:47.520862+0000","last_fullsized":"2024-04-26T07:48:47.520862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217537+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:48:48.217537+0000","last_peered":"2024-04-26T07:48:48.217537+0000","last_clean":"2024-04-26T07:48:48.217537+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:48:48.217537+0000","last_undegraded":"2024-04-26T07:48:48.217537+0000","last_fullsized":"2024-04-26T07:48:48.217537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421869+0000","last_change":"2024-04-26T07:48:21.523345+0000","last_active":"2024-04-26T07:48:48.421869+0000","last_peered":"2024-04-26T07:48:48.421869+0000","last_clean":"2024-04-26T07:48:48.421869+0000","last_became_active":"2024-04-26T07:48:21.521160+0000","last_became_peered":"2024-04-26T07:48:21.521160+0000","last_unstale":"2024-04-26T07:48:48.421869+0000","last_undegraded":"2024-04-26T07:48:48.421869+0000","last_fullsized":"2024-04-26T07:48:48.421869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521831+0000","last_change":"2024-04-26T07:48:25.576286+0000","last_active":"2024-04-26T07:48:47.521831+0000","last_peered":"2024-04-26T07:48:47.521831+0000","last_clean":"2024-04-26T07:48:47.521831+0000","last_became_active":"2024-04-26T07:48:25.575505+0000","last_became_peered":"2024-04-26T07:48:25.575505+0000","last_unstale":"2024-04-26T07:48:47.521831+0000","last_undegraded":"2024-04-26T07:48:47.521831+0000","last_fullsized":"2024-04-26T07:48:47.521831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421124+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:48:48.421124+0000","last_peered":"2024-04-26T07:48:48.421124+0000","last_clean":"2024-04-26T07:48:48.421124+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:48:48.421124+0000","last_undegraded":"2024-04-26T07:48:48.421124+0000","last_fullsized":"2024-04-26T07:48:48.421124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560163+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:48:47.560163+0000","last_peered":"2024-04-26T07:48:47.560163+0000","last_clean":"2024-04-26T07:48:47.560163+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:48:47.560163+0000","last_undegraded":"2024-04-26T07:48:47.560163+0000","last_fullsized":"2024-04-26T07:48:47.560163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523466+0000","last_change":"2024-04-26T07:48:31.598704+0000","last_active":"2024-04-26T07:48:47.523466+0000","last_peered":"2024-04-26T07:48:47.523466+0000","last_clean":"2024-04-26T07:48:47.523466+0000","last_became_active":"2024-04-26T07:48:31.597882+0000","last_became_peered":"2024-04-26T07:48:31.597882+0000","last_unstale":"2024-04-26T07:48:47.523466+0000","last_undegraded":"2024-04-26T07:48:47.523466+0000","last_fullsized":"2024-04-26T07:48:47.523466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217112+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:48:48.217112+0000","last_peered":"2024-04-26T07:48:48.217112+0000","last_clean":"2024-04-26T07:48:48.217112+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:48:48.217112+0000","last_undegraded":"2024-04-26T07:48:48.217112+0000","last_fullsized":"2024-04-26T07:48:48.217112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422501+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:48:48.422501+0000","last_peered":"2024-04-26T07:48:48.422501+0000","last_clean":"2024-04-26T07:48:48.422501+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:48:48.422501+0000","last_undegraded":"2024-04-26T07:48:48.422501+0000","last_fullsized":"2024-04-26T07:48:48.422501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421357+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:48:48.421357+0000","last_peered":"2024-04-26T07:48:48.421357+0000","last_clean":"2024-04-26T07:48:48.421357+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:48:48.421357+0000","last_undegraded":"2024-04-26T07:48:48.421357+0000","last_fullsized":"2024-04-26T07:48:48.421357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560444+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:48:47.560444+0000","last_peered":"2024-04-26T07:48:47.560444+0000","last_clean":"2024-04-26T07:48:47.560444+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:48:47.560444+0000","last_undegraded":"2024-04-26T07:48:47.560444+0000","last_fullsized":"2024-04-26T07:48:47.560444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580520+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:48:48.580520+0000","last_peered":"2024-04-26T07:48:48.580520+0000","last_clean":"2024-04-26T07:48:48.580520+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:48:48.580520+0000","last_undegraded":"2024-04-26T07:48:48.580520+0000","last_fullsized":"2024-04-26T07:48:48.580520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225548+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:48:48.225548+0000","last_peered":"2024-04-26T07:48:48.225548+0000","last_clean":"2024-04-26T07:48:48.225548+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:48:48.225548+0000","last_undegraded":"2024-04-26T07:48:48.225548+0000","last_fullsized":"2024-04-26T07:48:48.225548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223401+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:48:48.223401+0000","last_peered":"2024-04-26T07:48:48.223401+0000","last_clean":"2024-04-26T07:48:48.223401+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:48:48.223401+0000","last_undegraded":"2024-04-26T07:48:48.223401+0000","last_fullsized":"2024-04-26T07:48:48.223401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225814+0000","last_change":"2024-04-26T07:48:21.503786+0000","last_active":"2024-04-26T07:48:48.225814+0000","last_peered":"2024-04-26T07:48:48.225814+0000","last_clean":"2024-04-26T07:48:48.225814+0000","last_became_active":"2024-04-26T07:48:21.503422+0000","last_became_peered":"2024-04-26T07:48:21.503422+0000","last_unstale":"2024-04-26T07:48:48.225814+0000","last_undegraded":"2024-04-26T07:48:48.225814+0000","last_fullsized":"2024-04-26T07:48:48.225814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217954+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:48:48.217954+0000","last_peered":"2024-04-26T07:48:48.217954+0000","last_clean":"2024-04-26T07:48:48.217954+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:48:48.217954+0000","last_undegraded":"2024-04-26T07:48:48.217954+0000","last_fullsized":"2024-04-26T07:48:48.217954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225592+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:48:48.225592+0000","last_peered":"2024-04-26T07:48:48.225592+0000","last_clean":"2024-04-26T07:48:48.225592+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:48:48.225592+0000","last_undegraded":"2024-04-26T07:48:48.225592+0000","last_fullsized":"2024-04-26T07:48:48.225592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218107+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:48:48.218107+0000","last_peered":"2024-04-26T07:48:48.218107+0000","last_clean":"2024-04-26T07:48:48.218107+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:48:48.218107+0000","last_undegraded":"2024-04-26T07:48:48.218107+0000","last_fullsized":"2024-04-26T07:48:48.218107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522599+0000","last_change":"2024-04-26T07:48:31.591594+0000","last_active":"2024-04-26T07:48:47.522599+0000","last_peered":"2024-04-26T07:48:47.522599+0000","last_clean":"2024-04-26T07:48:47.522599+0000","last_became_active":"2024-04-26T07:48:31.590889+0000","last_became_peered":"2024-04-26T07:48:31.590889+0000","last_unstale":"2024-04-26T07:48:47.522599+0000","last_undegraded":"2024-04-26T07:48:47.522599+0000","last_fullsized":"2024-04-26T07:48:47.522599+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216928+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:48:48.216928+0000","last_peered":"2024-04-26T07:48:48.216928+0000","last_clean":"2024-04-26T07:48:48.216928+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:48:48.216928+0000","last_undegraded":"2024-04-26T07:48:48.216928+0000","last_fullsized":"2024-04-26T07:48:48.216928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.564045+0000","last_change":"2024-04-26T07:48:21.506013+0000","last_active":"2024-04-26T07:48:47.564045+0000","last_peered":"2024-04-26T07:48:47.564045+0000","last_clean":"2024-04-26T07:48:47.564045+0000","last_became_active":"2024-04-26T07:48:21.505104+0000","last_became_peered":"2024-04-26T07:48:21.505104+0000","last_unstale":"2024-04-26T07:48:47.564045+0000","last_undegraded":"2024-04-26T07:48:47.564045+0000","last_fullsized":"2024-04-26T07:48:47.564045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781418+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:48:47.781418+0000","last_peered":"2024-04-26T07:48:47.781418+0000","last_clean":"2024-04-26T07:48:47.781418+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:48:47.781418+0000","last_undegraded":"2024-04-26T07:48:47.781418+0000","last_fullsized":"2024-04-26T07:48:47.781418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218297+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:48:48.218297+0000","last_peered":"2024-04-26T07:48:48.218297+0000","last_clean":"2024-04-26T07:48:48.218297+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:48:48.218297+0000","last_undegraded":"2024-04-26T07:48:48.218297+0000","last_fullsized":"2024-04-26T07:48:48.218297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561608+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:48:47.561608+0000","last_peered":"2024-04-26T07:48:47.561608+0000","last_clean":"2024-04-26T07:48:47.561608+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:48:47.561608+0000","last_undegraded":"2024-04-26T07:48:47.561608+0000","last_fullsized":"2024-04-26T07:48:47.561608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217300+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:48:48.217300+0000","last_peered":"2024-04-26T07:48:48.217300+0000","last_clean":"2024-04-26T07:48:48.217300+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:48:48.217300+0000","last_undegraded":"2024-04-26T07:48:48.217300+0000","last_fullsized":"2024-04-26T07:48:48.217300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780758+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:48:47.780758+0000","last_peered":"2024-04-26T07:48:47.780758+0000","last_clean":"2024-04-26T07:48:47.780758+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:48:47.780758+0000","last_undegraded":"2024-04-26T07:48:47.780758+0000","last_fullsized":"2024-04-26T07:48:47.780758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580366+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:48:48.580366+0000","last_peered":"2024-04-26T07:48:48.580366+0000","last_clean":"2024-04-26T07:48:48.580366+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:48:48.580366+0000","last_undegraded":"2024-04-26T07:48:48.580366+0000","last_fullsized":"2024-04-26T07:48:48.580366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780572+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:48:47.780572+0000","last_peered":"2024-04-26T07:48:47.780572+0000","last_clean":"2024-04-26T07:48:47.780572+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:48:47.780572+0000","last_undegraded":"2024-04-26T07:48:47.780572+0000","last_fullsized":"2024-04-26T07:48:47.780572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.219048+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:48:48.219048+0000","last_peered":"2024-04-26T07:48:48.219048+0000","last_clean":"2024-04-26T07:48:48.219048+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:48:48.219048+0000","last_undegraded":"2024-04-26T07:48:48.219048+0000","last_fullsized":"2024-04-26T07:48:48.219048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422101+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:48:48.422101+0000","last_peered":"2024-04-26T07:48:48.422101+0000","last_clean":"2024-04-26T07:48:48.422101+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:48:48.422101+0000","last_undegraded":"2024-04-26T07:48:48.422101+0000","last_fullsized":"2024-04-26T07:48:48.422101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421396+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:48:48.421396+0000","last_peered":"2024-04-26T07:48:48.421396+0000","last_clean":"2024-04-26T07:48:48.421396+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:48:48.421396+0000","last_undegraded":"2024-04-26T07:48:48.421396+0000","last_fullsized":"2024-04-26T07:48:48.421396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.780001+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:48:47.780001+0000","last_peered":"2024-04-26T07:48:47.780001+0000","last_clean":"2024-04-26T07:48:47.780001+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:48:47.780001+0000","last_undegraded":"2024-04-26T07:48:47.780001+0000","last_fullsized":"2024-04-26T07:48:47.780001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561785+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:48:47.561785+0000","last_peered":"2024-04-26T07:48:47.561785+0000","last_clean":"2024-04-26T07:48:47.561785+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:48:47.561785+0000","last_undegraded":"2024-04-26T07:48:47.561785+0000","last_fullsized":"2024-04-26T07:48:47.561785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225243+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:48:48.225243+0000","last_peered":"2024-04-26T07:48:48.225243+0000","last_clean":"2024-04-26T07:48:48.225243+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:48:48.225243+0000","last_undegraded":"2024-04-26T07:48:48.225243+0000","last_fullsized":"2024-04-26T07:48:48.225243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.226483+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:48:48.226483+0000","last_peered":"2024-04-26T07:48:48.226483+0000","last_clean":"2024-04-26T07:48:48.226483+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:48:48.226483+0000","last_undegraded":"2024-04-26T07:48:48.226483+0000","last_fullsized":"2024-04-26T07:48:48.226483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.216813+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:48:48.216813+0000","last_peered":"2024-04-26T07:48:48.216813+0000","last_clean":"2024-04-26T07:48:48.216813+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:48:48.216813+0000","last_undegraded":"2024-04-26T07:48:48.216813+0000","last_fullsized":"2024-04-26T07:48:48.216813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.782020+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:48:47.782020+0000","last_peered":"2024-04-26T07:48:47.782020+0000","last_clean":"2024-04-26T07:48:47.782020+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:48:47.782020+0000","last_undegraded":"2024-04-26T07:48:47.782020+0000","last_fullsized":"2024-04-26T07:48:47.782020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222804+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:48:48.222804+0000","last_peered":"2024-04-26T07:48:48.222804+0000","last_clean":"2024-04-26T07:48:48.222804+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:48:48.222804+0000","last_undegraded":"2024-04-26T07:48:48.222804+0000","last_fullsized":"2024-04-26T07:48:48.222804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581758+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:48:48.581758+0000","last_peered":"2024-04-26T07:48:48.581758+0000","last_clean":"2024-04-26T07:48:48.581758+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:48:48.581758+0000","last_undegraded":"2024-04-26T07:48:48.581758+0000","last_fullsized":"2024-04-26T07:48:48.581758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.580289+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:48:48.580289+0000","last_peered":"2024-04-26T07:48:48.580289+0000","last_clean":"2024-04-26T07:48:48.580289+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:48:48.580289+0000","last_undegraded":"2024-04-26T07:48:48.580289+0000","last_fullsized":"2024-04-26T07:48:48.580289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.225956+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:48:48.225956+0000","last_peered":"2024-04-26T07:48:48.225956+0000","last_clean":"2024-04-26T07:48:48.225956+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:48:48.225956+0000","last_undegraded":"2024-04-26T07:48:48.225956+0000","last_fullsized":"2024-04-26T07:48:48.225956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559867+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:48:47.559867+0000","last_peered":"2024-04-26T07:48:47.559867+0000","last_clean":"2024-04-26T07:48:47.559867+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:48:47.559867+0000","last_undegraded":"2024-04-26T07:48:47.559867+0000","last_fullsized":"2024-04-26T07:48:47.559867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420926+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:48:48.420926+0000","last_peered":"2024-04-26T07:48:48.420926+0000","last_clean":"2024-04-26T07:48:48.420926+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:48:48.420926+0000","last_undegraded":"2024-04-26T07:48:48.420926+0000","last_fullsized":"2024-04-26T07:48:48.420926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.218423+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:48:48.218423+0000","last_peered":"2024-04-26T07:48:48.218423+0000","last_clean":"2024-04-26T07:48:48.218423+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:48:48.218423+0000","last_undegraded":"2024-04-26T07:48:48.218423+0000","last_fullsized":"2024-04-26T07:48:48.218423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.223626+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:48:48.223626+0000","last_peered":"2024-04-26T07:48:48.223626+0000","last_clean":"2024-04-26T07:48:48.223626+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:48:48.223626+0000","last_undegraded":"2024-04-26T07:48:48.223626+0000","last_fullsized":"2024-04-26T07:48:48.223626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.220947+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:48:48.220947+0000","last_peered":"2024-04-26T07:48:48.220947+0000","last_clean":"2024-04-26T07:48:48.220947+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:48:48.220947+0000","last_undegraded":"2024-04-26T07:48:48.220947+0000","last_fullsized":"2024-04-26T07:48:48.220947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.421286+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:48:48.421286+0000","last_peered":"2024-04-26T07:48:48.421286+0000","last_clean":"2024-04-26T07:48:48.421286+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:48:48.421286+0000","last_undegraded":"2024-04-26T07:48:48.421286+0000","last_fullsized":"2024-04-26T07:48:48.421286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.217106+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:48:48.217106+0000","last_peered":"2024-04-26T07:48:48.217106+0000","last_clean":"2024-04-26T07:48:48.217106+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:48:48.217106+0000","last_undegraded":"2024-04-26T07:48:48.217106+0000","last_fullsized":"2024-04-26T07:48:48.217106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.561863+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:48:47.561863+0000","last_peered":"2024-04-26T07:48:47.561863+0000","last_clean":"2024-04-26T07:48:47.561863+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:48:47.561863+0000","last_undegraded":"2024-04-26T07:48:47.561863+0000","last_fullsized":"2024-04-26T07:48:47.561863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.522091+0000","last_change":"2024-04-26T07:48:23.552189+0000","last_active":"2024-04-26T07:48:47.522091+0000","last_peered":"2024-04-26T07:48:47.522091+0000","last_clean":"2024-04-26T07:48:47.522091+0000","last_became_active":"2024-04-26T07:48:23.547277+0000","last_became_peered":"2024-04-26T07:48:23.547277+0000","last_unstale":"2024-04-26T07:48:47.522091+0000","last_undegraded":"2024-04-26T07:48:47.522091+0000","last_fullsized":"2024-04-26T07:48:47.522091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.581576+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:48:48.581576+0000","last_peered":"2024-04-26T07:48:48.581576+0000","last_clean":"2024-04-26T07:48:48.581576+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:48:48.581576+0000","last_undegraded":"2024-04-26T07:48:48.581576+0000","last_fullsized":"2024-04-26T07:48:48.581576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.560498+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:48:47.560498+0000","last_peered":"2024-04-26T07:48:47.560498+0000","last_clean":"2024-04-26T07:48:47.560498+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:48:47.560498+0000","last_undegraded":"2024-04-26T07:48:47.560498+0000","last_fullsized":"2024-04-26T07:48:47.560498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.523594+0000","last_change":"2024-04-26T07:48:21.521908+0000","last_active":"2024-04-26T07:48:47.523594+0000","last_peered":"2024-04-26T07:48:47.523594+0000","last_clean":"2024-04-26T07:48:47.523594+0000","last_became_active":"2024-04-26T07:48:21.520599+0000","last_became_peered":"2024-04-26T07:48:21.520599+0000","last_unstale":"2024-04-26T07:48:47.523594+0000","last_undegraded":"2024-04-26T07:48:47.523594+0000","last_fullsized":"2024-04-26T07:48:47.523594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222573+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:48:48.222573+0000","last_peered":"2024-04-26T07:48:48.222573+0000","last_clean":"2024-04-26T07:48:48.222573+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:48:48.222573+0000","last_undegraded":"2024-04-26T07:48:48.222573+0000","last_fullsized":"2024-04-26T07:48:48.222573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.222379+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:48:48.222379+0000","last_peered":"2024-04-26T07:48:48.222379+0000","last_clean":"2024-04-26T07:48:48.222379+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:48:48.222379+0000","last_undegraded":"2024-04-26T07:48:48.222379+0000","last_fullsized":"2024-04-26T07:48:48.222379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.521392+0000","last_change":"2024-04-26T07:48:23.557177+0000","last_active":"2024-04-26T07:48:47.521392+0000","last_peered":"2024-04-26T07:48:47.521392+0000","last_clean":"2024-04-26T07:48:47.521392+0000","last_became_active":"2024-04-26T07:48:23.556564+0000","last_became_peered":"2024-04-26T07:48:23.556564+0000","last_unstale":"2024-04-26T07:48:47.521392+0000","last_undegraded":"2024-04-26T07:48:47.521392+0000","last_fullsized":"2024-04-26T07:48:47.521392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422719+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:48:48.422719+0000","last_peered":"2024-04-26T07:48:48.422719+0000","last_clean":"2024-04-26T07:48:48.422719+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:48:48.422719+0000","last_undegraded":"2024-04-26T07:48:48.422719+0000","last_fullsized":"2024-04-26T07:48:48.422719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.420840+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:48:48.420840+0000","last_peered":"2024-04-26T07:48:48.420840+0000","last_clean":"2024-04-26T07:48:48.420840+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:48:48.420840+0000","last_undegraded":"2024-04-26T07:48:48.420840+0000","last_fullsized":"2024-04-26T07:48:48.420840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.559886+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:48:47.559886+0000","last_peered":"2024-04-26T07:48:47.559886+0000","last_clean":"2024-04-26T07:48:47.559886+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:48:47.559886+0000","last_undegraded":"2024-04-26T07:48:47.559886+0000","last_fullsized":"2024-04-26T07:48:47.559886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T07:48:47.781741+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:48:47.781741+0000","last_peered":"2024-04-26T07:48:47.781741+0000","last_clean":"2024-04-26T07:48:47.781741+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:48:47.781741+0000","last_undegraded":"2024-04-26T07:48:47.781741+0000","last_fullsized":"2024-04-26T07:48:47.781741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T07:48:48.422244+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:48:48.422244+0000","last_peered":"2024-04-26T07:48:48.422244+0000","last_clean":"2024-04-26T07:48:48.422244+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:48:48.422244+0000","last_undegraded":"2024-04-26T07:48:48.422244+0000","last_fullsized":"2024-04-26T07:48:48.422244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":787911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":196883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":205353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":204023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":206350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":196445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":450560,"data_stored":197569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":788310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:48:51.148 INFO:tasks.thrashosds.thrasher:Setting 4.f to [3, 0] 2024-04-26T07:48:51.148 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.f', '3', '0'] 2024-04-26T07:48:51.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.f 3 0 2024-04-26T07:48:51.181 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:51.182+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:51.240 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:51.241 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:51.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:48:51.273 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:51.271+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:51.367 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:51.368 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:51.374 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:51.374+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:51.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:48:51.475 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:51.474+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:51.538 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:51.538 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:51.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:48:51.592 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:51.594+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:51.677 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:51.675+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:51.679 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:51.679 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:51.694 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:48:51.780 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:51.779+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:51.859 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:51.859 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:51.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:48:51.878 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:51.878+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:51.980 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:51.979+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:52.040 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:52.040 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:52.053 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:48:52.080 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:52.078+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:52.181 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:52.179+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:52.221 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:52.222 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:52.236 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:48:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:set 4.f pg_upmap mapping to [3,0] 2024-04-26T07:48:52.264 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:48:52.281 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:52.279+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:52.383 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:52.382+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:52.401 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:52.402 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:52.416 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:48:52.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:48:52.497 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:52.498+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:52.539 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:52.540 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:52.553 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:48:52.584 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:52.582+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:52.596 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:52.613 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:52.630 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:52.650 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:52.650 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:52.671 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:52.671 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:52.673 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:52.674 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:52.685 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:52.686+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:52.686 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:48:52.692 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:52.711 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:52.711 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:52.732 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:52.732 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:52.792 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:52.794+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:52.809 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:52.809 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:52.809 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:48:52.809 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:48:52.809 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:52.825 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:48:52.887 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:52.883+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:52.945 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.385366100999999, 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:48:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:48:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:48:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596391207936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.355029131999999, 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027719889999999999, 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 47 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588084+0000", 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.243e-06 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588093+0000", 2024-04-26T07:48:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6430000000000001e-06 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588113+0000", 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0051000000000002e-05 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588125+0000", 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2191000000000001e-05 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588218+0000", 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3253999999999999e-05 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588480+0000", 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026131800000000002 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588685+0000", 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020556099999999999 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.589677+0000", 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0009915569999999999 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590602+0000", 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00092485600000000005 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590702+0000", 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100116 2024-04-26T07:48:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590854+0000", 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000152199 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.338072736000001, 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024108010000000002, 2024-04-26T07:48:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 54 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605040+0000", 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.818e-06 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605049+0000", 2024-04-26T07:48:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7520000000000002e-06 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605072+0000", 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2787999999999999e-05 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605085+0000", 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3200000000000001e-05 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605179+0000", 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3969999999999996e-05 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605357+0000", 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178262 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605511+0000", 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153416 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.606471+0000", 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00096066599999999999 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607310+0000", 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00083910300000000001 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607369+0000", 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8854000000000003e-05 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607449+0000", 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9971999999999999e-05 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596391203328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.335454640999998, 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0021617260000000001, 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 55 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607658+0000", 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2300000000000001e-06 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607664+0000", 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.387e-06 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607681+0000", 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6796999999999999e-05 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607691+0000", 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9129999999999998e-06 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607768+0000", 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7732999999999996e-05 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607873+0000", 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104372 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.608054+0000", 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018165600000000001 2024-04-26T07:48:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609112+0000", 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010570969999999999 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609666+0000", 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00055467500000000002 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609733+0000", 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6896999999999993e-05 2024-04-26T07:48:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609818+0000", 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4969000000000006e-05 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:191 6.5 e26/23 6:a2ace8b3:::data_log.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.238653101000001, 2024-04-26T07:48:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017875160000000001, 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704460+0000", 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7999999999999999e-06 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704471+0000", 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1446e-05 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704502+0000", 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0800000000000003e-05 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704535+0000", 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2982999999999999e-05 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704667+0000", 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013210899999999999 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704717+0000", 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0355999999999997e-05 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.706111+0000", 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013940389999999999 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.706245+0000", 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013398300000000001 2024-04-26T07:48:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.326246285, 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032337429999999999, 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616866+0000", 2024-04-26T07:48:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.33e-07 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616878+0000", 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2193e-05 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616920+0000", 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2509999999999998e-05 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616942+0000", 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1990000000000001e-05 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.617092+0000", 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149636 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.617140+0000", 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8322000000000003e-05 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.619973+0000", 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028324069999999999 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.620099+0000", 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125752 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:231 6.1f e29/23 6:fde4dd55:gc::gc.26:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.235864630999998, 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001768026, 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707247+0000", 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0399999999999996e-07 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707256+0000", 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4499999999999993e-06 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707294+0000", 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7576000000000001e-05 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707319+0000", 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4865999999999999e-05 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707499+0000", 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000180469 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707534+0000", 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4873000000000003e-05 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.708937+0000", 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001402312 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709014+0000", 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7875999999999998e-05 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:320 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.198365771999999, 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027437310000000001, 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744746+0000", 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6299999999999993e-07 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744760+0000", 2024-04-26T07:48:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3893000000000001e-05 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744795+0000", 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4947000000000003e-05 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744817+0000", 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1605999999999999e-05 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744963+0000", 2024-04-26T07:48:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146205 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.745009+0000", 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6607000000000003e-05 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.747361+0000", 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002351414 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.747489+0000", 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012809599999999999 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:360 6.5 e29/23 6:a60f9269:lc::lua_package_allowlist:head v 29'2, mlcod=0'0)", 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.191154397999998, 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018680750000000001, 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751958+0000", 2024-04-26T07:48:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8330000000000001e-06 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751971+0000", 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2274e-05 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752013+0000", 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2281999999999999e-05 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752034+0000", 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0699999999999998e-05 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752254+0000", 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021995900000000001 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752306+0000", 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2349000000000003e-05 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753718+0000", 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014118049999999999 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753825+0000", 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106873 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:426 6.a e29/23 6:50d64734:::obj_delete_at_hint.0000000009:head v 29'2, mlcod=0'0)", 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.160540756, 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026612879999999999, 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782572+0000", 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0200000000000001e-06 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782585+0000", 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2186e-05 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782609+0000", 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4335999999999999e-05 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782621+0000", 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2217e-05 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782787+0000", 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016643199999999999 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782844+0000", 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6999000000000001e-05 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785144+0000", 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022998419999999999 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785232+0000", 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7256000000000006e-05 2024-04-26T07:48:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:434 6.a e29/23 6:50d64734:::obj_delete_at_hint.0000000009:head v 29'3, mlcod=29'1)", 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.155078838000001, 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018461549999999999, 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788034+0000", 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.114e-06 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788050+0000", 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5472999999999999e-05 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788089+0000", 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8748999999999998e-05 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788110+0000", 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1457000000000001e-05 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788216+0000", 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106403 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788259+0000", 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2517e-05 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789758+0000", 2024-04-26T07:48:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014993369999999999 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789878+0000", 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120105 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:436 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'1)", 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.152874237999999, 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017544170000000001, 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790239+0000", 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790281+0000", 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1689e-05 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790311+0000", 2024-04-26T07:48:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0658999999999999e-05 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790331+0000", 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9935000000000001e-05 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790467+0000", 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135301 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790516+0000", 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9839000000000002e-05 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791891+0000", 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013743270000000001 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791991+0000", 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010050700000000001 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:466 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'5, mlcod=29'3)", 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.137668831999999, 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001869601, 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805444+0000", 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.486e-06 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805453+0000", 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9730000000000003e-06 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805474+0000", 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1254999999999999e-05 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805485+0000", 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0992000000000001e-05 2024-04-26T07:48:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805605+0000", 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012044099999999999 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805659+0000", 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3721999999999998e-05 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.807238+0000", 2024-04-26T07:48:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015787150000000001 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.807312+0000", 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4017000000000006e-05 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:484 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'11, mlcod=29'9)", 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.130503734000001, 2024-04-26T07:48:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016497599999999999, 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812610+0000", 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.486e-06 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812625+0000", 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5339999999999999e-05 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812707+0000", 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2158999999999997e-05 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812726+0000", 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8654000000000001e-05 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812939+0000", 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000213358 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812998+0000", 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8383e-05 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.814148+0000", 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011502750000000001 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.814257+0000", 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010910500000000001 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:552 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T07:48:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.08793528, 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025138949999999999, 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855177+0000", 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.654e-06 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855191+0000", 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3719e-05 2024-04-26T07:48:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855219+0000", 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.794e-05 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855234+0000", 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5330999999999999e-05 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855366+0000", 2024-04-26T07:48:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000131903 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855406+0000", 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9932999999999999e-05 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857619+0000", 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022126950000000002 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857690+0000", 2024-04-26T07:48:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0720000000000001e-05 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:726 6.1e e29/23 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head v 29'4, mlcod=29'2)", 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.949404591, 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037299329999999999, 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993708+0000", 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6869999999999999e-06 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993719+0000", 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0526000000000001e-05 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993742+0000", 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.376e-05 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993762+0000", 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9706000000000001e-05 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993891+0000", 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012897900000000001 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993951+0000", 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9633999999999999e-05 2024-04-26T07:48:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997363+0000", 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118550000000001 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997436+0000", 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3786000000000001e-05 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:816 6.1e e29/23 6:7a480f67:::obj_delete_at_hint.0000000079:head v 29'8, mlcod=29'6)", 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.734811029999999, 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003479055, 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208301+0000", 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.44e-06 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208319+0000", 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7482999999999998e-05 2024-04-26T07:48:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208343+0000", 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4346999999999999e-05 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208357+0000", 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3256e-05 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208465+0000", 2024-04-26T07:48:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108063 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208497+0000", 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2008999999999998e-05 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.211707+0000", 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032102440000000001 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.211779+0000", 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2212999999999995e-05 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:823 6.a e29/23 6:547b96f2:::obj_delete_at_hint.0000000082:head v 29'12, mlcod=29'10)", 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.715533334, 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023215279999999998, 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227580+0000", 2024-04-26T07:48:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1270000000000001e-06 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227595+0000", 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5336999999999999e-05 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227632+0000", 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7196000000000001e-05 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227652+0000", 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9709999999999999e-05 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227759+0000", 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010668200000000001 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227805+0000", 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6165999999999998e-05 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.229812+0000", 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020074210000000001 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.229899+0000", 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6889000000000001e-05 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.550553119, 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025350059999999998, 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392560+0000", 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.72e-06 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392573+0000", 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3203e-05 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392600+0000", 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7393999999999999e-05 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392613+0000", 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3213e-05 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392743+0000", 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012966200000000001 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392780+0000", 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6678999999999999e-05 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395019+0000", 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022392459999999999 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395093+0000", 2024-04-26T07:48:53.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3888999999999997e-05 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:954 6.a e29/23 6:541d369a:::obj_delete_at_hint.0000000125:head v 29'19, mlcod=29'17)", 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.409420026999999, 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054590150000000002, 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533693+0000", 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.623e-06 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533703+0000", 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0307e-05 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533730+0000", 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6686000000000002e-05 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533743+0000", 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3746e-05 2024-04-26T07:48:53.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533875+0000", 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013116899999999999 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533929+0000", 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4617000000000002e-05 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539030+0000", 2024-04-26T07:48:53.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051009879999999999 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539150+0000", 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119879 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.043 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:53.045 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:48:53.045 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:53.043+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:53.145 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:53.146+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:53.214 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:53.214 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:53.214 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:48:53.214 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:53.228 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:48:53.245 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:53.246+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:53.260 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:48:53.346 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:53.343+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:53.349 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:53.349 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:53.349 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:48:53.349 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:48:53.350 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:53.363 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:48:53.452 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:53.451+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.079133429000002, 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:48:53.537 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:48:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:48:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:48:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:48:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.973344918999999, 2024-04-26T07:48:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01016414, 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 36 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562284+0000", 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.976e-06 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562295+0000", 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0563e-05 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562317+0000", 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2160000000000001e-05 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568856+0000", 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065391340000000003 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568996+0000", 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013974500000000001 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.569185+0000", 2024-04-26T07:48:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018917599999999999 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570452+0000", 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012671259999999999 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572276+0000", 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018236579999999999 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572374+0000", 2024-04-26T07:48:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8179999999999999e-05 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572442+0000", 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7651999999999995e-05 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.550 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.973289823000002, 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010242279999999999, 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.551 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 37 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7599999999999997e-07 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562340+0000", 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2639999999999997e-06 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562353+0000", 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3953e-05 2024-04-26T07:48:53.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562364+0000", 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0023e-05 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570502+0000", 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081387839999999996 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570636+0000", 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133929 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570841+0000", 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020473799999999999 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572179+0000", 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001338136 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572455+0000", 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027610500000000001 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572525+0000", 2024-04-26T07:48:53.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9442000000000004e-05 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572575+0000", 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0229999999999998e-05 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:84 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.557 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:53.558 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.881739410999998, 2024-04-26T07:48:53.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010516041, 2024-04-26T07:48:53.558 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.558 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.558 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.558 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.558 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.558 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 84 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653884+0000", 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9299999999999997e-07 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653990+0000", 2024-04-26T07:48:53.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010574 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654007+0000", 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7255999999999999e-05 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654016+0000", 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0229999999999998e-06 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.656818+0000", 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028019609999999999 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657052+0000", 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023420799999999999 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657457+0000", 2024-04-26T07:48:53.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000404516 2024-04-26T07:48:53.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.660887+0000", 2024-04-26T07:48:53.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034301549999999998 2024-04-26T07:48:53.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664252+0000", 2024-04-26T07:48:53.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033656070000000001 2024-04-26T07:48:53.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664328+0000", 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6216000000000003e-05 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664399+0000", 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0566000000000002e-05 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:53.565 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.881589433000002, 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010767923, 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 85 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654034+0000", 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654040+0000", 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8300000000000001e-06 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654051+0000", 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0994e-05 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654059+0000", 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2400000000000007e-06 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659335+0000", 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052755730000000004 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659564+0000", 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022912799999999999 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659947+0000", 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000383204 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664531+0000", 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045834930000000001 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664678+0000", 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014781899999999999 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664748+0000", 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0088999999999999e-05 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664801+0000", 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2463000000000002e-05 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.571 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.881549919000001, 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010852031999999999, 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 86 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654090+0000", 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.649e-05 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654101+0000", 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1216000000000001e-05 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654109+0000", 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9670000000000001e-06 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661156+0000", 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007047022 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661408+0000", 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025155499999999999 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661801+0000", 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039353700000000001 2024-04-26T07:48:53.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664660+0000", 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028584499999999998 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664815+0000", 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015576899999999999 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664877+0000", 2024-04-26T07:48:53.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1259000000000004e-05 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664925+0000", 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7997000000000001e-05 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.881499296000001, 2024-04-26T07:48:53.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01259659, 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 87 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654124+0000", 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4300000000000002e-07 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654222+0000", 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7719000000000004e-05 2024-04-26T07:48:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654234+0000", 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2604e-05 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654243+0000", 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5459999999999992e-06 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662707+0000", 2024-04-26T07:48:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084641609999999996 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662839+0000", 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132125 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.663062+0000", 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000223136 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666539+0000", 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034766480000000002 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666567+0000", 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8070000000000001e-05 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666651+0000", 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3856000000000005e-05 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666720+0000", 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8981999999999998e-05 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.881363520999997, 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013093877, 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 88 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654260+0000", 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6000000000000002e-07 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654265+0000", 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4569999999999996e-06 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654278+0000", 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2948999999999999e-05 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654286+0000", 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9200000000000004e-06 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665027+0000", 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010741297 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665256+0000", 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000228528 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665645+0000", 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038947299999999999 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666936+0000", 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012903260000000001 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667178+0000", 2024-04-26T07:48:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024258799999999999 2024-04-26T07:48:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667271+0000", 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2637000000000001e-05 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667353+0000", 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1841999999999993e-05 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794756135, 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011699831000000001, 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 106 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740867+0000", 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740954+0000", 2024-04-26T07:48:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6539000000000006e-05 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740976+0000", 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1616000000000001e-05 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740986+0000", 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0210000000000001e-05 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.743957+0000", 2024-04-26T07:48:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029711820000000002 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744188+0000", 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023153799999999999 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744602+0000", 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041389699999999998 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746647+0000", 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020443940000000002 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752403+0000", 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00575583 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752495+0000", 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2205000000000002e-05 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752566+0000", 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1329999999999996e-05 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794616650000002, 2024-04-26T07:48:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011999419000000001, 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 107 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741007+0000", 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6300000000000004e-07 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741013+0000", 2024-04-26T07:48:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0430000000000004e-06 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741024+0000", 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1219999999999999e-05 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741032+0000", 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0129999999999993e-06 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746964+0000", 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059325890000000003 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747200+0000", 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023506800000000001 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747570+0000", 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037041400000000001 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752381+0000", 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048112110000000001 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752882+0000", 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050076899999999998 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752951+0000", 2024-04-26T07:48:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8639000000000005e-05 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753005+0000", 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4589999999999997e-05 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794569007, 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012200701, 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 108 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741054+0000", 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8299999999999996e-07 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741059+0000", 2024-04-26T07:48:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2270000000000001e-06 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741072+0000", 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3076e-05 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741081+0000", 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6600000000000001e-06 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748524+0000", 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074427199999999999 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748761+0000", 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023694499999999999 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.749207+0000", 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044570900000000002 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752705+0000", 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034982049999999999 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753019+0000", 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031469100000000003 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753143+0000", 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123919 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753254+0000", 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110766 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794519371, 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01715328, 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 109 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741104+0000", 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6400000000000001e-07 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741233+0000", 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129429 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741254+0000", 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0665999999999998e-05 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741264+0000", 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0216e-05 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750196+0000", 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089322310000000005 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750436+0000", 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023930499999999999 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750837+0000", 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040168400000000003 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752861+0000", 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002024086 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758087+0000", 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052259369999999999 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758165+0000", 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7906999999999998e-05 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758256+0000", 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1055000000000001e-05 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794340196, 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017458564999999999, 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 110 2024-04-26T07:48:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741283+0000", 2024-04-26T07:48:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8299999999999995e-07 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741289+0000", 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7799999999999997e-06 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741302+0000", 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.296e-05 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741310+0000", 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4400000000000005e-06 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753384+0000", 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012073709 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753620+0000", 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023612500000000001 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754000+0000", 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037985699999999999 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758415+0000", 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044144839999999998 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758560+0000", 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014554100000000001 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758676+0000", 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115906 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758741+0000", 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.478e-05 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794299033000001, 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017565926999999999, 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 111 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741324+0000", 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741330+0000", 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5899999999999998e-06 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741359+0000", 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.976e-05 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741368+0000", 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4630000000000001e-06 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754914+0000", 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01354584 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755155+0000", 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024081800000000001 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755512+0000", 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035783000000000001 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758539+0000", 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030268529999999999 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758765+0000", 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022618399999999999 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758839+0000", 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3056e-05 2024-04-26T07:48:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758889+0000", 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0813000000000003e-05 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794239517000001, 2024-04-26T07:48:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018715345000000001, 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 112 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741384+0000", 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1399999999999996e-07 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741484+0000", 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010031600000000001 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741497+0000", 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3413e-05 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741506+0000", 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8359999999999998e-06 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756372+0000", 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014865405999999999 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756614+0000", 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024270499999999999 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.757084+0000", 2024-04-26T07:48:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000469946 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759020+0000", 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019354979999999999 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759964+0000", 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000944195 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760039+0000", 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5543000000000005e-05 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760098+0000", 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8773000000000001e-05 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794099717999998, 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:48:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:48:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794060885, 2024-04-26T07:48:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:48:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.794022855000001, 2024-04-26T07:48:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:48:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:48:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.793901302000002, 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:48:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:48:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.793861333000002, 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:48:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:48:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:53.661 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:53.662 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:53.659+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:53.662 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:48:53.763 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:53.762+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:53.805 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:53.806 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:53.806 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:53.806 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:53.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:48:53.904 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:53.906+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:53.964 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:53.962+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:53.991 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:53.991 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:53.991 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:48:53.991 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:48:53.991 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:54.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:48:54.093 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:54.094+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:54.162 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.546532172999999, 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.163 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:48:54.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:48:54.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.558625075999998, 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.169 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:48:54.174 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.539263429999998, 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.175 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:48:54.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:48:54.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:48:54.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.509134999, 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:48:54.181 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:48:54.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.487716902999999, 2024-04-26T07:48:54.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:48:54.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.457717534, 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.193 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:48:54.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.439118280999999, 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:48:54.199 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.202 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:48:54.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:48:54.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:48:54.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.421135493000001, 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.209 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:48:54.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:48:54.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.389311099, 2024-04-26T07:48:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:48:54.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:48:54.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:48:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.337456683999999, 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.221 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.226 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.328621378000001, 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.227 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:48:54.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:48:54.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:48:54.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:48:54.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.279608061000001, 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:48:54.232 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.237 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:600 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.276225175, 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002431356, 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 600 2024-04-26T07:48:54.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:54.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9299999999999996e-07 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886663+0000", 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1590000000000003e-06 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886672+0000", 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0739999999999999e-06 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886677+0000", 2024-04-26T07:48:54.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.04e-06 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887171+0000", 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00049419000000000004 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887299+0000", 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012773799999999999 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887554+0000", 2024-04-26T07:48:54.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025523100000000002 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888312+0000", 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00075773799999999999 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888986+0000", 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00067451800000000004 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889055+0000", 2024-04-26T07:48:54.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9109000000000005e-05 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889089+0000", 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3665999999999999e-05 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.22518616, 2024-04-26T07:48:54.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:48:54.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:48:54.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:48:54.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.249 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.021456899, 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:48:54.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:48:54.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.255 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.017559748, 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.256 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:48:54.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:48:54.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 20.963515567999998, 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.262 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 20.959389408, 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.269 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:48:54.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:48:54.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:48:54.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:48:54.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:54.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:48:54.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 20.779195284, 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:48:54.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.278 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:48:54.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.281 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 20.775546164000001, 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.282 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.283 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.283 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.283 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.283 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:48:54.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.283 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.284 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.284 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:54.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:54.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:48:54.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:48:54.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.291 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:54.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:48:54.293 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:54.291+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:54.394 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:54.391+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:54.482 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:54.483 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:54.483 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:54.483 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:54.495 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:54.494+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:54.497 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:48:54.596 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:54.594+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:54.679 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:54.679 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:54.679 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:48:54.679 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:48:54.679 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:54.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:48:54.696 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:54.695+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:54.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:48:54.825 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:54.826+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.313472233999999, 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089363580000000001, 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:48:54.873 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:48:54.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559516+0000", 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3180000000000001e-06 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559526+0000", 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8190000000000003e-06 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559547+0000", 2024-04-26T07:48:54.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1675000000000002e-05 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559563+0000", 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5582000000000001e-05 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561240+0000", 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676978 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561260+0000", 2024-04-26T07:48:54.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0590000000000001e-05 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568285+0000", 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070247670000000003 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568450+0000", 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016462900000000001 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.262843609000001, 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030230650000000001, 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 38 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.878 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610144+0000", 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.517e-06 2024-04-26T07:48:54.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610152+0000", 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5820000000000002e-06 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610171+0000", 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8621e-05 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610180+0000", 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9029999999999993e-06 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610293+0000", 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113552 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610492+0000", 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000199008 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610724+0000", 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023223499999999999 2024-04-26T07:48:54.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.611841+0000", 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011162769999999999 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613006+0000", 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001165475 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613098+0000", 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1608999999999997e-05 2024-04-26T07:48:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613165+0000", 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7286000000000006e-05 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:50 7.15 e26/25 7:a93a5511:::notify.2:head v 26'1, mlcod=0'0)", 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.2755115, 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029468020000000001, 2024-04-26T07:48:54.883 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597475+0000", 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2600000000000002e-07 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597485+0000", 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8600000000000005e-06 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597524+0000", 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9156999999999998e-05 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597545+0000", 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1625999999999999e-05 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597750+0000", 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020436900000000001 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597798+0000", 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7732999999999999e-05 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600300+0000", 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025022859999999998 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600421+0000", 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121045 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.887 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.162237078, 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030667120000000001, 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 193 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710751+0000", 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2529999999999999e-06 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710763+0000", 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.225e-05 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710795+0000", 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2286999999999998e-05 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710810+0000", 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5102999999999999e-05 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710951+0000", 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014038899999999999 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711181+0000", 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022999199999999999 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711433+0000", 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025236200000000001 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.712618+0000", 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184596 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713695+0000", 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001076975 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713765+0000", 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0396999999999997e-05 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713815+0000", 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0108000000000002e-05 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.259969310999999, 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044673070000000002, 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.893 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 208 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613019+0000", 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613032+0000", 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3390000000000001e-05 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613059+0000", 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6369000000000001e-05 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613073+0000", 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613182+0000", 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108902 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613370+0000", 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018796899999999999 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613779+0000", 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040870700000000002 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.614995+0000", 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012161030000000001 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617272+0000", 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022775450000000002 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617365+0000", 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2866000000000002e-05 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617484+0000", 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011849900000000001 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.898 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.241595063999998, 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033767699999999999, 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 212 2024-04-26T07:48:54.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631393+0000", 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631403+0000", 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0757000000000001e-05 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631434+0000", 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0685999999999997e-05 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631452+0000", 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8289999999999999e-05 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631578+0000", 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012580499999999999 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631799+0000", 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221072 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.632219+0000", 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041983999999999999 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.633745+0000", 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015256410000000001 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634566+0000", 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000821234 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634652+0000", 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5521999999999999e-05 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634767+0000", 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115763 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:48:54.904 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.215649762000002, 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:48:54.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.190643581, 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037018250000000002, 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.910 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 224 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682344+0000", 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3199999999999998e-06 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682358+0000", 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3223e-05 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682389+0000", 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1819000000000001e-05 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682404+0000", 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4773000000000001e-05 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682559+0000", 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015474900000000001 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682925+0000", 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000365724 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.683728+0000", 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000803096 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685343+0000", 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016147939999999999 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685828+0000", 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048552900000000001 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685924+0000", 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5488999999999993e-05 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.686044+0000", 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120309 2024-04-26T07:48:54.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.156104309, 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031929739999999999, 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 233 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716884+0000", 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5799999999999999e-06 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716896+0000", 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2013e-05 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716928+0000", 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1739000000000002e-05 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716942+0000", 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4367e-05 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717058+0000", 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116239 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717283+0000", 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022485499999999999 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717719+0000", 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043577999999999998 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719168+0000", 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449021 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719862+0000", 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069427499999999995 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719954+0000", 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1939000000000002e-05 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.720074+0000", 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120166 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:320 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:48:54.921 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.12629871, 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041265579999999998, 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 320 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746689+0000", 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.75e-06 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746697+0000", 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4770000000000003e-06 2024-04-26T07:48:54.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746719+0000", 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1543e-05 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746730+0000", 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1041e-05 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746802+0000", 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.237e-05 2024-04-26T07:48:54.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746936+0000", 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013430000000000001 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747126+0000", 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018941100000000001 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747902+0000", 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077641500000000003 2024-04-26T07:48:54.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750700+0000", 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002797875 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750759+0000", 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8622999999999998e-05 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750813+0000", 2024-04-26T07:48:54.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4753000000000002e-05 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:392 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.108615955000001, 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003372562, 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.927 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 392 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764371+0000", 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0699999999999999e-06 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764376+0000", 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4530000000000001e-06 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764391+0000", 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764398+0000", 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6650000000000003e-06 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764458+0000", 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9580000000000002e-05 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764518+0000", 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9833000000000001e-05 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764632+0000", 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114765 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.765112+0000", 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047932900000000002 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767688+0000", 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002576339 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767719+0000", 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1307999999999999e-05 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767742+0000", 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2892999999999999e-05 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:481 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.932 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.059627302999999, 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029129989999999999, 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 481 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:48:54.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813359+0000", 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2399999999999997e-07 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813363+0000", 2024-04-26T07:48:54.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7699999999999999e-06 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813373+0000", 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0564000000000001e-05 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813378+0000", 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9869999999999999e-06 2024-04-26T07:48:54.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813431+0000", 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2601e-05 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813486+0000", 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5525000000000001e-05 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813616+0000", 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129195 2024-04-26T07:48:54.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.814126+0000", 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051048 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816215+0000", 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020892279999999998 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816247+0000", 2024-04-26T07:48:54.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1523000000000003e-05 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816271+0000", 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4402000000000001e-05 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.859258127, 2024-04-26T07:48:54.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030638950000000001, 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 733 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013730+0000", 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.723e-06 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013742+0000", 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2099999999999999e-05 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013774+0000", 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1686000000000001e-05 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013791+0000", 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7433000000000001e-05 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013903+0000", 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111562 2024-04-26T07:48:54.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014125+0000", 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221962 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014446+0000", 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032154800000000001 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.015730+0000", 2024-04-26T07:48:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012836189999999999 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016636+0000", 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090594600000000003 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016725+0000", 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8945999999999998e-05 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016791+0000", 2024-04-26T07:48:54.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6370000000000003e-05 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.710166600000001, 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031006810000000001, 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.944 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 796 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162821+0000", 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2000000000000001e-06 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162832+0000", 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1123e-05 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162863+0000", 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1053000000000002e-05 2024-04-26T07:48:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162878+0000", 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4627000000000001e-05 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163055+0000", 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017737800000000001 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163271+0000", 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021579100000000001 2024-04-26T07:48:54.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163582+0000", 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031048799999999999 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.164646+0000", 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064391 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165770+0000", 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001123895 2024-04-26T07:48:54.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165858+0000", 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7604999999999999e-05 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165920+0000", 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2130000000000003e-05 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.706093797000001, 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030619419999999998, 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 798 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166894+0000", 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0669999999999999e-06 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166905+0000", 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0689999999999999e-05 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166931+0000", 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5982e-05 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166943+0000", 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2269999999999999e-05 2024-04-26T07:48:54.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167088+0000", 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144983 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167220+0000", 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000131989 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167484+0000", 2024-04-26T07:48:54.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026388399999999998 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.168382+0000", 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089864600000000002 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169799+0000", 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014165250000000001 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169885+0000", 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6629e-05 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169954+0000", 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8276999999999997e-05 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.687823531999999, 2024-04-26T07:48:54.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029491159999999999, 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 805 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185164+0000", 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2800000000000002e-06 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185176+0000", 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1576000000000001e-05 2024-04-26T07:48:54.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185207+0000", 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0657000000000001e-05 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185224+0000", 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6943e-05 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185347+0000", 2024-04-26T07:48:54.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012364200000000001 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185557+0000", 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000209385 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185867+0000", 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031047799999999999 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.186792+0000", 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092501900000000001 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.187956+0000", 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011643210000000001 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188043+0000", 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6621999999999998e-05 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188111+0000", 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8193000000000003e-05 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.619327936000001, 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002965442, 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 834 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253659+0000", 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.813e-06 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253669+0000", 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5529999999999998e-06 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253695+0000", 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5542999999999999e-05 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253707+0000", 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2320000000000001e-05 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253850+0000", 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143356 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253974+0000", 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012351899999999999 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.254248+0000", 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000274104 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.255127+0000", 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00087949999999999996 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256473+0000", 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013458890000000001 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256560+0000", 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7206000000000005e-05 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256623+0000", 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2638999999999994e-05 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.966 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.460990327000001, 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034075350000000002, 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 901 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411998+0000", 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412011+0000", 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2873e-05 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412042+0000", 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1168999999999999e-05 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412058+0000", 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5480000000000001e-05 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412219+0000", 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016089899999999999 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412592+0000", 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037354 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.413172+0000", 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00057962499999999995 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.414322+0000", 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001149705 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415207+0000", 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088520199999999997 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415294+0000", 2024-04-26T07:48:54.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6860000000000005e-05 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415403+0000", 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010914200000000001 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:48:54.972 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.456272156000001, 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033765959999999999, 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 903 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416716+0000", 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.08e-06 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416729+0000", 2024-04-26T07:48:54.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.378e-05 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416762+0000", 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3173000000000002e-05 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416777+0000", 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4873e-05 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416907+0000", 2024-04-26T07:48:54.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417143+0000", 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023651499999999999 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417631+0000", 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048777599999999999 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.418763+0000", 2024-04-26T07:48:54.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011318599999999999 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419805+0000", 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001041742 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419970+0000", 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016569499999999999 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.420090+0000", 2024-04-26T07:48:54.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119553 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.355722044, 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003600907, 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:54.978 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 946 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517266+0000", 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2730000000000001e-06 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517278+0000", 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1987000000000001e-05 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517310+0000", 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1843e-05 2024-04-26T07:48:54.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517325+0000", 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5197e-05 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517439+0000", 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113785 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517663+0000", 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022453499999999999 2024-04-26T07:48:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517999+0000", 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033559099999999999 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.519130+0000", 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001131544 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520581+0000", 2024-04-26T07:48:54.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014505950000000001 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520744+0000", 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016345199999999999 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520864+0000", 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120105 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:54.983 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:54.984 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:54.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:48:54.986 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:54.986 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:54.987 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:54.987 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:54.986+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:54.991 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:55.013 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:55.035 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:55.035 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:55.056 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:55.056 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:55.081 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:55.081 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:55.085 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:55.086+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:55.119 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:55.119 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:55.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:48:55.186 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:55.187+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:55.281 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:48:55.287 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:55.283+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:55.307 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:55.308 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:55.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:48:55.409 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:55.410+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:55.488 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:55.488 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:55.488 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:55.487+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:55.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:48:55.589 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:55.590+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:55.676 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:55.677 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:55.690 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:55.687+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:55.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:48:55.791 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:55.787+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:55.865 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:55.865 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:55.881 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:48:55.892 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:55.891+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:55.993 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:55.994+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:56.021 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:56.021 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:56.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:48:56.094 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:56.094+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:56.169 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:56.169 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:56.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:48:56.195 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:56.194+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:56.268 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:48:56.296 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:56.295+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:56.304 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:56.304 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:56.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:48:56.397 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:56.398+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:56.485 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:56.485 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:56.497 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:56.498+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:56.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:48:56.598 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:56.595+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:56.624 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:56.625 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:56.639 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:48:56.724 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:56.723+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:56.799 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:56.795+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:56.801 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:56.802 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:56.816 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:48:56.904 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:56.903+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:56.984 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:56.985 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:57.000 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:48:57.001 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:56.999+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:57.101 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:57.102+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:57.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:48:57.165 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:57.165 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:57.179 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:48:57.224 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:57.223+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:57.256 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:57.256 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:57.277 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:57.278 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:57.295 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:57.295 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:57.297 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:57.297 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:57.301 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:57.302+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:57.311 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:48:57.315 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:57.316 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:57.336 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:57.337 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:57.357 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:57.378 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:57.379 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:57.399 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:57.400 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:57.403 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:57.402+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:57.479 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.919684247999999, 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:48:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596391207936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.889347278999999, 2024-04-26T07:48:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027719889999999999, 2024-04-26T07:48:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 47 2024-04-26T07:48:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588082+0000", 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588084+0000", 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.243e-06 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588093+0000", 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6430000000000001e-06 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588113+0000", 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0051000000000002e-05 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588125+0000", 2024-04-26T07:48:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2191000000000001e-05 2024-04-26T07:48:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588218+0000", 2024-04-26T07:48:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3253999999999999e-05 2024-04-26T07:48:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588480+0000", 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026131800000000002 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.588685+0000", 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020556099999999999 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.589677+0000", 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0009915569999999999 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590602+0000", 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00092485600000000005 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590702+0000", 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100116 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.590854+0000", 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000152199 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.872390883000001, 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024108010000000002, 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 54 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605038+0000", 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605040+0000", 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.818e-06 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605049+0000", 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7520000000000002e-06 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605072+0000", 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2787999999999999e-05 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605085+0000", 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3200000000000001e-05 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605179+0000", 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3969999999999996e-05 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605357+0000", 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178262 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.605511+0000", 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153416 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.606471+0000", 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00096066599999999999 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607310+0000", 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00083910300000000001 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607369+0000", 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8854000000000003e-05 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607449+0000", 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9971999999999999e-05 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596391203328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.869772787999999, 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0021617260000000001, 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:48:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 55 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607656+0000", 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607658+0000", 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2300000000000001e-06 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607664+0000", 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.387e-06 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607681+0000", 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6796999999999999e-05 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607691+0000", 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9129999999999998e-06 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607768+0000", 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7732999999999996e-05 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.607873+0000", 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104372 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.608054+0000", 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018165600000000001 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609112+0000", 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010570969999999999 2024-04-26T07:48:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609666+0000", 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00055467500000000002 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609733+0000", 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6896999999999993e-05 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.609818+0000", 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4969000000000006e-05 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:191 6.5 e26/23 6:a2ace8b3:::data_log.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.772971248000001, 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017875160000000001, 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704458+0000", 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704460+0000", 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7999999999999999e-06 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704471+0000", 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1446e-05 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704502+0000", 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0800000000000003e-05 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704535+0000", 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2982999999999999e-05 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704667+0000", 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013210899999999999 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.704717+0000", 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0355999999999997e-05 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.706111+0000", 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013940389999999999 2024-04-26T07:48:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.706245+0000", 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013398300000000001 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.860564432, 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032337429999999999, 2024-04-26T07:48:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616865+0000", 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616866+0000", 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.33e-07 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616878+0000", 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2193e-05 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616920+0000", 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2509999999999998e-05 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.616942+0000", 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1990000000000001e-05 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.617092+0000", 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149636 2024-04-26T07:48:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.617140+0000", 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8322000000000003e-05 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.619973+0000", 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028324069999999999 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.620099+0000", 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125752 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:231 6.1f e29/23 6:fde4dd55:gc::gc.26:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.770182777999999, 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001768026, 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707246+0000", 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707247+0000", 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0399999999999996e-07 2024-04-26T07:48:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707256+0000", 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4499999999999993e-06 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707294+0000", 2024-04-26T07:48:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7576000000000001e-05 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707319+0000", 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4865999999999999e-05 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707499+0000", 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000180469 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.707534+0000", 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4873000000000003e-05 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.708937+0000", 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001402312 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709014+0000", 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7875999999999998e-05 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:320 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.732683918999999, 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027437310000000001, 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744745+0000", 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744746+0000", 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6299999999999993e-07 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744760+0000", 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3893000000000001e-05 2024-04-26T07:48:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744795+0000", 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4947000000000003e-05 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744817+0000", 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1605999999999999e-05 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744963+0000", 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146205 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.745009+0000", 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6607000000000003e-05 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.747361+0000", 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002351414 2024-04-26T07:48:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.747489+0000", 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012809599999999999 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:360 6.5 e29/23 6:a60f9269:lc::lua_package_allowlist:head v 29'2, mlcod=0'0)", 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.725472544999999, 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018680750000000001, 2024-04-26T07:48:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751957+0000", 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751958+0000", 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8330000000000001e-06 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751971+0000", 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2274e-05 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752013+0000", 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2281999999999999e-05 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752034+0000", 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0699999999999998e-05 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752254+0000", 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021995900000000001 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752306+0000", 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2349000000000003e-05 2024-04-26T07:48:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753718+0000", 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014118049999999999 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753825+0000", 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106873 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:426 6.a e29/23 6:50d64734:::obj_delete_at_hint.0000000009:head v 29'2, mlcod=0'0)", 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.694858903, 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026612879999999999, 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782570+0000", 2024-04-26T07:48:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782572+0000", 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0200000000000001e-06 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782585+0000", 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2186e-05 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782609+0000", 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4335999999999999e-05 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782621+0000", 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2217e-05 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782787+0000", 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016643199999999999 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782844+0000", 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6999000000000001e-05 2024-04-26T07:48:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785144+0000", 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022998419999999999 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785232+0000", 2024-04-26T07:48:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7256000000000006e-05 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:434 6.a e29/23 6:50d64734:::obj_delete_at_hint.0000000009:head v 29'3, mlcod=29'1)", 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.689396984999998, 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018461549999999999, 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788032+0000", 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788034+0000", 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.114e-06 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788050+0000", 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5472999999999999e-05 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788089+0000", 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8748999999999998e-05 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788110+0000", 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1457000000000001e-05 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788216+0000", 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106403 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.788259+0000", 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2517e-05 2024-04-26T07:48:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789758+0000", 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014993369999999999 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.789878+0000", 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120105 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:436 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'1)", 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.687192384999999, 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017544170000000001, 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790237+0000", 2024-04-26T07:48:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790239+0000", 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790281+0000", 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1689e-05 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790311+0000", 2024-04-26T07:48:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0658999999999999e-05 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790331+0000", 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9935000000000001e-05 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790467+0000", 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135301 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790516+0000", 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9839000000000002e-05 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791891+0000", 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013743270000000001 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.791991+0000", 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010050700000000001 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:466 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'5, mlcod=29'3)", 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.671986979, 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001869601, 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805442+0000", 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805444+0000", 2024-04-26T07:48:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.486e-06 2024-04-26T07:48:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805453+0000", 2024-04-26T07:48:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9730000000000003e-06 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805474+0000", 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1254999999999999e-05 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805485+0000", 2024-04-26T07:48:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0992000000000001e-05 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805605+0000", 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012044099999999999 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.805659+0000", 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3721999999999998e-05 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.807238+0000", 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015787150000000001 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.807312+0000", 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4017000000000006e-05 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:484 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'11, mlcod=29'9)", 2024-04-26T07:48:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.664821881000002, 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016497599999999999, 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812607+0000", 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812610+0000", 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.486e-06 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812625+0000", 2024-04-26T07:48:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5339999999999999e-05 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812707+0000", 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2158999999999997e-05 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812726+0000", 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8654000000000001e-05 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812939+0000", 2024-04-26T07:48:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000213358 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.812998+0000", 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8383e-05 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.814148+0000", 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011502750000000001 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.814257+0000", 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010910500000000001 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:552 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.622253427, 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025138949999999999, 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855176+0000", 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855177+0000", 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.654e-06 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855191+0000", 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3719e-05 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855219+0000", 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.794e-05 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855234+0000", 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5330999999999999e-05 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855366+0000", 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000131903 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.855406+0000", 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9932999999999999e-05 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857619+0000", 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022126950000000002 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.857690+0000", 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0720000000000001e-05 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:726 6.1e e29/23 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head v 29'4, mlcod=29'2)", 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.483722738000001, 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037299329999999999, 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993708+0000", 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6869999999999999e-06 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993719+0000", 2024-04-26T07:48:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0526000000000001e-05 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993742+0000", 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.376e-05 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993762+0000", 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9706000000000001e-05 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993891+0000", 2024-04-26T07:48:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012897900000000001 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993951+0000", 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9633999999999999e-05 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997363+0000", 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118550000000001 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997436+0000", 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3786000000000001e-05 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:816 6.1e e29/23 6:7a480f67:::obj_delete_at_hint.0000000079:head v 29'8, mlcod=29'6)", 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.269129177, 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003479055, 2024-04-26T07:48:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208300+0000", 2024-04-26T07:48:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208301+0000", 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.44e-06 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208319+0000", 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7482999999999998e-05 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208343+0000", 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4346999999999999e-05 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208357+0000", 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3256e-05 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208465+0000", 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108063 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208497+0000", 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2008999999999998e-05 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.211707+0000", 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032102440000000001 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.211779+0000", 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2212999999999995e-05 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:823 6.a e29/23 6:547b96f2:::obj_delete_at_hint.0000000082:head v 29'12, mlcod=29'10)", 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.249851481, 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023215279999999998, 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227578+0000", 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227580+0000", 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1270000000000001e-06 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227595+0000", 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5336999999999999e-05 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227632+0000", 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7196000000000001e-05 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227652+0000", 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9709999999999999e-05 2024-04-26T07:48:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227759+0000", 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010668200000000001 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.227805+0000", 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6165999999999998e-05 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.229812+0000", 2024-04-26T07:48:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020074210000000001 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.229899+0000", 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6889000000000001e-05 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.084871266, 2024-04-26T07:48:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025350059999999998, 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392558+0000", 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392560+0000", 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.72e-06 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392573+0000", 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3203e-05 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392600+0000", 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7393999999999999e-05 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392613+0000", 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3213e-05 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392743+0000", 2024-04-26T07:48:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012966200000000001 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.392780+0000", 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6678999999999999e-05 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395019+0000", 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022392459999999999 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.395093+0000", 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3888999999999997e-05 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:954 6.a e29/23 6:541d369a:::obj_delete_at_hint.0000000125:head v 29'19, mlcod=29'17)", 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.943738174, 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054590150000000002, 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533693+0000", 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.623e-06 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533703+0000", 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0307e-05 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533730+0000", 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6686000000000002e-05 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533743+0000", 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3746e-05 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533875+0000", 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013116899999999999 2024-04-26T07:48:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533929+0000", 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4617000000000002e-05 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539030+0000", 2024-04-26T07:48:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051009879999999999 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539150+0000", 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119879 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:57.582 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:57.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:48:57.584 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:57.583+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:57.685 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:57.686+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:57.751 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:57.752 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:57.752 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:48:57.752 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:57.765 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:48:57.812 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:57.811+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:57.884 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:57.884 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:48:57.884 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:48:57.884 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:48:57.885 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:57.886 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:57.886+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:57.899 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:48:57.988 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:57.987+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:58.059 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:48:58.059 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:48:58.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:48:58.059 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:48:58.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.059 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.059 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.60172541, 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.060 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:48:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:48:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:48:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.495936899999997, 2024-04-26T07:48:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01016414, 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 36 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562284+0000", 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.976e-06 2024-04-26T07:48:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562295+0000", 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0563e-05 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562317+0000", 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2160000000000001e-05 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568856+0000", 2024-04-26T07:48:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065391340000000003 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568996+0000", 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013974500000000001 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.569185+0000", 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018917599999999999 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570452+0000", 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012671259999999999 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572276+0000", 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018236579999999999 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572374+0000", 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8179999999999999e-05 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572442+0000", 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7651999999999995e-05 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.495881804, 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010242279999999999, 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 37 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7599999999999997e-07 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562340+0000", 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2639999999999997e-06 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562353+0000", 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3953e-05 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562364+0000", 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0023e-05 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570502+0000", 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081387839999999996 2024-04-26T07:48:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570636+0000", 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133929 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570841+0000", 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020473799999999999 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572179+0000", 2024-04-26T07:48:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001338136 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572455+0000", 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027610500000000001 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572525+0000", 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9442000000000004e-05 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572575+0000", 2024-04-26T07:48:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0229999999999998e-05 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:84 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.404331392000003, 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010516041, 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 84 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653884+0000", 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9299999999999997e-07 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653990+0000", 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010574 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654007+0000", 2024-04-26T07:48:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7255999999999999e-05 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654016+0000", 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0229999999999998e-06 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.656818+0000", 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028019609999999999 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657052+0000", 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023420799999999999 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657457+0000", 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000404516 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.660887+0000", 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034301549999999998 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664252+0000", 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033656070000000001 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664328+0000", 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6216000000000003e-05 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664399+0000", 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0566000000000002e-05 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.404181414, 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010767923, 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 85 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654034+0000", 2024-04-26T07:48:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654040+0000", 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8300000000000001e-06 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654051+0000", 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0994e-05 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654059+0000", 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2400000000000007e-06 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659335+0000", 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052755730000000004 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659564+0000", 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022912799999999999 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659947+0000", 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000383204 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664531+0000", 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045834930000000001 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664678+0000", 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014781899999999999 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664748+0000", 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0088999999999999e-05 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664801+0000", 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2463000000000002e-05 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.404141899999999, 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010852031999999999, 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 86 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654090+0000", 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.649e-05 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654101+0000", 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1216000000000001e-05 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654109+0000", 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9670000000000001e-06 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661156+0000", 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007047022 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661408+0000", 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025155499999999999 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661801+0000", 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039353700000000001 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664660+0000", 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028584499999999998 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664815+0000", 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015576899999999999 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664877+0000", 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1259000000000004e-05 2024-04-26T07:48:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664925+0000", 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7997000000000001e-05 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.404091276999999, 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01259659, 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 87 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654124+0000", 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4300000000000002e-07 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654222+0000", 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7719000000000004e-05 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654234+0000", 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2604e-05 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654243+0000", 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5459999999999992e-06 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662707+0000", 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084641609999999996 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662839+0000", 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132125 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.663062+0000", 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000223136 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666539+0000", 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034766480000000002 2024-04-26T07:48:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666567+0000", 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8070000000000001e-05 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666651+0000", 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3856000000000005e-05 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666720+0000", 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8981999999999998e-05 2024-04-26T07:48:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.403955502000002, 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013093877, 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 88 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654260+0000", 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6000000000000002e-07 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654265+0000", 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4569999999999996e-06 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654278+0000", 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2948999999999999e-05 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654286+0000", 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9200000000000004e-06 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665027+0000", 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010741297 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665256+0000", 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000228528 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665645+0000", 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038947299999999999 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666936+0000", 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012903260000000001 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667178+0000", 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024258799999999999 2024-04-26T07:48:58.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667271+0000", 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2637000000000001e-05 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667353+0000", 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1841999999999993e-05 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.106 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.317348115999998, 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011699831000000001, 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 106 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740867+0000", 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740954+0000", 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6539000000000006e-05 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740976+0000", 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1616000000000001e-05 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740986+0000", 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0210000000000001e-05 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.743957+0000", 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029711820000000002 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744188+0000", 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023153799999999999 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744602+0000", 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041389699999999998 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746647+0000", 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020443940000000002 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752403+0000", 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00575583 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752495+0000", 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2205000000000002e-05 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752566+0000", 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1329999999999996e-05 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.317208631, 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011999419000000001, 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.112 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 107 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741007+0000", 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6300000000000004e-07 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741013+0000", 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0430000000000004e-06 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741024+0000", 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1219999999999999e-05 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741032+0000", 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0129999999999993e-06 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746964+0000", 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059325890000000003 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747200+0000", 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023506800000000001 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747570+0000", 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037041400000000001 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752381+0000", 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048112110000000001 2024-04-26T07:48:58.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752882+0000", 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050076899999999998 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752951+0000", 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8639000000000005e-05 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753005+0000", 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4589999999999997e-05 2024-04-26T07:48:58.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.317160987999998, 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012200701, 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.118 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 108 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741054+0000", 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8299999999999996e-07 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741059+0000", 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2270000000000001e-06 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741072+0000", 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3076e-05 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741081+0000", 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6600000000000001e-06 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748524+0000", 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074427199999999999 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748761+0000", 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023694499999999999 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.749207+0000", 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044570900000000002 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752705+0000", 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034982049999999999 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753019+0000", 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031469100000000003 2024-04-26T07:48:58.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753143+0000", 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123919 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753254+0000", 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110766 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.123 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.317111351999998, 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01715328, 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 109 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741104+0000", 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6400000000000001e-07 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741233+0000", 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129429 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741254+0000", 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0665999999999998e-05 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741264+0000", 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0216e-05 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750196+0000", 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089322310000000005 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750436+0000", 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023930499999999999 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750837+0000", 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040168400000000003 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752861+0000", 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002024086 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758087+0000", 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052259369999999999 2024-04-26T07:48:58.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758165+0000", 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7906999999999998e-05 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758256+0000", 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1055000000000001e-05 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.316932176999998, 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017458564999999999, 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 110 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741283+0000", 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8299999999999995e-07 2024-04-26T07:48:58.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741289+0000", 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7799999999999997e-06 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741302+0000", 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.296e-05 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741310+0000", 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4400000000000005e-06 2024-04-26T07:48:58.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753384+0000", 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012073709 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753620+0000", 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023612500000000001 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754000+0000", 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037985699999999999 2024-04-26T07:48:58.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758415+0000", 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044144839999999998 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758560+0000", 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014554100000000001 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758676+0000", 2024-04-26T07:48:58.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115906 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758741+0000", 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.478e-05 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.316891013999999, 2024-04-26T07:48:58.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017565926999999999, 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 111 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741324+0000", 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741330+0000", 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5899999999999998e-06 2024-04-26T07:48:58.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741359+0000", 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.976e-05 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741368+0000", 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4630000000000001e-06 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754914+0000", 2024-04-26T07:48:58.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01354584 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755155+0000", 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024081800000000001 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755512+0000", 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035783000000000001 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758539+0000", 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030268529999999999 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758765+0000", 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022618399999999999 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758839+0000", 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3056e-05 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758889+0000", 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0813000000000003e-05 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.316831497999999, 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018715345000000001, 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.141 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 112 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741384+0000", 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1399999999999996e-07 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741484+0000", 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010031600000000001 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741497+0000", 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3413e-05 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741506+0000", 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8359999999999998e-06 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756372+0000", 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014865405999999999 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756614+0000", 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024270499999999999 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.757084+0000", 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000469946 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759020+0000", 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019354979999999999 2024-04-26T07:48:58.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759964+0000", 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000944195 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760039+0000", 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5543000000000005e-05 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760098+0000", 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8773000000000001e-05 2024-04-26T07:48:58.146 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.316691699000003, 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.147 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:48:58.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:48:58.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:48:58.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.316652865999998, 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.153 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:48:58.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.158 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.316614835999999, 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:58.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:48:58.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.316493283, 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.164 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:48:58.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.316453314, 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.170 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:48:58.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:48:58.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:48:58.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:48:58.175 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:48:58.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:48:58.177 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:58.178+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:58.277 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:58.278+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:58.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:48:58.314 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:58.314 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:58.314 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:58.314 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:58.331 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:48:58.379 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:58.379+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:48:58.479 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:58.478+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:58.502 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:58.502 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:58.502 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:48:58.502 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:48:58.502 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:58.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:48:58.605 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:58.606+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:58.681 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:58.682+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.083346227, 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.700 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:48:58.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:48:58.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.705 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.095439129999999, 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:48:58.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:48:58.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:48:58.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.076077483999999, 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:48:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:48:58.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:48:58.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:48:58.717 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.717 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.717 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.718 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.718 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.045949053000001, 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:48:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:48:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.024530957, 2024-04-26T07:48:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:48:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:48:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.994531588000001, 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:48:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:48:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.975932335, 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:48:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:48:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:48:58.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.957949546999998, 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:48:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:48:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.926125153000001, 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:58.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:48:58.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:48:58.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.874270738, 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.753 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:48:58.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:48:58.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:48:58.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.865435431999998, 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.759 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:48:58.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:48:58.764 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.816422115000002, 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.765 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:48:58.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:48:58.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:600 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.813039229000001, 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002431356, 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.771 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 600 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9299999999999996e-07 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886663+0000", 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1590000000000003e-06 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886672+0000", 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0739999999999999e-06 2024-04-26T07:48:58.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886677+0000", 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.04e-06 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887171+0000", 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00049419000000000004 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887299+0000", 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012773799999999999 2024-04-26T07:48:58.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887554+0000", 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025523100000000002 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888312+0000", 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00075773799999999999 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888986+0000", 2024-04-26T07:48:58.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00067451800000000004 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889055+0000", 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9109000000000005e-05 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889089+0000", 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3665999999999999e-05 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.776 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.762000214, 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.777 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:48:58.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.558270953000001, 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.783 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:48:58.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:48:58.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:48:58.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.554373802000001, 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.789 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:48:58.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:48:58.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.500329621999999, 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:48:58.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:58.800 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.496203462, 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:48:58.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.316009338000001, 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.312360217999998, 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:58.811 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:58.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:48:58.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:48:58.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:48:58.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:48:58.817 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.817 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.817 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.817 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:58.817 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:58.817 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:58.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:48:58.819 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:48:58.815+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:48:58.918 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:48:58.918+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:48:58.985 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:58.985 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:58.985 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:58.985 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:58.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:48:59.020 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:59.019+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:59.121 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:59.122+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:59.160 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:59.160 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:59.160 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:48:59.160 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:48:59.160 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:59.172 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:48:59.261 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:48:59.262+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:48:59.283 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:48:59.343 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:59.344 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:48:59.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:48:59.344 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:48:59.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.344 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:48:59.344 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:48:59.344 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.784291209000003, 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089363580000000001, 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:48:59.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559516+0000", 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3180000000000001e-06 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559526+0000", 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8190000000000003e-06 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559547+0000", 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1675000000000002e-05 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559563+0000", 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5582000000000001e-05 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561240+0000", 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676978 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561260+0000", 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0590000000000001e-05 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568285+0000", 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070247670000000003 2024-04-26T07:48:59.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568450+0000", 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016462900000000001 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.733662584000001, 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030230650000000001, 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.349 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 38 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610144+0000", 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.517e-06 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610152+0000", 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5820000000000002e-06 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610171+0000", 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8621e-05 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610180+0000", 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9029999999999993e-06 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610293+0000", 2024-04-26T07:48:59.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113552 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610492+0000", 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000199008 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610724+0000", 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023223499999999999 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.611841+0000", 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011162769999999999 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613006+0000", 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001165475 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613098+0000", 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1608999999999997e-05 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613165+0000", 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7286000000000006e-05 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:50 7.15 e26/25 7:a93a5511:::notify.2:head v 26'1, mlcod=0'0)", 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.746330475000001, 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029468020000000001, 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.355 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597475+0000", 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2600000000000002e-07 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597485+0000", 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8600000000000005e-06 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597524+0000", 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9156999999999998e-05 2024-04-26T07:48:59.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597545+0000", 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1625999999999999e-05 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597750+0000", 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020436900000000001 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597798+0000", 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7732999999999999e-05 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600300+0000", 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025022859999999998 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600421+0000", 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121045 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.359 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.633056053000001, 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030667120000000001, 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.360 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 193 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710751+0000", 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2529999999999999e-06 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710763+0000", 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.225e-05 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710795+0000", 2024-04-26T07:48:59.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2286999999999998e-05 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710810+0000", 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5102999999999999e-05 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710951+0000", 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014038899999999999 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711181+0000", 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022999199999999999 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711433+0000", 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025236200000000001 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.712618+0000", 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184596 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713695+0000", 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001076975 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713765+0000", 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0396999999999997e-05 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713815+0000", 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0108000000000002e-05 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.365 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.730788285999999, 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044673070000000002, 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.366 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 208 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613019+0000", 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613032+0000", 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3390000000000001e-05 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613059+0000", 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6369000000000001e-05 2024-04-26T07:48:59.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613073+0000", 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613182+0000", 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108902 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613370+0000", 2024-04-26T07:48:59.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018796899999999999 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613779+0000", 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040870700000000002 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.614995+0000", 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012161030000000001 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617272+0000", 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022775450000000002 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617365+0000", 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2866000000000002e-05 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617484+0000", 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011849900000000001 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.371 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.712414038999999, 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033767699999999999, 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.372 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 212 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631393+0000", 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631403+0000", 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0757000000000001e-05 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631434+0000", 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0685999999999997e-05 2024-04-26T07:48:59.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631452+0000", 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8289999999999999e-05 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631578+0000", 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012580499999999999 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631799+0000", 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221072 2024-04-26T07:48:59.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.632219+0000", 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041983999999999999 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.633745+0000", 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015256410000000001 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634566+0000", 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000821234 2024-04-26T07:48:59.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634652+0000", 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5521999999999999e-05 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634767+0000", 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115763 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.377 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.686468736999998, 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:48:59.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:48:59.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.661462556, 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037018250000000002, 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 224 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682344+0000", 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3199999999999998e-06 2024-04-26T07:48:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682358+0000", 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3223e-05 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682389+0000", 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1819000000000001e-05 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682404+0000", 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4773000000000001e-05 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682559+0000", 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015474900000000001 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682925+0000", 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000365724 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.683728+0000", 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000803096 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685343+0000", 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016147939999999999 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685828+0000", 2024-04-26T07:48:59.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048552900000000001 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685924+0000", 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5488999999999993e-05 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.686044+0000", 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120309 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.626923284, 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031929739999999999, 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 233 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.390 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716884+0000", 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5799999999999999e-06 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716896+0000", 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2013e-05 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716928+0000", 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1739000000000002e-05 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716942+0000", 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4367e-05 2024-04-26T07:48:59.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717058+0000", 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116239 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717283+0000", 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022485499999999999 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717719+0000", 2024-04-26T07:48:59.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043577999999999998 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719168+0000", 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449021 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719862+0000", 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069427499999999995 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719954+0000", 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1939000000000002e-05 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.720074+0000", 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120166 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:320 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.597117685000001, 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041265579999999998, 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 320 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746689+0000", 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.75e-06 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746697+0000", 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4770000000000003e-06 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746719+0000", 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1543e-05 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746730+0000", 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1041e-05 2024-04-26T07:48:59.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746802+0000", 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.237e-05 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746936+0000", 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013430000000000001 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747126+0000", 2024-04-26T07:48:59.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018941100000000001 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747902+0000", 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077641500000000003 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750700+0000", 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002797875 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750759+0000", 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8622999999999998e-05 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750813+0000", 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4753000000000002e-05 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:392 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.401 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.579434930000001, 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003372562, 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 392 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764371+0000", 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0699999999999999e-06 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764376+0000", 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4530000000000001e-06 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764391+0000", 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764398+0000", 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6650000000000003e-06 2024-04-26T07:48:59.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764458+0000", 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9580000000000002e-05 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764518+0000", 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9833000000000001e-05 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764632+0000", 2024-04-26T07:48:59.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114765 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.765112+0000", 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047932900000000002 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767688+0000", 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002576339 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767719+0000", 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1307999999999999e-05 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767742+0000", 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2892999999999999e-05 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:481 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.407 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.530446277999999, 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029129989999999999, 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 481 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813359+0000", 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2399999999999997e-07 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813363+0000", 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7699999999999999e-06 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813373+0000", 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0564000000000001e-05 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813378+0000", 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9869999999999999e-06 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813431+0000", 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2601e-05 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813486+0000", 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5525000000000001e-05 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813616+0000", 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129195 2024-04-26T07:48:59.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.814126+0000", 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051048 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816215+0000", 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020892279999999998 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816247+0000", 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1523000000000003e-05 2024-04-26T07:48:59.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816271+0000", 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4402000000000001e-05 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.330077102000001, 2024-04-26T07:48:59.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030638950000000001, 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 733 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013730+0000", 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.723e-06 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013742+0000", 2024-04-26T07:48:59.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2099999999999999e-05 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013774+0000", 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1686000000000001e-05 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013791+0000", 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7433000000000001e-05 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013903+0000", 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111562 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014125+0000", 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221962 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014446+0000", 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032154800000000001 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.015730+0000", 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012836189999999999 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016636+0000", 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090594600000000003 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016725+0000", 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8945999999999998e-05 2024-04-26T07:48:59.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016791+0000", 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6370000000000003e-05 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.180985575000001, 2024-04-26T07:48:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031006810000000001, 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 796 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162821+0000", 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2000000000000001e-06 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162832+0000", 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1123e-05 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162863+0000", 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1053000000000002e-05 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162878+0000", 2024-04-26T07:48:59.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4627000000000001e-05 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163055+0000", 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017737800000000001 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163271+0000", 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021579100000000001 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:59.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163582+0000", 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031048799999999999 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.164646+0000", 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064391 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165770+0000", 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001123895 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165858+0000", 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7604999999999999e-05 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165920+0000", 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2130000000000003e-05 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.425 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.176912772000001, 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030619419999999998, 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 798 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166894+0000", 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0669999999999999e-06 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166905+0000", 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0689999999999999e-05 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166931+0000", 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5982e-05 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166943+0000", 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2269999999999999e-05 2024-04-26T07:48:59.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167088+0000", 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144983 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167220+0000", 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000131989 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167484+0000", 2024-04-26T07:48:59.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026388399999999998 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.168382+0000", 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089864600000000002 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169799+0000", 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014165250000000001 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169885+0000", 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6629e-05 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169954+0000", 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8276999999999997e-05 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.431 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.158642507, 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029491159999999999, 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 805 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:48:59.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185164+0000", 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2800000000000002e-06 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185176+0000", 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1576000000000001e-05 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185207+0000", 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0657000000000001e-05 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185224+0000", 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6943e-05 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185347+0000", 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012364200000000001 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185557+0000", 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000209385 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185867+0000", 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031047799999999999 2024-04-26T07:48:59.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.186792+0000", 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092501900000000001 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.187956+0000", 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011643210000000001 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188043+0000", 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6621999999999998e-05 2024-04-26T07:48:59.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188111+0000", 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8193000000000003e-05 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:48:59.437 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.090146911000001, 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002965442, 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 834 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253659+0000", 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.813e-06 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253669+0000", 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5529999999999998e-06 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253695+0000", 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5542999999999999e-05 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253707+0000", 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2320000000000001e-05 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253850+0000", 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143356 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253974+0000", 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012351899999999999 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.254248+0000", 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000274104 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.255127+0000", 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00087949999999999996 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256473+0000", 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013458890000000001 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256560+0000", 2024-04-26T07:48:59.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7206000000000005e-05 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256623+0000", 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2638999999999994e-05 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.931809302000001, 2024-04-26T07:48:59.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034075350000000002, 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 901 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411998+0000", 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412011+0000", 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2873e-05 2024-04-26T07:48:59.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412042+0000", 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1168999999999999e-05 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412058+0000", 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5480000000000001e-05 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412219+0000", 2024-04-26T07:48:59.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016089899999999999 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412592+0000", 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037354 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.413172+0000", 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00057962499999999995 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.414322+0000", 2024-04-26T07:48:59.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001149705 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415207+0000", 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088520199999999997 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415294+0000", 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6860000000000005e-05 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415403+0000", 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010914200000000001 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.927091131000001, 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033765959999999999, 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.449 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 903 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416716+0000", 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.08e-06 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416729+0000", 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.378e-05 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416762+0000", 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3173000000000002e-05 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416777+0000", 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4873e-05 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416907+0000", 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417143+0000", 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023651499999999999 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417631+0000", 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048777599999999999 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.418763+0000", 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011318599999999999 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419805+0000", 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001041742 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419970+0000", 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016569499999999999 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.420090+0000", 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119553 2024-04-26T07:48:59.454 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.826541019, 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003600907, 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:48:59.455 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 946 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517266+0000", 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2730000000000001e-06 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517278+0000", 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1987000000000001e-05 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517310+0000", 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1843e-05 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517325+0000", 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5197e-05 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517439+0000", 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113785 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517663+0000", 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022453499999999999 2024-04-26T07:48:59.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517999+0000", 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033559099999999999 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.519130+0000", 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001131544 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520581+0000", 2024-04-26T07:48:59.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014505950000000001 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520744+0000", 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016345199999999999 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520864+0000", 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120105 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:48:59.460 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:48:59.461 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:59.461 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:59.342+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:59.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:48:59.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:48:59.505 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:48:59.506+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:48:59.565 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:48:59.563+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:48:59.627 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:48:59.627 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:48:59.627 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:48:59.628 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:48:59.641 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:48:59.644 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:48:59.644 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:48:59.661 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:48:59.661 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:48:59.666 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:59.663+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:59.678 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:48:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:48:59.696 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:48:59.696 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:48:59.716 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:48:59.717 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:48:59.737 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:48:59.738 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:48:59.758 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:48:59.759 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:48:59.761 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:59.761 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:59.767 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:48:59.763+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:48:59.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:48:59.779 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:48:59.780 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:48:59.868 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:48:59.866+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:48:59.895 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:48:59.895 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:48:59.908 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:48:59.969 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:48:59.967+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:00.067 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:00.067 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:00.069 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:00.070+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:00.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:00.171 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:00.167+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:00.236 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:00.236 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:00.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:00.293 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:00.294+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:00.363 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:00.363 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:00.372 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:00.371+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:00.376 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:00.473 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:00.471+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:00.498 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:00.498 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:00.512 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:00.575 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:00.574+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:00.670 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:00.671 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:00.676 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:00.674+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:00.684 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:00.777 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:00.775+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:00.793 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:00.793 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:00.806 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:00.878 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:00.878+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:00.968 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:00.968 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:00.978 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:00.978+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:00.982 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:01.080 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:01.079+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:01.097 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:01.097 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:01.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:01.180 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:01.178+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:01.280 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:01.281 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:01.281 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:01.282+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:01.294 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:01.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:49:01.382 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:01.379+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:01.411 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:01.411 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:01.425 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:01.512 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:01.511+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:01.584 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:01.583+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:01.588 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:01.588 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:01.603 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:01.692 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:01.691+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:49:01.772 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:01.772 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:01.786 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:01.787 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:01.783+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:01.797 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:01.886 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:01.886+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:01.929 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:01.930 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:01.946 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:01.946 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:01.950 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:01.950 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:01.964 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:01.964 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:01.965 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:01.979 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:01.980 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:01.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:01.997 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:02.012 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:02.011+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:02.016 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:02.033 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:02.034 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:02.053 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:02.053 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:02.087 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:02.087 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:02.087 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:02.087 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:02.087 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:02.102 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:02.113 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:02.114+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:02.189 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:02.187+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:02.269 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.810216322000002, 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:49:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:49:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:49:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.704427811999999, 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01016414, 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 36 2024-04-26T07:49:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562284+0000", 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.976e-06 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562295+0000", 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0563e-05 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562317+0000", 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2160000000000001e-05 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568856+0000", 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065391340000000003 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568996+0000", 2024-04-26T07:49:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013974500000000001 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.569185+0000", 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018917599999999999 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570452+0000", 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012671259999999999 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572276+0000", 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018236579999999999 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572374+0000", 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8179999999999999e-05 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572442+0000", 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7651999999999995e-05 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.704372716000002, 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010242279999999999, 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 37 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7599999999999997e-07 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562340+0000", 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2639999999999997e-06 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562353+0000", 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3953e-05 2024-04-26T07:49:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562364+0000", 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0023e-05 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570502+0000", 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081387839999999996 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570636+0000", 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133929 2024-04-26T07:49:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570841+0000", 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020473799999999999 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572179+0000", 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001338136 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572455+0000", 2024-04-26T07:49:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027610500000000001 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572525+0000", 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9442000000000004e-05 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572575+0000", 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0229999999999998e-05 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:84 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.612822303999998, 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010516041, 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 84 2024-04-26T07:49:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653884+0000", 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9299999999999997e-07 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653990+0000", 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010574 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654007+0000", 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7255999999999999e-05 2024-04-26T07:49:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654016+0000", 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0229999999999998e-06 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.656818+0000", 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028019609999999999 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657052+0000", 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023420799999999999 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657457+0000", 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000404516 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.660887+0000", 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034301549999999998 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664252+0000", 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033656070000000001 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664328+0000", 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6216000000000003e-05 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664399+0000", 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0566000000000002e-05 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.612672326000002, 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010767923, 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 85 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654034+0000", 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654040+0000", 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8300000000000001e-06 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654051+0000", 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0994e-05 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654059+0000", 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2400000000000007e-06 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659335+0000", 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052755730000000004 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659564+0000", 2024-04-26T07:49:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022912799999999999 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659947+0000", 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000383204 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664531+0000", 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045834930000000001 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664678+0000", 2024-04-26T07:49:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014781899999999999 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664748+0000", 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0088999999999999e-05 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664801+0000", 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2463000000000002e-05 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.612632812000001, 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010852031999999999, 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 86 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:49:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654090+0000", 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.649e-05 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654101+0000", 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1216000000000001e-05 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654109+0000", 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9670000000000001e-06 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661156+0000", 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007047022 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661408+0000", 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025155499999999999 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661801+0000", 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039353700000000001 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664660+0000", 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028584499999999998 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664815+0000", 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015576899999999999 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664877+0000", 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1259000000000004e-05 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664925+0000", 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7997000000000001e-05 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:49:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.612582189000001, 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01259659, 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 87 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:49:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654124+0000", 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4300000000000002e-07 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654222+0000", 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7719000000000004e-05 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654234+0000", 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2604e-05 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654243+0000", 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5459999999999992e-06 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662707+0000", 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084641609999999996 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662839+0000", 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132125 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.663062+0000", 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000223136 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666539+0000", 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034766480000000002 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666567+0000", 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8070000000000001e-05 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666651+0000", 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3856000000000005e-05 2024-04-26T07:49:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666720+0000", 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8981999999999998e-05 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.612446413999997, 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013093877, 2024-04-26T07:49:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 88 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654260+0000", 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6000000000000002e-07 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654265+0000", 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4569999999999996e-06 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654278+0000", 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2948999999999999e-05 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654286+0000", 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9200000000000004e-06 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665027+0000", 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010741297 2024-04-26T07:49:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665256+0000", 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000228528 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665645+0000", 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038947299999999999 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666936+0000", 2024-04-26T07:49:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012903260000000001 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667178+0000", 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024258799999999999 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667271+0000", 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2637000000000001e-05 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667353+0000", 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1841999999999993e-05 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525839028, 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011699831000000001, 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 106 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740867+0000", 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740954+0000", 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6539000000000006e-05 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740976+0000", 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1616000000000001e-05 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740986+0000", 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0210000000000001e-05 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.743957+0000", 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029711820000000002 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744188+0000", 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023153799999999999 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744602+0000", 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041389699999999998 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746647+0000", 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020443940000000002 2024-04-26T07:49:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752403+0000", 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00575583 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752495+0000", 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2205000000000002e-05 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752566+0000", 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1329999999999996e-05 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525699543000002, 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011999419000000001, 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 107 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741007+0000", 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6300000000000004e-07 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741013+0000", 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0430000000000004e-06 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741024+0000", 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1219999999999999e-05 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741032+0000", 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0129999999999993e-06 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746964+0000", 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059325890000000003 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747200+0000", 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023506800000000001 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747570+0000", 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037041400000000001 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752381+0000", 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048112110000000001 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752882+0000", 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050076899999999998 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752951+0000", 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8639000000000005e-05 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753005+0000", 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4589999999999997e-05 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.5256519, 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012200701, 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 108 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:49:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741054+0000", 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8299999999999996e-07 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741059+0000", 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2270000000000001e-06 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741072+0000", 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3076e-05 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741081+0000", 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6600000000000001e-06 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748524+0000", 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074427199999999999 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748761+0000", 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023694499999999999 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.749207+0000", 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044570900000000002 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752705+0000", 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034982049999999999 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753019+0000", 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031469100000000003 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753143+0000", 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123919 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753254+0000", 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110766 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525602264, 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01715328, 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 109 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741104+0000", 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6400000000000001e-07 2024-04-26T07:49:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741233+0000", 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129429 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741254+0000", 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0665999999999998e-05 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741264+0000", 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0216e-05 2024-04-26T07:49:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750196+0000", 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089322310000000005 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750436+0000", 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023930499999999999 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750837+0000", 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040168400000000003 2024-04-26T07:49:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752861+0000", 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002024086 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758087+0000", 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052259369999999999 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758165+0000", 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7906999999999998e-05 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758256+0000", 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1055000000000001e-05 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525423089, 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017458564999999999, 2024-04-26T07:49:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 110 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741283+0000", 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8299999999999995e-07 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741289+0000", 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7799999999999997e-06 2024-04-26T07:49:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741302+0000", 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.296e-05 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741310+0000", 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4400000000000005e-06 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753384+0000", 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012073709 2024-04-26T07:49:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753620+0000", 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023612500000000001 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754000+0000", 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037985699999999999 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758415+0000", 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044144839999999998 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758560+0000", 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014554100000000001 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758676+0000", 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115906 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758741+0000", 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.478e-05 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525381926000001, 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017565926999999999, 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 111 2024-04-26T07:49:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741324+0000", 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741330+0000", 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5899999999999998e-06 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741359+0000", 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.976e-05 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741368+0000", 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4630000000000001e-06 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754914+0000", 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01354584 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755155+0000", 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024081800000000001 2024-04-26T07:49:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755512+0000", 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035783000000000001 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758539+0000", 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030268529999999999 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758765+0000", 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022618399999999999 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758839+0000", 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3056e-05 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758889+0000", 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0813000000000003e-05 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525322410000001, 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018715345000000001, 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 112 2024-04-26T07:49:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741384+0000", 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1399999999999996e-07 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741484+0000", 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010031600000000001 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741497+0000", 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3413e-05 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741506+0000", 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8359999999999998e-06 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756372+0000", 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014865405999999999 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756614+0000", 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024270499999999999 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.757084+0000", 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000469946 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759020+0000", 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019354979999999999 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759964+0000", 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000944195 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760039+0000", 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5543000000000005e-05 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760098+0000", 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8773000000000001e-05 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525182610999998, 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:49:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525143778, 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:49:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:49:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:49:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.525105748000001, 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:49:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:49:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.524984195000002, 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.524944226000002, 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:49:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:49:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:02.386 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:02.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:02.388 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:02.386+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:02.488 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:02.486+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:02.557 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:02.557 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:02.557 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:02.557 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:02.574 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:02.589 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:02.587+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:02.690 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:02.687+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:02.766 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:02.766 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:02.766 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:02.766 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:02.766 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:02.779 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:02.790 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:02.787+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:02.891 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:02.887+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:02.942 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:02.942 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:02.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:02.942 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:02.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.942 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:02.942 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.324728116000003, 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:49:02.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:49:02.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:49:02.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:49:02.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:02.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:49:02.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:49:02.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:02.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:49:02.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:49:02.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:02.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:49:02.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:49:02.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:49:02.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:49:02.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:02.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:49:02.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:49:02.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:02.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:49:02.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:49:02.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.951 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:02.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.952 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:49:02.952 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:02.952 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.336821018999999, 2024-04-26T07:49:02.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:49:02.952 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.953 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.953 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.953 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.953 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.953 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.953 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:49:02.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.954 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:02.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:02.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:49:02.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:49:02.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:49:02.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.960 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.317459372999998, 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:49:02.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:49:02.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:02.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.966 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.287330942000001, 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:49:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:49:02.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.265912845999999, 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:49:02.972 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:49:02.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:49:02.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.235913477, 2024-04-26T07:49:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:49:02.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.217314223999999, 2024-04-26T07:49:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:49:02.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:49:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.199331436000001, 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.990 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:02.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.167507042, 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:02.996 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:02.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:02.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:49:03.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.115652626999999, 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:03.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:49:03.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:49:03.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.106817321000001, 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.008 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:49:03.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:49:03.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:03.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.014 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.057804004000001, 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:49:03.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:03.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:49:03.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:49:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:49:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:49:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:600 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.054421118, 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002431356, 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.023 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 600 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886658+0000", 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9299999999999996e-07 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886663+0000", 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1590000000000003e-06 2024-04-26T07:49:03.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886672+0000", 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0739999999999999e-06 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.886677+0000", 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.04e-06 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887171+0000", 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00049419000000000004 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887299+0000", 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012773799999999999 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.887554+0000", 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025523100000000002 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888312+0000", 2024-04-26T07:49:03.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00075773799999999999 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.888986+0000", 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00067451800000000004 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889055+0000", 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9109000000000005e-05 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.889089+0000", 2024-04-26T07:49:03.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3665999999999999e-05 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.003382103, 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.029 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:49:03.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:49:03.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:49:03.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.034 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.799652842, 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.040 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.795755691, 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:49:03.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:49:03.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.741711510999998, 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:03.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:49:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:49:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:49:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:49:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.737585351, 2024-04-26T07:49:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:49:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.054 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:49:03.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:49:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:49:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:49:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:49:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:49:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:49:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:49:03.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:49:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:49:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:49:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:49:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:49:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:03.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:49:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:49:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:49:03.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:49:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:49:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:49:03.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:49:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:49:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:49:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:49:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.066 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.557391227, 2024-04-26T07:49:03.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:49:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.068 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:49:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:49:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:49:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:49:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:49:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:49:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:49:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:49:03.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:49:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:49:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:49:03.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:49:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:49:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:49:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:49:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:49:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:49:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:49:03.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:49:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:49:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:49:03.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:49:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:49:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.079 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.553742107000001, 2024-04-26T07:49:03.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:49:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.081 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:49:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:49:03.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:49:03.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:49:03.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:49:03.088 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.089 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.089 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.089 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.089 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.089 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:03.090 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:03.091 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:03.090+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:03.191 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:03.187+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:03.292 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:03.290+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:03.302 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:03.302 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:03.302 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:03.302 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:03.319 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:03.405 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:03.406+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:03.496 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:03.494+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:03.530 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:03.530 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:03.530 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:03.531 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:03.531 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:03.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:03.638 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:03.638+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:03.698 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:03.695+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:03.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:49:03.766 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.206353559, 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089363580000000001, 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:03.767 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:03.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559516+0000", 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3180000000000001e-06 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559526+0000", 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8190000000000003e-06 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559547+0000", 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1675000000000002e-05 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559563+0000", 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5582000000000001e-05 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561240+0000", 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676978 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561260+0000", 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0590000000000001e-05 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568285+0000", 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070247670000000003 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568450+0000", 2024-04-26T07:49:03.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016462900000000001 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.155724933999998, 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030230650000000001, 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.772 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 38 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610144+0000", 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.517e-06 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610152+0000", 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5820000000000002e-06 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610171+0000", 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8621e-05 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610180+0000", 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9029999999999993e-06 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610293+0000", 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113552 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610492+0000", 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000199008 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610724+0000", 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023223499999999999 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.611841+0000", 2024-04-26T07:49:03.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011162769999999999 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613006+0000", 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001165475 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613098+0000", 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1608999999999997e-05 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613165+0000", 2024-04-26T07:49:03.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7286000000000006e-05 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:50 7.15 e26/25 7:a93a5511:::notify.2:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.168392824999998, 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029468020000000001, 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597475+0000", 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2600000000000002e-07 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597485+0000", 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8600000000000005e-06 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597524+0000", 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9156999999999998e-05 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597545+0000", 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1625999999999999e-05 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597750+0000", 2024-04-26T07:49:03.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020436900000000001 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597798+0000", 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7732999999999999e-05 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600300+0000", 2024-04-26T07:49:03.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025022859999999998 2024-04-26T07:49:03.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.782 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600421+0000", 2024-04-26T07:49:03.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121045 2024-04-26T07:49:03.782 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.782 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.782 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.783 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:03.783 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:03.783 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.055118403000002, 2024-04-26T07:49:03.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030667120000000001, 2024-04-26T07:49:03.784 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.784 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.784 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.785 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 193 2024-04-26T07:49:03.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.785 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:03.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:03.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710751+0000", 2024-04-26T07:49:03.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2529999999999999e-06 2024-04-26T07:49:03.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710763+0000", 2024-04-26T07:49:03.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.225e-05 2024-04-26T07:49:03.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710795+0000", 2024-04-26T07:49:03.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2286999999999998e-05 2024-04-26T07:49:03.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710810+0000", 2024-04-26T07:49:03.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5102999999999999e-05 2024-04-26T07:49:03.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710951+0000", 2024-04-26T07:49:03.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014038899999999999 2024-04-26T07:49:03.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711181+0000", 2024-04-26T07:49:03.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022999199999999999 2024-04-26T07:49:03.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711433+0000", 2024-04-26T07:49:03.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025236200000000001 2024-04-26T07:49:03.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.712618+0000", 2024-04-26T07:49:03.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184596 2024-04-26T07:49:03.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713695+0000", 2024-04-26T07:49:03.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001076975 2024-04-26T07:49:03.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713765+0000", 2024-04-26T07:49:03.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0396999999999997e-05 2024-04-26T07:49:03.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713815+0000", 2024-04-26T07:49:03.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0108000000000002e-05 2024-04-26T07:49:03.797 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.797 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.797 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.798 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.798 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:03.798 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.152850636, 2024-04-26T07:49:03.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044673070000000002, 2024-04-26T07:49:03.798 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.798 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.799 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.799 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.799 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.799 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.799 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 208 2024-04-26T07:49:03.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.800 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:03.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:03.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613019+0000", 2024-04-26T07:49:03.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:49:03.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613032+0000", 2024-04-26T07:49:03.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3390000000000001e-05 2024-04-26T07:49:03.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613059+0000", 2024-04-26T07:49:03.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6369000000000001e-05 2024-04-26T07:49:03.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613073+0000", 2024-04-26T07:49:03.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:03.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613182+0000", 2024-04-26T07:49:03.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108902 2024-04-26T07:49:03.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613370+0000", 2024-04-26T07:49:03.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018796899999999999 2024-04-26T07:49:03.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613779+0000", 2024-04-26T07:49:03.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040870700000000002 2024-04-26T07:49:03.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.614995+0000", 2024-04-26T07:49:03.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012161030000000001 2024-04-26T07:49:03.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617272+0000", 2024-04-26T07:49:03.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022775450000000002 2024-04-26T07:49:03.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617365+0000", 2024-04-26T07:49:03.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2866000000000002e-05 2024-04-26T07:49:03.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617484+0000", 2024-04-26T07:49:03.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011849900000000001 2024-04-26T07:49:03.810 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.811 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.811 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.811 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.811 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:03.812 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.134476389, 2024-04-26T07:49:03.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033767699999999999, 2024-04-26T07:49:03.812 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.812 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.812 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.813 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.813 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.813 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 212 2024-04-26T07:49:03.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.813 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631393+0000", 2024-04-26T07:49:03.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:49:03.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631403+0000", 2024-04-26T07:49:03.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0757000000000001e-05 2024-04-26T07:49:03.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631434+0000", 2024-04-26T07:49:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0685999999999997e-05 2024-04-26T07:49:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631452+0000", 2024-04-26T07:49:03.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8289999999999999e-05 2024-04-26T07:49:03.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631578+0000", 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012580499999999999 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631799+0000", 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221072 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.632219+0000", 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041983999999999999 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.633745+0000", 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015256410000000001 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634566+0000", 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000821234 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634652+0000", 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5521999999999999e-05 2024-04-26T07:49:03.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634767+0000", 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115763 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.108531086999999, 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:49:03.820 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.825 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.083524906000001, 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037018250000000002, 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.826 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 224 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682344+0000", 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3199999999999998e-06 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682358+0000", 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3223e-05 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682389+0000", 2024-04-26T07:49:03.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1819000000000001e-05 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682404+0000", 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4773000000000001e-05 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682559+0000", 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015474900000000001 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682925+0000", 2024-04-26T07:49:03.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000365724 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.683728+0000", 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000803096 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685343+0000", 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016147939999999999 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685828+0000", 2024-04-26T07:49:03.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048552900000000001 2024-04-26T07:49:03.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685924+0000", 2024-04-26T07:49:03.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5488999999999993e-05 2024-04-26T07:49:03.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.686044+0000", 2024-04-26T07:49:03.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120309 2024-04-26T07:49:03.832 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.832 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.832 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.833 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.833 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:03.833 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.048985634000001, 2024-04-26T07:49:03.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031929739999999999, 2024-04-26T07:49:03.833 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.834 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.834 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.834 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 233 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716884+0000", 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5799999999999999e-06 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716896+0000", 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2013e-05 2024-04-26T07:49:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716928+0000", 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1739000000000002e-05 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716942+0000", 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4367e-05 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717058+0000", 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116239 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717283+0000", 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022485499999999999 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717719+0000", 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043577999999999998 2024-04-26T07:49:03.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719168+0000", 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449021 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719862+0000", 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069427499999999995 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719954+0000", 2024-04-26T07:49:03.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1939000000000002e-05 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.720074+0000", 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120166 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.840 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:320 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.019180035000002, 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041265579999999998, 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 320 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.841 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746689+0000", 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.75e-06 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746697+0000", 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4770000000000003e-06 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746719+0000", 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1543e-05 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746730+0000", 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1041e-05 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746802+0000", 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.237e-05 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746936+0000", 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013430000000000001 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747126+0000", 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018941100000000001 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747902+0000", 2024-04-26T07:49:03.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077641500000000003 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750700+0000", 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002797875 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750759+0000", 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8622999999999998e-05 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750813+0000", 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4753000000000002e-05 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:392 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:03.847 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.001497279999999, 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003372562, 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 392 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764371+0000", 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0699999999999999e-06 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764376+0000", 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4530000000000001e-06 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764391+0000", 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764398+0000", 2024-04-26T07:49:03.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6650000000000003e-06 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764458+0000", 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9580000000000002e-05 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764518+0000", 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9833000000000001e-05 2024-04-26T07:49:03.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764632+0000", 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114765 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.765112+0000", 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047932900000000002 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767688+0000", 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002576339 2024-04-26T07:49:03.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767719+0000", 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1307999999999999e-05 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767742+0000", 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2892999999999999e-05 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:481 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.952508628, 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029129989999999999, 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 481 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.854 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813359+0000", 2024-04-26T07:49:03.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2399999999999997e-07 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813363+0000", 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7699999999999999e-06 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813373+0000", 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0564000000000001e-05 2024-04-26T07:49:03.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813378+0000", 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9869999999999999e-06 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813431+0000", 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2601e-05 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813486+0000", 2024-04-26T07:49:03.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5525000000000001e-05 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813616+0000", 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129195 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.814126+0000", 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051048 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816215+0000", 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020892279999999998 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816247+0000", 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1523000000000003e-05 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816271+0000", 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4402000000000001e-05 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.752139452000002, 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030638950000000001, 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.860 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 733 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013730+0000", 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.723e-06 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013742+0000", 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2099999999999999e-05 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013774+0000", 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1686000000000001e-05 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013791+0000", 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7433000000000001e-05 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013903+0000", 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111562 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014125+0000", 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221962 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014446+0000", 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032154800000000001 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.015730+0000", 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012836189999999999 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016636+0000", 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090594600000000003 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016725+0000", 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8945999999999998e-05 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016791+0000", 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6370000000000003e-05 2024-04-26T07:49:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.603047924999998, 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031006810000000001, 2024-04-26T07:49:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 796 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162821+0000", 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2000000000000001e-06 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162832+0000", 2024-04-26T07:49:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1123e-05 2024-04-26T07:49:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162863+0000", 2024-04-26T07:49:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1053000000000002e-05 2024-04-26T07:49:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162878+0000", 2024-04-26T07:49:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4627000000000001e-05 2024-04-26T07:49:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163055+0000", 2024-04-26T07:49:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017737800000000001 2024-04-26T07:49:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163271+0000", 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021579100000000001 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163582+0000", 2024-04-26T07:49:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031048799999999999 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.164646+0000", 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064391 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165770+0000", 2024-04-26T07:49:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001123895 2024-04-26T07:49:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165858+0000", 2024-04-26T07:49:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7604999999999999e-05 2024-04-26T07:49:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165920+0000", 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2130000000000003e-05 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.598975121999999, 2024-04-26T07:49:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030619419999999998, 2024-04-26T07:49:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 798 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166894+0000", 2024-04-26T07:49:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0669999999999999e-06 2024-04-26T07:49:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166905+0000", 2024-04-26T07:49:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0689999999999999e-05 2024-04-26T07:49:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166931+0000", 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5982e-05 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166943+0000", 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2269999999999999e-05 2024-04-26T07:49:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167088+0000", 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144983 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167220+0000", 2024-04-26T07:49:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000131989 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167484+0000", 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026388399999999998 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.168382+0000", 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089864600000000002 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169799+0000", 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014165250000000001 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169885+0000", 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6629e-05 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169954+0000", 2024-04-26T07:49:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8276999999999997e-05 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.580704857000001, 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029491159999999999, 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 805 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185164+0000", 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2800000000000002e-06 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185176+0000", 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1576000000000001e-05 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185207+0000", 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0657000000000001e-05 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185224+0000", 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6943e-05 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185347+0000", 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012364200000000001 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185557+0000", 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000209385 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185867+0000", 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031047799999999999 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.186792+0000", 2024-04-26T07:49:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092501900000000001 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.187956+0000", 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011643210000000001 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188043+0000", 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6621999999999998e-05 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188111+0000", 2024-04-26T07:49:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8193000000000003e-05 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.512209260999999, 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002965442, 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 834 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253659+0000", 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.813e-06 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253669+0000", 2024-04-26T07:49:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5529999999999998e-06 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253695+0000", 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5542999999999999e-05 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253707+0000", 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2320000000000001e-05 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253850+0000", 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143356 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253974+0000", 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012351899999999999 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.254248+0000", 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000274104 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.255127+0000", 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00087949999999999996 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256473+0000", 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013458890000000001 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256560+0000", 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7206000000000005e-05 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256623+0000", 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2638999999999994e-05 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.353871651999999, 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034075350000000002, 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 901 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411998+0000", 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412011+0000", 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2873e-05 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412042+0000", 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1168999999999999e-05 2024-04-26T07:49:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412058+0000", 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5480000000000001e-05 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412219+0000", 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016089899999999999 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412592+0000", 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037354 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.413172+0000", 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00057962499999999995 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.414322+0000", 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001149705 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415207+0000", 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088520199999999997 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415294+0000", 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6860000000000005e-05 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415403+0000", 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010914200000000001 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.349153480999998, 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033765959999999999, 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 903 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416716+0000", 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.08e-06 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416729+0000", 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.378e-05 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416762+0000", 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3173000000000002e-05 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416777+0000", 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4873e-05 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416907+0000", 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417143+0000", 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023651499999999999 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417631+0000", 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048777599999999999 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.418763+0000", 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011318599999999999 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419805+0000", 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001041742 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419970+0000", 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016569499999999999 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.420090+0000", 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119553 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.248603369000001, 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003600907, 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 946 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517266+0000", 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2730000000000001e-06 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517278+0000", 2024-04-26T07:49:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1987000000000001e-05 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517310+0000", 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1843e-05 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517325+0000", 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5197e-05 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517439+0000", 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113785 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517663+0000", 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022453499999999999 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517999+0000", 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033559099999999999 2024-04-26T07:49:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.519130+0000", 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001131544 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520581+0000", 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014505950000000001 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520744+0000", 2024-04-26T07:49:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016345199999999999 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520864+0000", 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120105 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:03.914 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:03.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:03.916 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:03.913+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:04.017 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:04.015+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:04.071 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:04.118 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:04.115+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:04.129 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:04.130 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:04.130 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:04.130 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:04.149 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:04.219 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:04.215+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:04.278 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:04.279 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:04.310 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:04.319 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:04.317+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:04.327 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:04.327 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:04.328 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:04.328 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:04.328 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:04.340 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:04.341 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:04.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:04.372 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:04.373 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:04.406 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:04.406 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:04.420 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:04.417+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:04.440 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:04.474 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:04.475 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:04.507 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:04.521 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:04.519+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:04.544 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:04.544 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:04.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:04.622 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:04.619+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:04.723 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:04.719+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:04.774 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:04.774 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:04.793 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:04.837 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:04.837+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:04.906 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:49:04.924 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:04.921+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:04.967 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:04.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:05.029 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:05.029+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:05.125 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:05.125+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:05.198 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:05.199 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:05.215 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:05.260 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:05.259+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:05.327 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:05.327+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:05.349 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:05.349 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:05.363 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:05.452 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:05.451+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:05.528 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:05.528 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:05.529 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:05.525+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:05.542 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:05.630 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:05.629+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:05.705 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:05.705 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:05.720 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:05.731 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:05.729+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:05.832 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:05.829+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:05.837 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:05.837 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:05.851 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:05.933 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:05.929+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:05.968 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:05.968 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:05.983 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:06.033 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:06.033+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:06.097 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:06.097 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:06.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:06.156 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:06.155+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:06.234 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:06.234 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:06.235 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:06.231+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:06.249 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:06.335 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:06.333+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:06.413 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:06.413 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:06.427 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:06.436 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:06.433+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:06.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:06.537 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:06.535+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:06.547 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:06.548 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:06.561 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:06.637 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:06.637+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:06.725 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:06.725 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:06.726 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:06.727 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:06.738 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:06.737+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:06.740 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:06.758 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:06.758 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:06.788 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:06.788 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:06.819 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:06.819 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:06.838 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:06.837+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:06.851 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:06.851 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:06.857 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:06.858 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:06.870 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:06.883 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:06.883 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:06.905 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:06.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:49:06.937 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:06.937 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:06.939 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:06.937+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:06.999 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:06.999 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:06.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:06.999 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:06.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:06.999 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:06.999 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.542097466999998, 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:49:07.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.436308957000001, 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01016414, 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.006 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 36 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562278+0000", 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562284+0000", 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.976e-06 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562295+0000", 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0563e-05 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562317+0000", 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2160000000000001e-05 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568856+0000", 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065391340000000003 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.568996+0000", 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013974500000000001 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.569185+0000", 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018917599999999999 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570452+0000", 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012671259999999999 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572276+0000", 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018236579999999999 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572374+0000", 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8179999999999999e-05 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572442+0000", 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7651999999999995e-05 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.436253860999997, 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010242279999999999, 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.012 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 37 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562333+0000", 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7599999999999997e-07 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562340+0000", 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2639999999999997e-06 2024-04-26T07:49:07.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562353+0000", 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3953e-05 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.562364+0000", 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0023e-05 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570502+0000", 2024-04-26T07:49:07.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081387839999999996 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570636+0000", 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133929 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.570841+0000", 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020473799999999999 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572179+0000", 2024-04-26T07:49:07.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001338136 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572455+0000", 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027610500000000001 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572525+0000", 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9442000000000004e-05 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.572575+0000", 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0229999999999998e-05 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:84 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.344703449000001, 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010516041, 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.018 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 84 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653883+0000", 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653884+0000", 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9299999999999997e-07 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.653990+0000", 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010574 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654007+0000", 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7255999999999999e-05 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654016+0000", 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0229999999999998e-06 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.656818+0000", 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028019609999999999 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657052+0000", 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023420799999999999 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.657457+0000", 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000404516 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.660887+0000", 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034301549999999998 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664252+0000", 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033656070000000001 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664328+0000", 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6216000000000003e-05 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664399+0000", 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0566000000000002e-05 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.023 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.344553470999998, 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010767923, 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 85 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.024 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654033+0000", 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654034+0000", 2024-04-26T07:49:07.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654040+0000", 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8300000000000001e-06 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654051+0000", 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0994e-05 2024-04-26T07:49:07.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654059+0000", 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2400000000000007e-06 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659335+0000", 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052755730000000004 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659564+0000", 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022912799999999999 2024-04-26T07:49:07.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.659947+0000", 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000383204 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664531+0000", 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045834930000000001 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664678+0000", 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014781899999999999 2024-04-26T07:49:07.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664748+0000", 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0088999999999999e-05 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664801+0000", 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2463000000000002e-05 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.029 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.344513956999997, 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010852031999999999, 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 86 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654073+0000", 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654090+0000", 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.649e-05 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654101+0000", 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1216000000000001e-05 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654109+0000", 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9670000000000001e-06 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661156+0000", 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007047022 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661408+0000", 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025155499999999999 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.661801+0000", 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039353700000000001 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664660+0000", 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028584499999999998 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664815+0000", 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015576899999999999 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664877+0000", 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1259000000000004e-05 2024-04-26T07:49:07.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.664925+0000", 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7997000000000001e-05 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.344463333999997, 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01259659, 2024-04-26T07:49:07.035 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 87 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654123+0000", 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654124+0000", 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4300000000000002e-07 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654222+0000", 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7719000000000004e-05 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654234+0000", 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2604e-05 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654243+0000", 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5459999999999992e-06 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662707+0000", 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084641609999999996 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.662839+0000", 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132125 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.663062+0000", 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000223136 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666539+0000", 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034766480000000002 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666567+0000", 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8070000000000001e-05 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666651+0000", 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3856000000000005e-05 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666720+0000", 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8981999999999998e-05 2024-04-26T07:49:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.344327559, 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013093877, 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.041 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 88 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654259+0000", 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654260+0000", 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6000000000000002e-07 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654265+0000", 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4569999999999996e-06 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654278+0000", 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2948999999999999e-05 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.654286+0000", 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9200000000000004e-06 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665027+0000", 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010741297 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665256+0000", 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000228528 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.665645+0000", 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038947299999999999 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.666936+0000", 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012903260000000001 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667178+0000", 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024258799999999999 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667271+0000", 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2637000000000001e-05 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.667353+0000", 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1841999999999993e-05 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:49:07.046 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257720173000003, 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011699831000000001, 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 106 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740866+0000", 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740867+0000", 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0899999999999999e-06 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740954+0000", 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6539000000000006e-05 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740976+0000", 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1616000000000001e-05 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.740986+0000", 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0210000000000001e-05 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.743957+0000", 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029711820000000002 2024-04-26T07:49:07.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744188+0000", 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023153799999999999 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.744602+0000", 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041389699999999998 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746647+0000", 2024-04-26T07:49:07.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020443940000000002 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752403+0000", 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00575583 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752495+0000", 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2205000000000002e-05 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752566+0000", 2024-04-26T07:49:07.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1329999999999996e-05 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257580687999997, 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011999419000000001, 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.052 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 107 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741006+0000", 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741007+0000", 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6300000000000004e-07 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741013+0000", 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0430000000000004e-06 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741024+0000", 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1219999999999999e-05 2024-04-26T07:49:07.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741032+0000", 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0129999999999993e-06 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.746964+0000", 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059325890000000003 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747200+0000", 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023506800000000001 2024-04-26T07:49:07.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.747570+0000", 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037041400000000001 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752381+0000", 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048112110000000001 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752882+0000", 2024-04-26T07:49:07.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050076899999999998 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752951+0000", 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8639000000000005e-05 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753005+0000", 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4589999999999997e-05 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257533045000002, 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012200701, 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 108 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741053+0000", 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741054+0000", 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8299999999999996e-07 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741059+0000", 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2270000000000001e-06 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741072+0000", 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3076e-05 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741081+0000", 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6600000000000001e-06 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748524+0000", 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074427199999999999 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.748761+0000", 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023694499999999999 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.749207+0000", 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044570900000000002 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752705+0000", 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034982049999999999 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753019+0000", 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031469100000000003 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753143+0000", 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123919 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753254+0000", 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110766 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.063 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257483409000002, 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01715328, 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 109 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741103+0000", 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741104+0000", 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6400000000000001e-07 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741233+0000", 2024-04-26T07:49:07.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129429 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741254+0000", 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0665999999999998e-05 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741264+0000", 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0216e-05 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750196+0000", 2024-04-26T07:49:07.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089322310000000005 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750436+0000", 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023930499999999999 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.750837+0000", 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040168400000000003 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.752861+0000", 2024-04-26T07:49:07.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002024086 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758087+0000", 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052259369999999999 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758165+0000", 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7906999999999998e-05 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758256+0000", 2024-04-26T07:49:07.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1055000000000001e-05 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257304234000003, 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017458564999999999, 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.069 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 110 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741282+0000", 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741283+0000", 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8299999999999995e-07 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741289+0000", 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7799999999999997e-06 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741302+0000", 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.296e-05 2024-04-26T07:49:07.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741310+0000", 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4400000000000005e-06 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753384+0000", 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012073709 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.753620+0000", 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023612500000000001 2024-04-26T07:49:07.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754000+0000", 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037985699999999999 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758415+0000", 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044144839999999998 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758560+0000", 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014554100000000001 2024-04-26T07:49:07.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758676+0000", 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115906 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758741+0000", 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.478e-05 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257263070999997, 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017565926999999999, 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 111 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741323+0000", 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741324+0000", 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741330+0000", 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5899999999999998e-06 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741359+0000", 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.976e-05 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741368+0000", 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4630000000000001e-06 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.754914+0000", 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01354584 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755155+0000", 2024-04-26T07:49:07.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024081800000000001 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.755512+0000", 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035783000000000001 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758539+0000", 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030268529999999999 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758765+0000", 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022618399999999999 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758839+0000", 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3056e-05 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.758889+0000", 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0813000000000003e-05 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.080 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257203554999997, 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018715345000000001, 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.081 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 112 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741383+0000", 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741384+0000", 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1399999999999996e-07 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741484+0000", 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010031600000000001 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741497+0000", 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3413e-05 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741506+0000", 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8359999999999998e-06 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756372+0000", 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014865405999999999 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.756614+0000", 2024-04-26T07:49:07.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024270499999999999 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.757084+0000", 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000469946 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759020+0000", 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019354979999999999 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759964+0000", 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000944195 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760039+0000", 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5543000000000005e-05 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760098+0000", 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8773000000000001e-05 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.086 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257063756000001, 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.087 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.257024923000003, 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.093 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:49:07.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:49:07.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:49:07.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.256986892999997, 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:49:07.098 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.256865339999997, 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.104 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:49:07.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:49:07.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.256825370999998, 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:49:07.109 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:49:07.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:07.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:49:07.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:49:07.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:07.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:49:07.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:49:07.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:07.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:49:07.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:49:07.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:07.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:07.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:07.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:49:07.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:49:07.116 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.116 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.116 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.116 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:07.117 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:07.117 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:07.119 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:07.115+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:07.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:07.219 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:07.219+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:07.286 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:07.286 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:07.286 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:07.287 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:07.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:07.320 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:07.319+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:07.414 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:07.415 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:07.415 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:07.415 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:07.415 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:07.421 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:07.419+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:07.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:07.522 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:07.519+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:07.538 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.921370164999999, 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.539 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:49:07.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:49:07.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:49:07.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:07.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:49:07.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:49:07.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:49:07.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:49:07.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:49:07.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:49:07.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:49:07.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:49:07.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:49:07.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:49:07.547 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.547 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.547 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.547 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:49:07.547 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:07.548 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.933463068000002, 2024-04-26T07:49:07.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:49:07.548 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.548 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.548 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.548 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.549 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.549 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.549 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:49:07.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.549 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:07.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:49:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:49:07.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:49:07.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:49:07.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:49:07.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:49:07.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:49:07.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:49:07.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:49:07.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:07.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:49:07.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:49:07.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:49:07.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:49:07.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:49:07.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:49:07.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:49:07.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:49:07.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:49:07.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:49:07.559 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.559 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.560 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.560 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.560 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:07.560 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.914101422000002, 2024-04-26T07:49:07.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:49:07.561 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.561 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.561 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.561 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.561 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.561 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.561 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:49:07.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.562 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:07.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:07.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:49:07.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:49:07.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:49:07.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:49:07.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:49:07.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:49:07.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:49:07.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:49:07.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:49:07.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:49:07.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:49:07.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:49:07.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:07.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:49:07.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:49:07.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:49:07.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:49:07.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:49:07.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:49:07.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:49:07.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:49:07.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.883972991, 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.573 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.574 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:49:07.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.574 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:07.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:07.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.579 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.862554895000002, 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:49:07.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:49:07.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.585 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.832555526, 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:49:07.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.813956273000002, 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:49:07.591 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:49:07.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:49:07.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:49:07.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.795973484999998, 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.597 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:07.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:49:07.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:49:07.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:49:07.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:49:07.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:49:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:49:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:49:07.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:49:07.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:49:07.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:49:07.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:49:07.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:49:07.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:07.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:49:07.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:49:07.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:49:07.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:49:07.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:49:07.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:49:07.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:49:07.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:49:07.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:49:07.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:49:07.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.608 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.608 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.608 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.608 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.764149091, 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:49:07.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:49:07.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.712294675999999, 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.703459369999997, 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.620 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:49:07.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:49:07.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:49:07.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.625 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.654446053000001, 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.626 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:49:07.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.600024152000003, 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:07.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:49:07.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:49:07.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:49:07.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:49:07.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:49:07.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:49:07.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:49:07.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:49:07.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:49:07.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.639 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.396294890999997, 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.640 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:07.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:49:07.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:49:07.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:49:07.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:49:07.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:49:07.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:49:07.648 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.648 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.648 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.39239774, 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:07.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:49:07.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:49:07.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:49:07.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.338353560000002, 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.654 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.659 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.334227400000003, 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:49:07.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:49:07.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.154033276, 2024-04-26T07:49:07.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:49:07.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:49:07.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:49:07.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:49:07.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:49:07.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:49:07.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:49:07.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:49:07.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:49:07.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:49:07.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:07.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:49:07.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:49:07.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:49:07.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:49:07.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:49:07.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:49:07.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:49:07.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:49:07.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:49:07.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:49:07.675 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.675 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.675 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.676 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:07.676 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:07.676 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.150384156000001, 2024-04-26T07:49:07.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:49:07.676 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.676 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.677 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.677 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.677 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.677 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.677 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:49:07.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.677 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:07.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:07.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:49:07.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:49:07.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:49:07.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:49:07.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:49:07.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:49:07.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:49:07.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:49:07.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:49:07.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:49:07.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:49:07.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:49:07.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:07.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:49:07.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:49:07.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:49:07.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:49:07.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:49:07.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:49:07.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:49:07.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:49:07.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:49:07.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:49:07.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.688 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.689 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T07:49:07.689 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:07.689 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.7857460539999996, 2024-04-26T07:49:07.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031879370000000001, 2024-04-26T07:49:07.689 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:07.690 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:07.690 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:07.690 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:07.690 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:07.690 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:07.690 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1020 2024-04-26T07:49:07.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.690 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:07.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751976+0000", 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6330000000000001e-06 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:07.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751983+0000", 2024-04-26T07:49:07.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7070000000000003e-06 2024-04-26T07:49:07.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:07.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752000+0000", 2024-04-26T07:49:07.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7169000000000001e-05 2024-04-26T07:49:07.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752011+0000", 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.099e-05 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752123+0000", 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112154 2024-04-26T07:49:07.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752277+0000", 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015411299999999999 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752536+0000", 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025889199999999999 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.753314+0000", 2024-04-26T07:49:07.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077766900000000004 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755045+0000", 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001731376 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755117+0000", 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1963000000000002e-05 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:07.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755163+0000", 2024-04-26T07:49:07.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5271000000000001e-05 2024-04-26T07:49:07.697 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.697 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.697 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.697 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:07.697 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:07.697 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:07.699 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:07.699 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:07.697+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:07.799 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:07.797+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:07.901 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:07.899+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:07.912 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:07.912 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:07.912 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:07.912 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:07.943 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:49:07.950 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:08.002 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:08.003+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:08.103 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:08.099+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:08.181 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:08.182 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:08.182 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:08.182 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:08.182 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:08.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:08.203 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:08.203+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:08.304 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:08.301+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:08.373 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:08.373 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:08.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:08.373 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.812511532999999, 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089363580000000001, 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2 2024-04-26T07:49:08.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559516+0000", 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3180000000000001e-06 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559526+0000", 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8190000000000003e-06 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559547+0000", 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1675000000000002e-05 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559563+0000", 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5582000000000001e-05 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561240+0000", 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676978 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561260+0000", 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0590000000000001e-05 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568285+0000", 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070247670000000003 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568450+0000", 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016462900000000001 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.378 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.761882907999997, 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030230650000000001, 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 38 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610144+0000", 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.517e-06 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610152+0000", 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5820000000000002e-06 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610171+0000", 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8621e-05 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610180+0000", 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9029999999999993e-06 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610293+0000", 2024-04-26T07:49:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113552 2024-04-26T07:49:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610492+0000", 2024-04-26T07:49:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000199008 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610724+0000", 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023223499999999999 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.611841+0000", 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011162769999999999 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613006+0000", 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001165475 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613098+0000", 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1608999999999997e-05 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613165+0000", 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7286000000000006e-05 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:50 7.15 e26/25 7:a93a5511:::notify.2:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.774550798999996, 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029468020000000001, 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597475+0000", 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2600000000000002e-07 2024-04-26T07:49:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597485+0000", 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8600000000000005e-06 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597524+0000", 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9156999999999998e-05 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597545+0000", 2024-04-26T07:49:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1625999999999999e-05 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597750+0000", 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020436900000000001 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597798+0000", 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7732999999999999e-05 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600300+0000", 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025022859999999998 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600421+0000", 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121045 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.661276377, 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030667120000000001, 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 193 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710751+0000", 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2529999999999999e-06 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710763+0000", 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.225e-05 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710795+0000", 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2286999999999998e-05 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710810+0000", 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5102999999999999e-05 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710951+0000", 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014038899999999999 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711181+0000", 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022999199999999999 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711433+0000", 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025236200000000001 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.712618+0000", 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184596 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713695+0000", 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001076975 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713765+0000", 2024-04-26T07:49:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0396999999999997e-05 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713815+0000", 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0108000000000002e-05 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.759008610000002, 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044673070000000002, 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 208 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613019+0000", 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613032+0000", 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3390000000000001e-05 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613059+0000", 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6369000000000001e-05 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613073+0000", 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613182+0000", 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108902 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613370+0000", 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018796899999999999 2024-04-26T07:49:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613779+0000", 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040870700000000002 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.614995+0000", 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012161030000000001 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617272+0000", 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022775450000000002 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617365+0000", 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2866000000000002e-05 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617484+0000", 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011849900000000001 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.740634362999998, 2024-04-26T07:49:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033767699999999999, 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 212 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631393+0000", 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631403+0000", 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0757000000000001e-05 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631434+0000", 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0685999999999997e-05 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631452+0000", 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8289999999999999e-05 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631578+0000", 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012580499999999999 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631799+0000", 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221072 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.632219+0000", 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041983999999999999 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.633745+0000", 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015256410000000001 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634566+0000", 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000821234 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634652+0000", 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5521999999999999e-05 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634767+0000", 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115763 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.714689061000001, 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.689682879999999, 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037018250000000002, 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 224 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682344+0000", 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3199999999999998e-06 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682358+0000", 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3223e-05 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682389+0000", 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1819000000000001e-05 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682404+0000", 2024-04-26T07:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4773000000000001e-05 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682559+0000", 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015474900000000001 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682925+0000", 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000365724 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.683728+0000", 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000803096 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685343+0000", 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016147939999999999 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685828+0000", 2024-04-26T07:49:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048552900000000001 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685924+0000", 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5488999999999993e-05 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.686044+0000", 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120309 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.655143608000003, 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031929739999999999, 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 233 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716884+0000", 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5799999999999999e-06 2024-04-26T07:49:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716896+0000", 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2013e-05 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716928+0000", 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1739000000000002e-05 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716942+0000", 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4367e-05 2024-04-26T07:49:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717058+0000", 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116239 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717283+0000", 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022485499999999999 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717719+0000", 2024-04-26T07:49:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043577999999999998 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719168+0000", 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449021 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719862+0000", 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069427499999999995 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719954+0000", 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1939000000000002e-05 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.720074+0000", 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120166 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:320 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.625338009000004, 2024-04-26T07:49:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041265579999999998, 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 320 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746689+0000", 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.75e-06 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746697+0000", 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4770000000000003e-06 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746719+0000", 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1543e-05 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746730+0000", 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1041e-05 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746802+0000", 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.237e-05 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746936+0000", 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013430000000000001 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747126+0000", 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018941100000000001 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747902+0000", 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077641500000000003 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750700+0000", 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002797875 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750759+0000", 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8622999999999998e-05 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750813+0000", 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4753000000000002e-05 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:392 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.607655254000001, 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003372562, 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 392 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764371+0000", 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0699999999999999e-06 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764376+0000", 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4530000000000001e-06 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764391+0000", 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764398+0000", 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6650000000000003e-06 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764458+0000", 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9580000000000002e-05 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764518+0000", 2024-04-26T07:49:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9833000000000001e-05 2024-04-26T07:49:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764632+0000", 2024-04-26T07:49:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114765 2024-04-26T07:49:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.765112+0000", 2024-04-26T07:49:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047932900000000002 2024-04-26T07:49:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767688+0000", 2024-04-26T07:49:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002576339 2024-04-26T07:49:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767719+0000", 2024-04-26T07:49:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1307999999999999e-05 2024-04-26T07:49:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767742+0000", 2024-04-26T07:49:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2892999999999999e-05 2024-04-26T07:49:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:481 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.558666602000002, 2024-04-26T07:49:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029129989999999999, 2024-04-26T07:49:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 481 2024-04-26T07:49:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813359+0000", 2024-04-26T07:49:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2399999999999997e-07 2024-04-26T07:49:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813363+0000", 2024-04-26T07:49:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7699999999999999e-06 2024-04-26T07:49:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813373+0000", 2024-04-26T07:49:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0564000000000001e-05 2024-04-26T07:49:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813378+0000", 2024-04-26T07:49:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9869999999999999e-06 2024-04-26T07:49:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813431+0000", 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2601e-05 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813486+0000", 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5525000000000001e-05 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813616+0000", 2024-04-26T07:49:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129195 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.814126+0000", 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051048 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816215+0000", 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020892279999999998 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816247+0000", 2024-04-26T07:49:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1523000000000003e-05 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816271+0000", 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4402000000000001e-05 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.358297426, 2024-04-26T07:49:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030638950000000001, 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 733 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013730+0000", 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.723e-06 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013742+0000", 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2099999999999999e-05 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013774+0000", 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1686000000000001e-05 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013791+0000", 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7433000000000001e-05 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013903+0000", 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111562 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014125+0000", 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221962 2024-04-26T07:49:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014446+0000", 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032154800000000001 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.015730+0000", 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012836189999999999 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016636+0000", 2024-04-26T07:49:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090594600000000003 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016725+0000", 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8945999999999998e-05 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016791+0000", 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6370000000000003e-05 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.209205898999997, 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031006810000000001, 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 796 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162821+0000", 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2000000000000001e-06 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162832+0000", 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1123e-05 2024-04-26T07:49:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162863+0000", 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1053000000000002e-05 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162878+0000", 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4627000000000001e-05 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163055+0000", 2024-04-26T07:49:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017737800000000001 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163271+0000", 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021579100000000001 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163582+0000", 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031048799999999999 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.164646+0000", 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064391 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165770+0000", 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001123895 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165858+0000", 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7604999999999999e-05 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165920+0000", 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2130000000000003e-05 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.205133095999997, 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030619419999999998, 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 798 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166894+0000", 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0669999999999999e-06 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166905+0000", 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0689999999999999e-05 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166931+0000", 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5982e-05 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166943+0000", 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2269999999999999e-05 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167088+0000", 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144983 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167220+0000", 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000131989 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167484+0000", 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026388399999999998 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.168382+0000", 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089864600000000002 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169799+0000", 2024-04-26T07:49:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014165250000000001 2024-04-26T07:49:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169885+0000", 2024-04-26T07:49:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6629e-05 2024-04-26T07:49:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169954+0000", 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8276999999999997e-05 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.186862830999999, 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029491159999999999, 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 805 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185164+0000", 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2800000000000002e-06 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185176+0000", 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1576000000000001e-05 2024-04-26T07:49:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185207+0000", 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0657000000000001e-05 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185224+0000", 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6943e-05 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185347+0000", 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012364200000000001 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185557+0000", 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000209385 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185867+0000", 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031047799999999999 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.186792+0000", 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092501900000000001 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.187956+0000", 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011643210000000001 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188043+0000", 2024-04-26T07:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6621999999999998e-05 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188111+0000", 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8193000000000003e-05 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.118367235000001, 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002965442, 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 834 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253659+0000", 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.813e-06 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253669+0000", 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5529999999999998e-06 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253695+0000", 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5542999999999999e-05 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253707+0000", 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2320000000000001e-05 2024-04-26T07:49:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253850+0000", 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143356 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253974+0000", 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012351899999999999 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.254248+0000", 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000274104 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.255127+0000", 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00087949999999999996 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256473+0000", 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013458890000000001 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256560+0000", 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7206000000000005e-05 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256623+0000", 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2638999999999994e-05 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.960029626000001, 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034075350000000002, 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 901 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411998+0000", 2024-04-26T07:49:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412011+0000", 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2873e-05 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412042+0000", 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1168999999999999e-05 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412058+0000", 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5480000000000001e-05 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412219+0000", 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016089899999999999 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412592+0000", 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037354 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.413172+0000", 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00057962499999999995 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.414322+0000", 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001149705 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415207+0000", 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088520199999999997 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415294+0000", 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6860000000000005e-05 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415403+0000", 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010914200000000001 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.955311455, 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033765959999999999, 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 903 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416716+0000", 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.08e-06 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416729+0000", 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.378e-05 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416762+0000", 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3173000000000002e-05 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416777+0000", 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4873e-05 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416907+0000", 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417143+0000", 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023651499999999999 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417631+0000", 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048777599999999999 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.418763+0000", 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011318599999999999 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419805+0000", 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001041742 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419970+0000", 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016569499999999999 2024-04-26T07:49:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.420090+0000", 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119553 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.854761343, 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003600907, 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 946 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517266+0000", 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2730000000000001e-06 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517278+0000", 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1987000000000001e-05 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517310+0000", 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1843e-05 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517325+0000", 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5197e-05 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517439+0000", 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113785 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517663+0000", 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022453499999999999 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517999+0000", 2024-04-26T07:49:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033559099999999999 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.519130+0000", 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001131544 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520581+0000", 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014505950000000001 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520744+0000", 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016345199999999999 2024-04-26T07:49:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520864+0000", 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120105 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:08.493 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:08.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:08.496 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:08.491+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:08.596 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:08.593+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:08.697 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:08.693+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:08.708 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:08.708 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:08.708 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:08.708 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:08.726 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:08.817 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:08.817+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:08.899 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:08.895+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:08.939 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:08.940 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:08.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:08.960 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:09.000 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:08.999+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:09.101 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:09.101+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:09.114 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.494415353000001, 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026678100000000001, 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 42 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620179+0000", 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2400000000000002e-06 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620193+0000", 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3886000000000001e-05 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620222+0000", 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8736000000000001e-05 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620243+0000", 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0832e-05 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620365+0000", 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012243700000000001 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620549+0000", 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018372899999999999 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620684+0000", 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135723 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.621541+0000", 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085632299999999998 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622750+0000", 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001209168 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622801+0000", 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0991e-05 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622845+0000", 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3745000000000002e-05 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.121 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.512868241, 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0056514750000000004, 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 52 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601727+0000", 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.163e-06 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601761+0000", 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3847999999999998e-05 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602013+0000", 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025215399999999998 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602102+0000", 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9066000000000004e-05 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602273+0000", 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000171182 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602651+0000", 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037720000000000001 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602995+0000", 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000344247 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.604820+0000", 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018254160000000001 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607233+0000", 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024128230000000001 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607309+0000", 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6224999999999996e-05 2024-04-26T07:49:09.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607376+0000", 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6150999999999997e-05 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.127 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.387264203999997, 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031921969999999999, 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 236 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:09.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727332+0000", 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4869999999999998e-06 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727346+0000", 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4836e-05 2024-04-26T07:49:09.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727380+0000", 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3692999999999997e-05 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727400+0000", 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9979999999999998e-05 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727531+0000", 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130949 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727788+0000", 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025688499999999999 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.728200+0000", 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041179900000000002 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.729730+0000", 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001530572 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730356+0000", 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062611800000000005 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730446+0000", 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9319000000000003e-05 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730520+0000", 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4559000000000002e-05 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.373724393000003, 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028999310000000001, 2024-04-26T07:49:09.133 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 283 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740869+0000", 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.155e-06 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740884+0000", 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.543e-05 2024-04-26T07:49:09.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740899+0000", 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4533e-05 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740905+0000", 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4010000000000002e-06 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740970+0000", 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4888000000000006e-05 2024-04-26T07:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741087+0000", 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116388 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741223+0000", 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013601800000000001 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741950+0000", 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072763400000000001 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743680+0000", 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017300309999999999 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743719+0000", 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8732000000000001e-05 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743768+0000", 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8721000000000003e-05 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:09.139 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.077390241000003, 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028979790000000002, 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 742 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037205+0000", 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.683e-06 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037217+0000", 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2347000000000001e-05 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037249+0000", 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1652999999999997e-05 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037264+0000", 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5053e-05 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037398+0000", 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134449 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037637+0000", 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000238388 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037984+0000", 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000347401 2024-04-26T07:49:09.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039386+0000", 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001402375 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039941+0000", 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00055470499999999996 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040031+0000", 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9870000000000005e-05 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040100+0000", 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9054999999999995e-05 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.036741905, 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026953580000000001, 2024-04-26T07:49:09.145 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 760 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077853+0000", 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2199999999999999e-06 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077864+0000", 2024-04-26T07:49:09.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.136e-05 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077895+0000", 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1380000000000001e-05 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077910+0000", 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4683e-05 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078033+0000", 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012319499999999999 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078253+0000", 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021987499999999999 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078568+0000", 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031487099999999999 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.079737+0000", 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001169364 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080396+0000", 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065863100000000002 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080482+0000", 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5673000000000005e-05 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080546+0000", 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4105999999999999e-05 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:09.151 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.033062094999998, 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026454019999999998, 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 762 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081532+0000", 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081560+0000", 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8153e-05 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081592+0000", 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1757000000000001e-05 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081611+0000", 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8626000000000001e-05 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081721+0000", 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110296 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081849+0000", 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012843199999999999 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.082121+0000", 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027200800000000002 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.083234+0000", 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011123769999999999 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084026+0000", 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079225400000000005 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084109+0000", 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2641999999999999e-05 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084176+0000", 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7037000000000002e-05 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.156 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.899399125999999, 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026859850000000001, 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 817 2024-04-26T07:49:09.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215197+0000", 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.444e-06 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215210+0000", 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3016e-05 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215241+0000", 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1050000000000003e-05 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215256+0000", 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5293000000000001e-05 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215390+0000", 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013440199999999999 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215620+0000", 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022916200000000001 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215891+0000", 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027189100000000002 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217059+0000", 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011680670000000001 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217578+0000", 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051814600000000004 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217748+0000", 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017023200000000001 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217879+0000", 2024-04-26T07:49:09.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013128200000000001 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.895584962999997, 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030863079999999998, 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.163 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 819 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219009+0000", 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6300000000000001e-06 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219018+0000", 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7830000000000004e-06 2024-04-26T07:49:09.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219043+0000", 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4902999999999999e-05 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219055+0000", 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2733e-05 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219187+0000", 2024-04-26T07:49:09.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013202600000000001 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219416+0000", 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000228595 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219921+0000", 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00050526200000000003 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221111+0000", 2024-04-26T07:49:09.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001189264 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221824+0000", 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071316700000000001 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221979+0000", 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015522600000000001 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.222094+0000", 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114719 2024-04-26T07:49:09.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.843718699, 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033639400000000002, 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.169 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 841 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270876+0000", 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5239999999999999e-06 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270888+0000", 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.239e-05 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270919+0000", 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0386e-05 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270937+0000", 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8023e-05 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271091+0000", 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153802 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271447+0000", 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035622099999999999 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.272032+0000", 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058492799999999997 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273324+0000", 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012923559999999999 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273958+0000", 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063414899999999998 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274114+0000", 2024-04-26T07:49:09.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015607800000000001 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274238+0000", 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012308299999999999 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.839153949, 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031880070000000001, 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.179 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 843 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275441+0000", 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2129999999999998e-06 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275451+0000", 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0727000000000001e-05 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275483+0000", 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2011999999999998e-05 2024-04-26T07:49:09.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275504+0000", 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0267000000000001e-05 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275646+0000", 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014206900000000001 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275879+0000", 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000233315 2024-04-26T07:49:09.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.276359+0000", 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048021899999999999 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.277529+0000", 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011702609999999999 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278354+0000", 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00082486600000000005 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278506+0000", 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015169599999999999 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278626+0000", 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120362 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.829061824, 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027584929999999999, 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 847 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285533+0000", 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3159999999999999e-06 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285544+0000", 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1253999999999999e-05 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285575+0000", 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0738999999999998e-05 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285589+0000", 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4343e-05 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285702+0000", 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112649 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285921+0000", 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021945499999999999 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.286238+0000", 2024-04-26T07:49:09.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031702400000000001 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.287549+0000", 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001310879 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288004+0000", 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045514399999999999 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288167+0000", 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016323100000000001 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288289+0000", 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121459 2024-04-26T07:49:09.190 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.825178272999999, 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002936106, 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.191 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 849 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289416+0000", 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7129999999999999e-06 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289425+0000", 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6369999999999994e-06 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289450+0000", 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4433000000000001e-05 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289462+0000", 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1956999999999999e-05 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289591+0000", 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289827+0000", 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023558800000000001 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.290310+0000", 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048358899999999998 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.291493+0000", 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001182324 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292082+0000", 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058951499999999998 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292242+0000", 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159309 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292350+0000", 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108492 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:09.196 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.780572073999998, 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026241229999999999, 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 868 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334022+0000", 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8610000000000001e-06 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334031+0000", 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3759999999999997e-06 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334055+0000", 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3272999999999999e-05 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334066+0000", 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1498000000000001e-05 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334185+0000", 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118355 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334409+0000", 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022421499999999999 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334721+0000", 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031224699999999998 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336020+0000", 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012986829999999999 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336496+0000", 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047615 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336578+0000", 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2452000000000003e-05 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336644+0000", 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6013000000000006e-05 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.202 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.687291338000001, 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032794199999999999, 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 907 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427303+0000", 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.446e-06 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427315+0000", 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1707e-05 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427348+0000", 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2642999999999999e-05 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427363+0000", 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5037e-05 2024-04-26T07:49:09.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427519+0000", 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015594200000000001 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427915+0000", 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039595599999999999 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.428501+0000", 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058595900000000005 2024-04-26T07:49:09.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.429998+0000", 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014978210000000001 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430311+0000", 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031217400000000002 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430468+0000", 2024-04-26T07:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015785500000000001 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430580+0000", 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011188000000000001 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.682868304000003, 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002976916, 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 909 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431726+0000", 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8759999999999999e-06 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431735+0000", 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.577e-06 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431761+0000", 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5117e-05 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431773+0000", 2024-04-26T07:49:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2526e-05 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431878+0000", 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010459300000000001 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432020+0000", 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014283899999999999 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432300+0000", 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279664 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.433338+0000", 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001038115 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434437+0000", 2024-04-26T07:49:09.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001098878 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434590+0000", 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015255800000000001 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434701+0000", 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111173 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.214 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.590022732999998, 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026912619999999998, 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 949 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.215 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524572+0000", 2024-04-26T07:49:09.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4870000000000001e-06 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524584+0000", 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.242e-05 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524615+0000", 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0156000000000001e-05 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524630+0000", 2024-04-26T07:49:09.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5327000000000001e-05 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524785+0000", 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015463799999999999 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525023+0000", 2024-04-26T07:49:09.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023835800000000001 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525339+0000", 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031561799999999999 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.526523+0000", 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184367 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527111+0000", 2024-04-26T07:49:09.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058795500000000003 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527193+0000", 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2459000000000005e-05 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527261+0000", 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7477000000000005e-05 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.220 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.221 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.221 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:09.221 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.586391208999999, 2024-04-26T07:49:09.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025643620000000002, 2024-04-26T07:49:09.221 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.221 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 951 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528203+0000", 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5600000000000001e-06 2024-04-26T07:49:09.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528211+0000", 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8060000000000001e-06 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528236+0000", 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4933999999999999e-05 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528249+0000", 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2935999999999999e-05 2024-04-26T07:49:09.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528348+0000", 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8822999999999999e-05 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528473+0000", 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012490900000000001 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528743+0000", 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026996099999999999 2024-04-26T07:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.529961+0000", 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012176299999999999 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530617+0000", 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065623799999999996 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530701+0000", 2024-04-26T07:49:09.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4419000000000006e-05 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530765+0000", 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4146000000000006e-05 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.227 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.228 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:09.228 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.572093019, 2024-04-26T07:49:09.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002689145, 2024-04-26T07:49:09.228 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.228 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.228 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.228 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.229 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.229 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.229 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 955 2024-04-26T07:49:09.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.229 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:09.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:09.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542501+0000", 2024-04-26T07:49:09.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1639999999999999e-06 2024-04-26T07:49:09.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542513+0000", 2024-04-26T07:49:09.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1456e-05 2024-04-26T07:49:09.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542543+0000", 2024-04-26T07:49:09.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0190000000000001e-05 2024-04-26T07:49:09.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542558+0000", 2024-04-26T07:49:09.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4866e-05 2024-04-26T07:49:09.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542681+0000", 2024-04-26T07:49:09.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012343200000000001 2024-04-26T07:49:09.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542905+0000", 2024-04-26T07:49:09.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223155 2024-04-26T07:49:09.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.543219+0000", 2024-04-26T07:49:09.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031459800000000003 2024-04-26T07:49:09.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.544603+0000", 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013838489999999999 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545039+0000", 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043600300000000002 2024-04-26T07:49:09.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545124+0000", 2024-04-26T07:49:09.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4999000000000004e-05 2024-04-26T07:49:09.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545188+0000", 2024-04-26T07:49:09.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4432999999999998e-05 2024-04-26T07:49:09.239 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.239 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.239 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.239 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:09.239 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:09.240 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.568516357999997, 2024-04-26T07:49:09.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026964580000000001, 2024-04-26T07:49:09.240 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:09.240 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:09.240 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:09.240 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:09.240 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:09.241 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:09.241 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 957 2024-04-26T07:49:09.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.241 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:09.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:09.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:09.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:09.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:09.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:09.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:09.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546078+0000", 2024-04-26T07:49:09.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0700000000000001e-06 2024-04-26T07:49:09.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:09.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546088+0000", 2024-04-26T07:49:09.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0067e-05 2024-04-26T07:49:09.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:09.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546118+0000", 2024-04-26T07:49:09.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0429999999999998e-05 2024-04-26T07:49:09.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:09.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546136+0000", 2024-04-26T07:49:09.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7520000000000002e-05 2024-04-26T07:49:09.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:09.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546252+0000", 2024-04-26T07:49:09.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115945 2024-04-26T07:49:09.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:09.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546400+0000", 2024-04-26T07:49:09.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014764199999999999 2024-04-26T07:49:09.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:09.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546672+0000", 2024-04-26T07:49:09.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027279099999999998 2024-04-26T07:49:09.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:09.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.547902+0000", 2024-04-26T07:49:09.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001230014 2024-04-26T07:49:09.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:09.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548616+0000", 2024-04-26T07:49:09.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071360399999999995 2024-04-26T07:49:09.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:09.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548707+0000", 2024-04-26T07:49:09.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1372999999999994e-05 2024-04-26T07:49:09.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:09.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:09.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:09.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548772+0000", 2024-04-26T07:49:09.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5001999999999999e-05 2024-04-26T07:49:09.251 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.251 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.252 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.252 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:09.252 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:09.252 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:09.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:09.255 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:09.256 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:09.256 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:09.257 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:09.257 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:09.253+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:09.258 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:09.258 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:09.286 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:09.286 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:09.319 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:09.320 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:09.353 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:09.353 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:09.354 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:09.353+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:09.386 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:09.419 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:09.419 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:09.429 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:09.429 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:09.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:09.455 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:09.451+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:09.556 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:09.553+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:09.608 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:09.608 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:09.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:09.657 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:09.655+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:09.758 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:09.757+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:09.838 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:09.838 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:09.856 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:09.858 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:09.855+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:09.959 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:09.959+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:09.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:49:09.989 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:09.989 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:10.003 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:10.096 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:10.095+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:10.161 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:10.159+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:10.172 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:10.172 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:10.186 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:10.276 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:10.275+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:10.353 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:10.354 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:10.362 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:10.359+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:10.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:10.463 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:10.459+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:10.538 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:10.539 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:10.553 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:10.596 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:10.595+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:10.664 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:10.661+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:10.718 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:10.719 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:10.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:10.765 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:10.765+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:10.858 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:10.858 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:10.867 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:10.863+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:10.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:10.957 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:49:10.968 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:10.965+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:11.042 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:11.042 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:11.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:11.069 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:11.065+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:11.170 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:11.169+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:11.180 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:11.180 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:11.194 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:11.271 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:11.269+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:11.317 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:11.317 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:11.331 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:11.379 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:11.379+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:11.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:11.451 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:11.451 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:11.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:11.490 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:11.489+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:11.573 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:11.573+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:11.636 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:11.637 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:11.641 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:11.651 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:11.672 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:11.672 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:11.696 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:11.695+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:11.702 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:11.703 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:11.733 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:11.733 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:11.764 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:11.764 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:11.775 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:11.771+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:11.775 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:11.775 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:11.784 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:11.784 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:11.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:11.811 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:11.812 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:11.844 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:11.845 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:11.876 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:11.875+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:11.957 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:11.957 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:11.957 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:11.958 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:11.976 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:11.977 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:11.977+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:12.079 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:12.077+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:12.085 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:12.085 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:12.085 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:12.085 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:12.085 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:12.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:12.180 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:12.179+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:12.281 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:12.277+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.683691091, 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:49:12.301 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:49:12.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.695783994000003, 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.309 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:49:12.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.676422348000003, 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.315 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:49:12.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.646293917000001, 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.318 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:49:12.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:49:12.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:49:12.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.323 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.624875821000003, 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.324 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.326 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:12.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:12.329 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.594876452000001, 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.576277199000003, 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:49:12.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.558294410999999, 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:49:12.340 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:49:12.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.526470017000001, 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:12.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:49:12.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:49:12.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:12.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:49:12.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:49:12.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.474615602, 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.352 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:12.357 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.465780295999998, 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:49:12.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:49:12.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.416766979000002, 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:49:12.363 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:49:12.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:12.369 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.362345077999997, 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:12.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:49:12.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:49:12.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:49:12.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:49:12.374 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.158615816999998, 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:49:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:49:12.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:49:12.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.154718666000001, 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.380 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:49:12.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:49:12.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:49:12.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.100674486000003, 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.386 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:49:12.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.096548325999997, 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:49:12.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.397 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.916354202000001, 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.398 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:49:12.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.912705082000002, 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.403 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:49:12.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:49:12.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.408 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.5480669799999998, 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031879370000000001, 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1020 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:12.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751976+0000", 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6330000000000001e-06 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751983+0000", 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7070000000000003e-06 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752000+0000", 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7169000000000001e-05 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752011+0000", 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.099e-05 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752123+0000", 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112154 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752277+0000", 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015411299999999999 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752536+0000", 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025889199999999999 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.753314+0000", 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077766900000000004 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755045+0000", 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001731376 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755117+0000", 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1963000000000002e-05 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755163+0000", 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5271000000000001e-05 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.414 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:12.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:12.416 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:12.415+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:12.517 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:12.515+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:12.568 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:12.568 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:12.568 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:12.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:12.618 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:12.615+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:12.691 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:12.691 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:12.691 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:12.691 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:12.691 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:12.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:12.719 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:12.715+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:12.818 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.258048520999999, 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089363580000000001, 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.819 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559516+0000", 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3180000000000001e-06 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559526+0000", 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8190000000000003e-06 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559547+0000", 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1675000000000002e-05 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559563+0000", 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5582000000000001e-05 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561240+0000", 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676978 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561260+0000", 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0590000000000001e-05 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568285+0000", 2024-04-26T07:49:12.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070247670000000003 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568450+0000", 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016462900000000001 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:12.824 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.207419895999998, 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030230650000000001, 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:12.825 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 38 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610144+0000", 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.517e-06 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610152+0000", 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5820000000000002e-06 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610171+0000", 2024-04-26T07:49:12.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8621e-05 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610180+0000", 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9029999999999993e-06 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610293+0000", 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113552 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610492+0000", 2024-04-26T07:49:12.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000199008 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610724+0000", 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023223499999999999 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.611841+0000", 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011162769999999999 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613006+0000", 2024-04-26T07:49:12.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001165475 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613098+0000", 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1608999999999997e-05 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613165+0000", 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7286000000000006e-05 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.830 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:50 7.15 e26/25 7:a93a5511:::notify.2:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.220087786999997, 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029468020000000001, 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597475+0000", 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2600000000000002e-07 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597485+0000", 2024-04-26T07:49:12.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8600000000000005e-06 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597524+0000", 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9156999999999998e-05 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597545+0000", 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1625999999999999e-05 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597750+0000", 2024-04-26T07:49:12.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020436900000000001 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597798+0000", 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7732999999999999e-05 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600300+0000", 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025022859999999998 2024-04-26T07:49:12.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600421+0000", 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121045 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.106813365000001, 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030667120000000001, 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 193 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:12.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710751+0000", 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2529999999999999e-06 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710763+0000", 2024-04-26T07:49:12.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.225e-05 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710795+0000", 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2286999999999998e-05 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710810+0000", 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5102999999999999e-05 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710951+0000", 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014038899999999999 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711181+0000", 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022999199999999999 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711433+0000", 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025236200000000001 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.712618+0000", 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184596 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713695+0000", 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001076975 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713765+0000", 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0396999999999997e-05 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713815+0000", 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0108000000000002e-05 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.204545598000003, 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044673070000000002, 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 208 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613019+0000", 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613032+0000", 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3390000000000001e-05 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613059+0000", 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6369000000000001e-05 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613073+0000", 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613182+0000", 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108902 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613370+0000", 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018796899999999999 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613779+0000", 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040870700000000002 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.614995+0000", 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012161030000000001 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617272+0000", 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022775450000000002 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617365+0000", 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2866000000000002e-05 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617484+0000", 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011849900000000001 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.847 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.186171350999999, 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033767699999999999, 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 212 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631393+0000", 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631403+0000", 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0757000000000001e-05 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631434+0000", 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0685999999999997e-05 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631452+0000", 2024-04-26T07:49:12.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8289999999999999e-05 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631578+0000", 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012580499999999999 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631799+0000", 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221072 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.632219+0000", 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041983999999999999 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.633745+0000", 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015256410000000001 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634566+0000", 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000821234 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634652+0000", 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5521999999999999e-05 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634767+0000", 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115763 2024-04-26T07:49:12.853 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.160226049000002, 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:49:12.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:49:12.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:49:12.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.135219868, 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037018250000000002, 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 224 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682344+0000", 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3199999999999998e-06 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682358+0000", 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3223e-05 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682389+0000", 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1819000000000001e-05 2024-04-26T07:49:12.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682404+0000", 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4773000000000001e-05 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682559+0000", 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015474900000000001 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682925+0000", 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000365724 2024-04-26T07:49:12.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.683728+0000", 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000803096 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685343+0000", 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016147939999999999 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685828+0000", 2024-04-26T07:49:12.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048552900000000001 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685924+0000", 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5488999999999993e-05 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.686044+0000", 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120309 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.867 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.867 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:12.867 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.100680595999997, 2024-04-26T07:49:12.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031929739999999999, 2024-04-26T07:49:12.867 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.868 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.868 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.868 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 233 2024-04-26T07:49:12.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.869 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:12.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:12.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716884+0000", 2024-04-26T07:49:12.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5799999999999999e-06 2024-04-26T07:49:12.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716896+0000", 2024-04-26T07:49:12.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2013e-05 2024-04-26T07:49:12.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716928+0000", 2024-04-26T07:49:12.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1739000000000002e-05 2024-04-26T07:49:12.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716942+0000", 2024-04-26T07:49:12.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4367e-05 2024-04-26T07:49:12.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717058+0000", 2024-04-26T07:49:12.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116239 2024-04-26T07:49:12.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717283+0000", 2024-04-26T07:49:12.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022485499999999999 2024-04-26T07:49:12.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717719+0000", 2024-04-26T07:49:12.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043577999999999998 2024-04-26T07:49:12.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719168+0000", 2024-04-26T07:49:12.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449021 2024-04-26T07:49:12.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719862+0000", 2024-04-26T07:49:12.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069427499999999995 2024-04-26T07:49:12.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719954+0000", 2024-04-26T07:49:12.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1939000000000002e-05 2024-04-26T07:49:12.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.720074+0000", 2024-04-26T07:49:12.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120166 2024-04-26T07:49:12.879 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.879 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.880 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.880 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:320 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.880 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:12.880 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.070874996999997, 2024-04-26T07:49:12.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041265579999999998, 2024-04-26T07:49:12.880 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.881 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.881 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.881 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.881 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.881 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.881 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 320 2024-04-26T07:49:12.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.882 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:12.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:12.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746689+0000", 2024-04-26T07:49:12.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.75e-06 2024-04-26T07:49:12.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746697+0000", 2024-04-26T07:49:12.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4770000000000003e-06 2024-04-26T07:49:12.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746719+0000", 2024-04-26T07:49:12.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1543e-05 2024-04-26T07:49:12.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746730+0000", 2024-04-26T07:49:12.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1041e-05 2024-04-26T07:49:12.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746802+0000", 2024-04-26T07:49:12.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.237e-05 2024-04-26T07:49:12.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746936+0000", 2024-04-26T07:49:12.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013430000000000001 2024-04-26T07:49:12.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:12.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747126+0000", 2024-04-26T07:49:12.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018941100000000001 2024-04-26T07:49:12.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747902+0000", 2024-04-26T07:49:12.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077641500000000003 2024-04-26T07:49:12.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750700+0000", 2024-04-26T07:49:12.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002797875 2024-04-26T07:49:12.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750759+0000", 2024-04-26T07:49:12.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8622999999999998e-05 2024-04-26T07:49:12.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750813+0000", 2024-04-26T07:49:12.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4753000000000002e-05 2024-04-26T07:49:12.891 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.891 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.891 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:392 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.053192242000001, 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003372562, 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.892 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 392 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764371+0000", 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0699999999999999e-06 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764376+0000", 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4530000000000001e-06 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764391+0000", 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:12.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764398+0000", 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6650000000000003e-06 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764458+0000", 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9580000000000002e-05 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764518+0000", 2024-04-26T07:49:12.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9833000000000001e-05 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764632+0000", 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114765 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.765112+0000", 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047932900000000002 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767688+0000", 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002576339 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767719+0000", 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1307999999999999e-05 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767742+0000", 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2892999999999999e-05 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.897 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:481 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.004203590000003, 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029129989999999999, 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.898 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 481 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813359+0000", 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2399999999999997e-07 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813363+0000", 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7699999999999999e-06 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813373+0000", 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0564000000000001e-05 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813378+0000", 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9869999999999999e-06 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813431+0000", 2024-04-26T07:49:12.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2601e-05 2024-04-26T07:49:12.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813486+0000", 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5525000000000001e-05 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813616+0000", 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129195 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.814126+0000", 2024-04-26T07:49:12.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051048 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816215+0000", 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020892279999999998 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816247+0000", 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1523000000000003e-05 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816271+0000", 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4402000000000001e-05 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.803834414000001, 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030638950000000001, 2024-04-26T07:49:12.905 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 733 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:12.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:12.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013730+0000", 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.723e-06 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013742+0000", 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2099999999999999e-05 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013774+0000", 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1686000000000001e-05 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013791+0000", 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7433000000000001e-05 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013903+0000", 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111562 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014125+0000", 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221962 2024-04-26T07:49:12.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014446+0000", 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032154800000000001 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.015730+0000", 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012836189999999999 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016636+0000", 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090594600000000003 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016725+0000", 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8945999999999998e-05 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016791+0000", 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6370000000000003e-05 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.911 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.654742886999998, 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031006810000000001, 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.912 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 796 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162821+0000", 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2000000000000001e-06 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162832+0000", 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1123e-05 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162863+0000", 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1053000000000002e-05 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162878+0000", 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4627000000000001e-05 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163055+0000", 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017737800000000001 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163271+0000", 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021579100000000001 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163582+0000", 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031048799999999999 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.164646+0000", 2024-04-26T07:49:12.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064391 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165770+0000", 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001123895 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165858+0000", 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7604999999999999e-05 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165920+0000", 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2130000000000003e-05 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.650670083999998, 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030619419999999998, 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.918 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 798 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166894+0000", 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0669999999999999e-06 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166905+0000", 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0689999999999999e-05 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166931+0000", 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5982e-05 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166943+0000", 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2269999999999999e-05 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167088+0000", 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144983 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167220+0000", 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000131989 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167484+0000", 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026388399999999998 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.168382+0000", 2024-04-26T07:49:12.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089864600000000002 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169799+0000", 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014165250000000001 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169885+0000", 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6629e-05 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169954+0000", 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8276999999999997e-05 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.632399819, 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029491159999999999, 2024-04-26T07:49:12.924 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 805 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185164+0000", 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2800000000000002e-06 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185176+0000", 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1576000000000001e-05 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185207+0000", 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0657000000000001e-05 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185224+0000", 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6943e-05 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185347+0000", 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012364200000000001 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185557+0000", 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000209385 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185867+0000", 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031047799999999999 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.186792+0000", 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092501900000000001 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.187956+0000", 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011643210000000001 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188043+0000", 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6621999999999998e-05 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188111+0000", 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8193000000000003e-05 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.563904223000002, 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002965442, 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.930 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 834 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253659+0000", 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.813e-06 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253669+0000", 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5529999999999998e-06 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253695+0000", 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5542999999999999e-05 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253707+0000", 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2320000000000001e-05 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253850+0000", 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143356 2024-04-26T07:49:12.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253974+0000", 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012351899999999999 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.254248+0000", 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000274104 2024-04-26T07:49:12.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.255127+0000", 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00087949999999999996 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256473+0000", 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013458890000000001 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256560+0000", 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7206000000000005e-05 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256623+0000", 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2638999999999994e-05 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:12.936 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.405566614000001, 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034075350000000002, 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 901 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:12.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411998+0000", 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412011+0000", 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2873e-05 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412042+0000", 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1168999999999999e-05 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412058+0000", 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5480000000000001e-05 2024-04-26T07:49:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412219+0000", 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016089899999999999 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412592+0000", 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037354 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.413172+0000", 2024-04-26T07:49:12.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00057962499999999995 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.414322+0000", 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001149705 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415207+0000", 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088520199999999997 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415294+0000", 2024-04-26T07:49:12.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6860000000000005e-05 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415403+0000", 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010914200000000001 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:12.942 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.400848443000001, 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033765959999999999, 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 903 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416716+0000", 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.08e-06 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416729+0000", 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.378e-05 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416762+0000", 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3173000000000002e-05 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416777+0000", 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4873e-05 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416907+0000", 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417143+0000", 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023651499999999999 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417631+0000", 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048777599999999999 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.418763+0000", 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011318599999999999 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419805+0000", 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001041742 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419970+0000", 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016569499999999999 2024-04-26T07:49:12.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.420090+0000", 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119553 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.300298331, 2024-04-26T07:49:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003600907, 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 946 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:12.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517266+0000", 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2730000000000001e-06 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:12.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517278+0000", 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1987000000000001e-05 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517310+0000", 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1843e-05 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517325+0000", 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5197e-05 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517439+0000", 2024-04-26T07:49:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113785 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517663+0000", 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022453499999999999 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517999+0000", 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033559099999999999 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:12.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.519130+0000", 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001131544 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520581+0000", 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014505950000000001 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520744+0000", 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016345199999999999 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520864+0000", 2024-04-26T07:49:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120105 2024-04-26T07:49:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:12.954 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:12.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:12.956 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:12.953+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:12.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:49:13.056 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:13.053+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:13.157 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:13.155+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:13.168 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:13.168 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:13.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:13.258 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:13.259+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:13.359 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:13.359+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:13.398 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:13.398 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:13.398 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:13.398 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:13.398 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:13.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:13.461 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:13.461+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:13.561 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:13.557+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:13.579 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:49:13.589 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:13.590 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:13.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:13.590 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:13.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.590 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:13.590 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:13.590 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.967631372, 2024-04-26T07:49:13.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026678100000000001, 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 42 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620179+0000", 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2400000000000002e-06 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620193+0000", 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3886000000000001e-05 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620222+0000", 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8736000000000001e-05 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620243+0000", 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0832e-05 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620365+0000", 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012243700000000001 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620549+0000", 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018372899999999999 2024-04-26T07:49:13.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620684+0000", 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135723 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.621541+0000", 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085632299999999998 2024-04-26T07:49:13.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622750+0000", 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001209168 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622801+0000", 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0991e-05 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622845+0000", 2024-04-26T07:49:13.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3745000000000002e-05 2024-04-26T07:49:13.598 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.598 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.598 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.986084259999998, 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0056514750000000004, 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.599 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 52 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601727+0000", 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.163e-06 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601761+0000", 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3847999999999998e-05 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602013+0000", 2024-04-26T07:49:13.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025215399999999998 2024-04-26T07:49:13.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602102+0000", 2024-04-26T07:49:13.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9066000000000004e-05 2024-04-26T07:49:13.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602273+0000", 2024-04-26T07:49:13.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000171182 2024-04-26T07:49:13.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602651+0000", 2024-04-26T07:49:13.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037720000000000001 2024-04-26T07:49:13.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:13.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602995+0000", 2024-04-26T07:49:13.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000344247 2024-04-26T07:49:13.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.604820+0000", 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018254160000000001 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607233+0000", 2024-04-26T07:49:13.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024128230000000001 2024-04-26T07:49:13.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607309+0000", 2024-04-26T07:49:13.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6224999999999996e-05 2024-04-26T07:49:13.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607376+0000", 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6150999999999997e-05 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:13.608 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.860480223000003, 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031921969999999999, 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 236 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:13.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727332+0000", 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4869999999999998e-06 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727346+0000", 2024-04-26T07:49:13.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4836e-05 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727380+0000", 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3692999999999997e-05 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727400+0000", 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9979999999999998e-05 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727531+0000", 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130949 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727788+0000", 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025688499999999999 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.728200+0000", 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041179900000000002 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.729730+0000", 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001530572 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730356+0000", 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062611800000000005 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730446+0000", 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9319000000000003e-05 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730520+0000", 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4559000000000002e-05 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.846940412000002, 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028999310000000001, 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.617 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.618 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.618 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.618 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.618 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 283 2024-04-26T07:49:13.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.618 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740869+0000", 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.155e-06 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740884+0000", 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.543e-05 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740899+0000", 2024-04-26T07:49:13.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4533e-05 2024-04-26T07:49:13.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740905+0000", 2024-04-26T07:49:13.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4010000000000002e-06 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740970+0000", 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4888000000000006e-05 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741087+0000", 2024-04-26T07:49:13.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116388 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741223+0000", 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013601800000000001 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741950+0000", 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072763400000000001 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743680+0000", 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017300309999999999 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743719+0000", 2024-04-26T07:49:13.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8732000000000001e-05 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743768+0000", 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8721000000000003e-05 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.550606260000002, 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028979790000000002, 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 742 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037205+0000", 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.683e-06 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037217+0000", 2024-04-26T07:49:13.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2347000000000001e-05 2024-04-26T07:49:13.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037249+0000", 2024-04-26T07:49:13.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1652999999999997e-05 2024-04-26T07:49:13.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037264+0000", 2024-04-26T07:49:13.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5053e-05 2024-04-26T07:49:13.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037398+0000", 2024-04-26T07:49:13.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134449 2024-04-26T07:49:13.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037637+0000", 2024-04-26T07:49:13.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000238388 2024-04-26T07:49:13.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037984+0000", 2024-04-26T07:49:13.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000347401 2024-04-26T07:49:13.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039386+0000", 2024-04-26T07:49:13.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001402375 2024-04-26T07:49:13.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039941+0000", 2024-04-26T07:49:13.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00055470499999999996 2024-04-26T07:49:13.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040031+0000", 2024-04-26T07:49:13.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9870000000000005e-05 2024-04-26T07:49:13.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040100+0000", 2024-04-26T07:49:13.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9054999999999995e-05 2024-04-26T07:49:13.635 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.635 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.635 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.635 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.635 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:13.636 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.509957923999998, 2024-04-26T07:49:13.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026953580000000001, 2024-04-26T07:49:13.636 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.636 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.636 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.636 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.636 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 760 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:13.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077853+0000", 2024-04-26T07:49:13.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2199999999999999e-06 2024-04-26T07:49:13.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077864+0000", 2024-04-26T07:49:13.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.136e-05 2024-04-26T07:49:13.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077895+0000", 2024-04-26T07:49:13.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1380000000000001e-05 2024-04-26T07:49:13.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077910+0000", 2024-04-26T07:49:13.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4683e-05 2024-04-26T07:49:13.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078033+0000", 2024-04-26T07:49:13.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012319499999999999 2024-04-26T07:49:13.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078253+0000", 2024-04-26T07:49:13.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021987499999999999 2024-04-26T07:49:13.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078568+0000", 2024-04-26T07:49:13.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031487099999999999 2024-04-26T07:49:13.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.079737+0000", 2024-04-26T07:49:13.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001169364 2024-04-26T07:49:13.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080396+0000", 2024-04-26T07:49:13.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065863100000000002 2024-04-26T07:49:13.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080482+0000", 2024-04-26T07:49:13.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5673000000000005e-05 2024-04-26T07:49:13.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080546+0000", 2024-04-26T07:49:13.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4105999999999999e-05 2024-04-26T07:49:13.645 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.645 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.645 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.646 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.646 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:13.646 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.506278113999997, 2024-04-26T07:49:13.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026454019999999998, 2024-04-26T07:49:13.646 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 762 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:13.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081532+0000", 2024-04-26T07:49:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081560+0000", 2024-04-26T07:49:13.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8153e-05 2024-04-26T07:49:13.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081592+0000", 2024-04-26T07:49:13.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1757000000000001e-05 2024-04-26T07:49:13.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081611+0000", 2024-04-26T07:49:13.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8626000000000001e-05 2024-04-26T07:49:13.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081721+0000", 2024-04-26T07:49:13.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110296 2024-04-26T07:49:13.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081849+0000", 2024-04-26T07:49:13.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012843199999999999 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.082121+0000", 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027200800000000002 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.083234+0000", 2024-04-26T07:49:13.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011123769999999999 2024-04-26T07:49:13.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084026+0000", 2024-04-26T07:49:13.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079225400000000005 2024-04-26T07:49:13.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084109+0000", 2024-04-26T07:49:13.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2641999999999999e-05 2024-04-26T07:49:13.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084176+0000", 2024-04-26T07:49:13.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7037000000000002e-05 2024-04-26T07:49:13.656 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.656 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.656 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.656 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.656 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.372615144999997, 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026859850000000001, 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.657 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 817 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215197+0000", 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.444e-06 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215210+0000", 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3016e-05 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215241+0000", 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1050000000000003e-05 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215256+0000", 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5293000000000001e-05 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215390+0000", 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013440199999999999 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215620+0000", 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022916200000000001 2024-04-26T07:49:13.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215891+0000", 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027189100000000002 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217059+0000", 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011680670000000001 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217578+0000", 2024-04-26T07:49:13.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051814600000000004 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217748+0000", 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017023200000000001 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217879+0000", 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013128200000000001 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.368800982000003, 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030863079999999998, 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 819 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.663 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219009+0000", 2024-04-26T07:49:13.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6300000000000001e-06 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219018+0000", 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7830000000000004e-06 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219043+0000", 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4902999999999999e-05 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219055+0000", 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2733e-05 2024-04-26T07:49:13.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219187+0000", 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013202600000000001 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219416+0000", 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000228595 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219921+0000", 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00050526200000000003 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221111+0000", 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001189264 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221824+0000", 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071316700000000001 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221979+0000", 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015522600000000001 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.222094+0000", 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114719 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:13.668 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.316934717999999, 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033639400000000002, 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 841 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270876+0000", 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5239999999999999e-06 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270888+0000", 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.239e-05 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270919+0000", 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0386e-05 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270937+0000", 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8023e-05 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271091+0000", 2024-04-26T07:49:13.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153802 2024-04-26T07:49:13.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271447+0000", 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035622099999999999 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.272032+0000", 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058492799999999997 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273324+0000", 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012923559999999999 2024-04-26T07:49:13.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273958+0000", 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063414899999999998 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274114+0000", 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015607800000000001 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274238+0000", 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012308299999999999 2024-04-26T07:49:13.676 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.312369967999999, 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031880070000000001, 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.677 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 843 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275441+0000", 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2129999999999998e-06 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275451+0000", 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0727000000000001e-05 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275483+0000", 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2011999999999998e-05 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275504+0000", 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0267000000000001e-05 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275646+0000", 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014206900000000001 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275879+0000", 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000233315 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.276359+0000", 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048021899999999999 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.277529+0000", 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011702609999999999 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278354+0000", 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00082486600000000005 2024-04-26T07:49:13.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278506+0000", 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015169599999999999 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278626+0000", 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120362 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.302277842999999, 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027584929999999999, 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 847 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285533+0000", 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3159999999999999e-06 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285544+0000", 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1253999999999999e-05 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285575+0000", 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0738999999999998e-05 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285589+0000", 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4343e-05 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285702+0000", 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112649 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285921+0000", 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021945499999999999 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.286238+0000", 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031702400000000001 2024-04-26T07:49:13.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.287549+0000", 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001310879 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288004+0000", 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045514399999999999 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288167+0000", 2024-04-26T07:49:13.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016323100000000001 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288289+0000", 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121459 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.298394291999998, 2024-04-26T07:49:13.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002936106, 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 849 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289416+0000", 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7129999999999999e-06 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289425+0000", 2024-04-26T07:49:13.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6369999999999994e-06 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289450+0000", 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4433000000000001e-05 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289462+0000", 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1956999999999999e-05 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289591+0000", 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289827+0000", 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023558800000000001 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.290310+0000", 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048358899999999998 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.291493+0000", 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001182324 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292082+0000", 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058951499999999998 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292242+0000", 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159309 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292350+0000", 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108492 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.253788092999997, 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026241229999999999, 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 868 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334022+0000", 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8610000000000001e-06 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334031+0000", 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3759999999999997e-06 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334055+0000", 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3272999999999999e-05 2024-04-26T07:49:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334066+0000", 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1498000000000001e-05 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334185+0000", 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118355 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334409+0000", 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022421499999999999 2024-04-26T07:49:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334721+0000", 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031224699999999998 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336020+0000", 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012986829999999999 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336496+0000", 2024-04-26T07:49:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047615 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336578+0000", 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2452000000000003e-05 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336644+0000", 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6013000000000006e-05 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.160507357, 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032794199999999999, 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 907 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427303+0000", 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.446e-06 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427315+0000", 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1707e-05 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427348+0000", 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2642999999999999e-05 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427363+0000", 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5037e-05 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427519+0000", 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015594200000000001 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427915+0000", 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039595599999999999 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.428501+0000", 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058595900000000005 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.429998+0000", 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014978210000000001 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430311+0000", 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031217400000000002 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430468+0000", 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015785500000000001 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430580+0000", 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011188000000000001 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.156084323000002, 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002976916, 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 909 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431726+0000", 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8759999999999999e-06 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431735+0000", 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.577e-06 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431761+0000", 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5117e-05 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431773+0000", 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2526e-05 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431878+0000", 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010459300000000001 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432020+0000", 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014283899999999999 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432300+0000", 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279664 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.433338+0000", 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001038115 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434437+0000", 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001098878 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434590+0000", 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015255800000000001 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434701+0000", 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111173 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.063238751999997, 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026912619999999998, 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 949 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524572+0000", 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4870000000000001e-06 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524584+0000", 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.242e-05 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524615+0000", 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0156000000000001e-05 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524630+0000", 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5327000000000001e-05 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524785+0000", 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015463799999999999 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525023+0000", 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023835800000000001 2024-04-26T07:49:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525339+0000", 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031561799999999999 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.526523+0000", 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184367 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527111+0000", 2024-04-26T07:49:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058795500000000003 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527193+0000", 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2459000000000005e-05 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527261+0000", 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7477000000000005e-05 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.059607227999997, 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025643620000000002, 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 951 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528203+0000", 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5600000000000001e-06 2024-04-26T07:49:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528211+0000", 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8060000000000001e-06 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528236+0000", 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4933999999999999e-05 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528249+0000", 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2935999999999999e-05 2024-04-26T07:49:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528348+0000", 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8822999999999999e-05 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528473+0000", 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012490900000000001 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528743+0000", 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026996099999999999 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.529961+0000", 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012176299999999999 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530617+0000", 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065623799999999996 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530701+0000", 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4419000000000006e-05 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530765+0000", 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4146000000000006e-05 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.045309037999999, 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002689145, 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 955 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542501+0000", 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1639999999999999e-06 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542513+0000", 2024-04-26T07:49:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1456e-05 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542543+0000", 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0190000000000001e-05 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542558+0000", 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4866e-05 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542681+0000", 2024-04-26T07:49:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012343200000000001 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542905+0000", 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223155 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.543219+0000", 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031459800000000003 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.544603+0000", 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013838489999999999 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545039+0000", 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043600300000000002 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545124+0000", 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4999000000000004e-05 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545188+0000", 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4432999999999998e-05 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.041732377000002, 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026964580000000001, 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 957 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546078+0000", 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0700000000000001e-06 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546088+0000", 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0067e-05 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546118+0000", 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0429999999999998e-05 2024-04-26T07:49:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546136+0000", 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7520000000000002e-05 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546252+0000", 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115945 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546400+0000", 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014764199999999999 2024-04-26T07:49:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546672+0000", 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027279099999999998 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.547902+0000", 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001230014 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548616+0000", 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071360399999999995 2024-04-26T07:49:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548707+0000", 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1372999999999994e-05 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548772+0000", 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5001999999999999e-05 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:13.733 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:13.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:13.736 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:13.731+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:13.835 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:13.833+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:13.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:13.936 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:13.933+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:13.950 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:13.950 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:13.950 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:13.950 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:13.968 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:14.038 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:14.035+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:14.046 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:14.046 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:14.077 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:14.108 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:14.109 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:14.122 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:14.122 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:14.122 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:14.123 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:14.123 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:14.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:14.138 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:14.135+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:14.139 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:14.139 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:14.172 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:14.172 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:14.205 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:14.205 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:14.239 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:14.239 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:14.239 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:14.237+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:14.248 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:14.248 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:14.262 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:14.271 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:14.340 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:14.337+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:14.397 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:14.397 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:14.413 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:14.460 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:14.459+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:14.534 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:14.535 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:14.541 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:14.537+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:14.548 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:14.642 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:14.641+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:14.720 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:14.720 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:14.734 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:14.779 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:14.779+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:14.844 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:14.841+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:14.857 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:14.857 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:14.871 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:14.960 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:14.959+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:15.039 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:15.039 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:15.045 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:15.043+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:15.054 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:15.147 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:15.143+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:15.216 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:15.216 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:15.230 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:15.248 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:15.245+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:15.349 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:15.345+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:15.391 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:15.391 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:15.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:15.450 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:15.449+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:15.529 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:15.529 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:15.544 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:15.591 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:15.591+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:15.652 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:15.651+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:15.658 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:15.658 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:15.671 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:15.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:49:15.786 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:15.785+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:15.839 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:15.839 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:15.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:15.854 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:15.853+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:15.955 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:15.953+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:15.977 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:15.977 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:15.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:16.055 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:16.055+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:16.110 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:16.110 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:16.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:16.170 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:16.169+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:16.256 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:16.253+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:16.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:16.296 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:16.296 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:16.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:16.358 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:16.357+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:16.458 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:16.455+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:16.496 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:16.496 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:16.527 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:16.529 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:16.530 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:16.530 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:16.530 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:16.530 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:16.530 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:16.548 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:16.557 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:16.557 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:16.558 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:16.557+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:16.588 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:16.623 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:16.659 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:16.660 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:16.660 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:16.659+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:16.693 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:16.693 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.077366130000001, 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.695 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.089459032999997, 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.701 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:49:16.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:49:16.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:16.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:16.706 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.070097386999997, 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.039968956000003, 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.712 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:16.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.018550859999998, 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:49:16.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:49:16.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:49:16.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:49:16.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:16.723 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.988551491000003, 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:49:16.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:49:16.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.969952237999998, 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.729 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.734 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.95196945, 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.920145056000003, 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.740 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:16.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:49:16.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.745 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.868290641000002, 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:49:16.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:49:16.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:49:16.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.859455335, 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.751 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:49:16.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.810442018000003, 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:49:16.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:49:16.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:16.762 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.756020116999998, 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:49:16.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:49:16.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:49:16.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.552290855999999, 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.768 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:49:16.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:49:16.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.548393705000002, 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.774 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:49:16.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.779 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.494349524999997, 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:49:16.784 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.490223364999999, 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.785 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:16.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.790 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.310029241000002, 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:49:16.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:49:16.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:49:16.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.796 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.306380120999997, 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:49:16.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:16.802 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.941742018999999, 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031879370000000001, 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1020 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:16.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751976+0000", 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6330000000000001e-06 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751983+0000", 2024-04-26T07:49:16.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7070000000000003e-06 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752000+0000", 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7169000000000001e-05 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752011+0000", 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.099e-05 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752123+0000", 2024-04-26T07:49:16.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112154 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752277+0000", 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015411299999999999 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752536+0000", 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025889199999999999 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.753314+0000", 2024-04-26T07:49:16.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077766900000000004 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755045+0000", 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001731376 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755117+0000", 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1963000000000002e-05 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755163+0000", 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5271000000000001e-05 2024-04-26T07:49:16.807 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.808 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.808 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.808 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:16.808 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:16.808 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:16.809 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:16.810 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:16.811 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:16.807+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:16.900 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:49:16.909 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:16.909+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:16.983 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:16.983 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:16.983 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:16.983 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:16.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:17.041 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:17.041+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:17.109 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:17.109 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:17.109 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:17.109 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:17.109 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:17.111 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:17.109+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:17.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:17.212 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:17.211+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:17.294 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:17.294 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:17.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:17.294 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.732719836000001, 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089363580000000001, 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2 2024-04-26T07:49:17.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559516+0000", 2024-04-26T07:49:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3180000000000001e-06 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559526+0000", 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8190000000000003e-06 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559547+0000", 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1675000000000002e-05 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559563+0000", 2024-04-26T07:49:17.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5582000000000001e-05 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561240+0000", 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676978 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561260+0000", 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0590000000000001e-05 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568285+0000", 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070247670000000003 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568450+0000", 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016462900000000001 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.682091210999999, 2024-04-26T07:49:17.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030230650000000001, 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 38 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610144+0000", 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.517e-06 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610152+0000", 2024-04-26T07:49:17.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5820000000000002e-06 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610171+0000", 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8621e-05 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610180+0000", 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9029999999999993e-06 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610293+0000", 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113552 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610492+0000", 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000199008 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610724+0000", 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023223499999999999 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.611841+0000", 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011162769999999999 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613006+0000", 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001165475 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613098+0000", 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1608999999999997e-05 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613165+0000", 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7286000000000006e-05 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:50 7.15 e26/25 7:a93a5511:::notify.2:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.694759101999999, 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029468020000000001, 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.305 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597475+0000", 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2600000000000002e-07 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597485+0000", 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8600000000000005e-06 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597524+0000", 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9156999999999998e-05 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597545+0000", 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1625999999999999e-05 2024-04-26T07:49:17.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597750+0000", 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020436900000000001 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597798+0000", 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7732999999999999e-05 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600300+0000", 2024-04-26T07:49:17.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025022859999999998 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600421+0000", 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121045 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.581484680000003, 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030667120000000001, 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.309 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 193 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710751+0000", 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2529999999999999e-06 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710763+0000", 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.225e-05 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710795+0000", 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2286999999999998e-05 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710810+0000", 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5102999999999999e-05 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710951+0000", 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014038899999999999 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711181+0000", 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022999199999999999 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711433+0000", 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025236200000000001 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.712618+0000", 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184596 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713695+0000", 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001076975 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713765+0000", 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0396999999999997e-05 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713815+0000", 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0108000000000002e-05 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.314 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.679216912999998, 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044673070000000002, 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 208 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.315 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613019+0000", 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:49:17.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613032+0000", 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3390000000000001e-05 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613059+0000", 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6369000000000001e-05 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613073+0000", 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613182+0000", 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108902 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613370+0000", 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018796899999999999 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613779+0000", 2024-04-26T07:49:17.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040870700000000002 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.614995+0000", 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012161030000000001 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617272+0000", 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022775450000000002 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617365+0000", 2024-04-26T07:49:17.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2866000000000002e-05 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617484+0000", 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011849900000000001 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.660842666000001, 2024-04-26T07:49:17.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033767699999999999, 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 212 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631393+0000", 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631403+0000", 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0757000000000001e-05 2024-04-26T07:49:17.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631434+0000", 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0685999999999997e-05 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631452+0000", 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8289999999999999e-05 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631578+0000", 2024-04-26T07:49:17.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012580499999999999 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631799+0000", 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221072 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.632219+0000", 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041983999999999999 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.633745+0000", 2024-04-26T07:49:17.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015256410000000001 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634566+0000", 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000821234 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634652+0000", 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5521999999999999e-05 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634767+0000", 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115763 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.634897363999997, 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.326 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.609891183000002, 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037018250000000002, 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 224 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.332 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682344+0000", 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3199999999999998e-06 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682358+0000", 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3223e-05 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682389+0000", 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1819000000000001e-05 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682404+0000", 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4773000000000001e-05 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682559+0000", 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015474900000000001 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682925+0000", 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000365724 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.683728+0000", 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000803096 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685343+0000", 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016147939999999999 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685828+0000", 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048552900000000001 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685924+0000", 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5488999999999993e-05 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.686044+0000", 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120309 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.575351910999998, 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031929739999999999, 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.337 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 233 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:17.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716884+0000", 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5799999999999999e-06 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716896+0000", 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2013e-05 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716928+0000", 2024-04-26T07:49:17.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1739000000000002e-05 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716942+0000", 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4367e-05 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717058+0000", 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116239 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717283+0000", 2024-04-26T07:49:17.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022485499999999999 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717719+0000", 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043577999999999998 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719168+0000", 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449021 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719862+0000", 2024-04-26T07:49:17.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069427499999999995 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719954+0000", 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1939000000000002e-05 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.720074+0000", 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120166 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:320 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.545546311999999, 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041265579999999998, 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 320 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746689+0000", 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.75e-06 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746697+0000", 2024-04-26T07:49:17.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4770000000000003e-06 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746719+0000", 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1543e-05 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746730+0000", 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1041e-05 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746802+0000", 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.237e-05 2024-04-26T07:49:17.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746936+0000", 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013430000000000001 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747126+0000", 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018941100000000001 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747902+0000", 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077641500000000003 2024-04-26T07:49:17.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750700+0000", 2024-04-26T07:49:17.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002797875 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750759+0000", 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8622999999999998e-05 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750813+0000", 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4753000000000002e-05 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:392 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.527863557000003, 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003372562, 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 392 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764371+0000", 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0699999999999999e-06 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764376+0000", 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4530000000000001e-06 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764391+0000", 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764398+0000", 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6650000000000003e-06 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764458+0000", 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9580000000000002e-05 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764518+0000", 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9833000000000001e-05 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764632+0000", 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114765 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.765112+0000", 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047932900000000002 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767688+0000", 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002576339 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767719+0000", 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1307999999999999e-05 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767742+0000", 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2892999999999999e-05 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:481 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.478874904999998, 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029129989999999999, 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 481 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813359+0000", 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2399999999999997e-07 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813363+0000", 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7699999999999999e-06 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813373+0000", 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0564000000000001e-05 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813378+0000", 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9869999999999999e-06 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813431+0000", 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2601e-05 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813486+0000", 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5525000000000001e-05 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813616+0000", 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129195 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.814126+0000", 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051048 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816215+0000", 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020892279999999998 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816247+0000", 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1523000000000003e-05 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816271+0000", 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4402000000000001e-05 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.361 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.278505729000003, 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030638950000000001, 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 733 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013730+0000", 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.723e-06 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013742+0000", 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2099999999999999e-05 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013774+0000", 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1686000000000001e-05 2024-04-26T07:49:17.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013791+0000", 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7433000000000001e-05 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013903+0000", 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111562 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014125+0000", 2024-04-26T07:49:17.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221962 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014446+0000", 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032154800000000001 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.015730+0000", 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012836189999999999 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016636+0000", 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090594600000000003 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016725+0000", 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8945999999999998e-05 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016791+0000", 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6370000000000003e-05 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.129414202, 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031006810000000001, 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 796 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162821+0000", 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2000000000000001e-06 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162832+0000", 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1123e-05 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162863+0000", 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1053000000000002e-05 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162878+0000", 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4627000000000001e-05 2024-04-26T07:49:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163055+0000", 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017737800000000001 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163271+0000", 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021579100000000001 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163582+0000", 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031048799999999999 2024-04-26T07:49:17.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.164646+0000", 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064391 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165770+0000", 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001123895 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165858+0000", 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7604999999999999e-05 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165920+0000", 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2130000000000003e-05 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.125341399, 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030619419999999998, 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.373 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 798 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166894+0000", 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0669999999999999e-06 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166905+0000", 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0689999999999999e-05 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166931+0000", 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5982e-05 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166943+0000", 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2269999999999999e-05 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167088+0000", 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144983 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167220+0000", 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000131989 2024-04-26T07:49:17.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167484+0000", 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026388399999999998 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.168382+0000", 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089864600000000002 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169799+0000", 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014165250000000001 2024-04-26T07:49:17.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169885+0000", 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6629e-05 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169954+0000", 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8276999999999997e-05 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.107071134000002, 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029491159999999999, 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 805 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185164+0000", 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2800000000000002e-06 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185176+0000", 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1576000000000001e-05 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185207+0000", 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0657000000000001e-05 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185224+0000", 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6943e-05 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185347+0000", 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012364200000000001 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185557+0000", 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000209385 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185867+0000", 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031047799999999999 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.186792+0000", 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092501900000000001 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.187956+0000", 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011643210000000001 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188043+0000", 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6621999999999998e-05 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188111+0000", 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8193000000000003e-05 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.038575538000003, 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002965442, 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.384 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 834 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253659+0000", 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.813e-06 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253669+0000", 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5529999999999998e-06 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253695+0000", 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5542999999999999e-05 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253707+0000", 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2320000000000001e-05 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253850+0000", 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143356 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253974+0000", 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012351899999999999 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.254248+0000", 2024-04-26T07:49:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000274104 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.255127+0000", 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00087949999999999996 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256473+0000", 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013458890000000001 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256560+0000", 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7206000000000005e-05 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256623+0000", 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2638999999999994e-05 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.880237929000003, 2024-04-26T07:49:17.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034075350000000002, 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 901 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:17.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411998+0000", 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412011+0000", 2024-04-26T07:49:17.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2873e-05 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412042+0000", 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1168999999999999e-05 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412058+0000", 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5480000000000001e-05 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412219+0000", 2024-04-26T07:49:17.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016089899999999999 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412592+0000", 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037354 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.413172+0000", 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00057962499999999995 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.414322+0000", 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001149705 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415207+0000", 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088520199999999997 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415294+0000", 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6860000000000005e-05 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415403+0000", 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010914200000000001 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.875519758000003, 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033765959999999999, 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.395 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 903 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416716+0000", 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.08e-06 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416729+0000", 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.378e-05 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416762+0000", 2024-04-26T07:49:17.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3173000000000002e-05 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416777+0000", 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4873e-05 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416907+0000", 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417143+0000", 2024-04-26T07:49:17.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023651499999999999 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417631+0000", 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048777599999999999 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.418763+0000", 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011318599999999999 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419805+0000", 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001041742 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419970+0000", 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016569499999999999 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.420090+0000", 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119553 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:17.400 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.774969646000002, 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003600907, 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 946 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517266+0000", 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2730000000000001e-06 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517278+0000", 2024-04-26T07:49:17.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1987000000000001e-05 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517310+0000", 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1843e-05 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517325+0000", 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5197e-05 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517439+0000", 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113785 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517663+0000", 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022453499999999999 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517999+0000", 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033559099999999999 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.519130+0000", 2024-04-26T07:49:17.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001131544 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520581+0000", 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014505950000000001 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520744+0000", 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016345199999999999 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520864+0000", 2024-04-26T07:49:17.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120105 2024-04-26T07:49:17.406 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.406 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.406 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.406 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.406 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.406 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:17.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:17.408 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:17.405+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:17.510 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:17.509+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:17.566 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:17.566 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:17.566 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:17.566 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:17.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:17.622 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:17.621+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:17.712 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:17.709+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:17.734 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:17.734 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:17.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:17.837 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:17.837+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:17.914 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:17.913+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:17.915 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:17.915 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:17.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:17.915 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.294072235000002, 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026678100000000001, 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 42 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620179+0000", 2024-04-26T07:49:17.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2400000000000002e-06 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620193+0000", 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3886000000000001e-05 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620222+0000", 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8736000000000001e-05 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620243+0000", 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0832e-05 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620365+0000", 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012243700000000001 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620549+0000", 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018372899999999999 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620684+0000", 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135723 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.621541+0000", 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085632299999999998 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622750+0000", 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001209168 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622801+0000", 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0991e-05 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622845+0000", 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3745000000000002e-05 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.921 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.312525123, 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0056514750000000004, 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 52 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601727+0000", 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.163e-06 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601761+0000", 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3847999999999998e-05 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602013+0000", 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025215399999999998 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602102+0000", 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9066000000000004e-05 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602273+0000", 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000171182 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602651+0000", 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037720000000000001 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602995+0000", 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000344247 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.604820+0000", 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018254160000000001 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607233+0000", 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024128230000000001 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607309+0000", 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6224999999999996e-05 2024-04-26T07:49:17.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607376+0000", 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6150999999999997e-05 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.186921085999998, 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031921969999999999, 2024-04-26T07:49:17.927 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 236 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727332+0000", 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4869999999999998e-06 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727346+0000", 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4836e-05 2024-04-26T07:49:17.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727380+0000", 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3692999999999997e-05 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727400+0000", 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9979999999999998e-05 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727531+0000", 2024-04-26T07:49:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130949 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727788+0000", 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025688499999999999 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.728200+0000", 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041179900000000002 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.729730+0000", 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001530572 2024-04-26T07:49:17.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730356+0000", 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062611800000000005 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730446+0000", 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9319000000000003e-05 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730520+0000", 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4559000000000002e-05 2024-04-26T07:49:17.932 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.173381274999997, 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028999310000000001, 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.933 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 283 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740869+0000", 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.155e-06 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740884+0000", 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.543e-05 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740899+0000", 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4533e-05 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740905+0000", 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4010000000000002e-06 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740970+0000", 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4888000000000006e-05 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741087+0000", 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116388 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741223+0000", 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013601800000000001 2024-04-26T07:49:17.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741950+0000", 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072763400000000001 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743680+0000", 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017300309999999999 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743719+0000", 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8732000000000001e-05 2024-04-26T07:49:17.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743768+0000", 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8721000000000003e-05 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.877047122999997, 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028979790000000002, 2024-04-26T07:49:17.938 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 742 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:17.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037205+0000", 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.683e-06 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037217+0000", 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2347000000000001e-05 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037249+0000", 2024-04-26T07:49:17.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1652999999999997e-05 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037264+0000", 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5053e-05 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037398+0000", 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134449 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037637+0000", 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000238388 2024-04-26T07:49:17.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037984+0000", 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000347401 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039386+0000", 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001402375 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039941+0000", 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00055470499999999996 2024-04-26T07:49:17.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040031+0000", 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9870000000000005e-05 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040100+0000", 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9054999999999995e-05 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.943 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.836398787, 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026953580000000001, 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 760 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:17.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077853+0000", 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2199999999999999e-06 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077864+0000", 2024-04-26T07:49:17.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.136e-05 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077895+0000", 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1380000000000001e-05 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077910+0000", 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4683e-05 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078033+0000", 2024-04-26T07:49:17.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012319499999999999 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078253+0000", 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021987499999999999 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078568+0000", 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031487099999999999 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.079737+0000", 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001169364 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080396+0000", 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065863100000000002 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080482+0000", 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5673000000000005e-05 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080546+0000", 2024-04-26T07:49:17.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4105999999999999e-05 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.832718976999999, 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026454019999999998, 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.949 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 762 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081532+0000", 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081560+0000", 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8153e-05 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081592+0000", 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1757000000000001e-05 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081611+0000", 2024-04-26T07:49:17.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8626000000000001e-05 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081721+0000", 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110296 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081849+0000", 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012843199999999999 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:17.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.082121+0000", 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027200800000000002 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.083234+0000", 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011123769999999999 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084026+0000", 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079225400000000005 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084109+0000", 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2641999999999999e-05 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084176+0000", 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7037000000000002e-05 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.954 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.699056007999999, 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026859850000000001, 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 817 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215197+0000", 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.444e-06 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215210+0000", 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3016e-05 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215241+0000", 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1050000000000003e-05 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215256+0000", 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5293000000000001e-05 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215390+0000", 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013440199999999999 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215620+0000", 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022916200000000001 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215891+0000", 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027189100000000002 2024-04-26T07:49:17.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217059+0000", 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011680670000000001 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217578+0000", 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051814600000000004 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217748+0000", 2024-04-26T07:49:17.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017023200000000001 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217879+0000", 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013128200000000001 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.695241844999998, 2024-04-26T07:49:17.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030863079999999998, 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 819 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219009+0000", 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6300000000000001e-06 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219018+0000", 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7830000000000004e-06 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219043+0000", 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4902999999999999e-05 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219055+0000", 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2733e-05 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219187+0000", 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013202600000000001 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219416+0000", 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000228595 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219921+0000", 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00050526200000000003 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221111+0000", 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001189264 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221824+0000", 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071316700000000001 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221979+0000", 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015522600000000001 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.222094+0000", 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114719 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.643375581000001, 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033639400000000002, 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 841 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.966 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270876+0000", 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5239999999999999e-06 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270888+0000", 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.239e-05 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270919+0000", 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0386e-05 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270937+0000", 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8023e-05 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271091+0000", 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153802 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271447+0000", 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035622099999999999 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.272032+0000", 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058492799999999997 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273324+0000", 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012923559999999999 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273958+0000", 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063414899999999998 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274114+0000", 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015607800000000001 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274238+0000", 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012308299999999999 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.638810831000001, 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031880070000000001, 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 843 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275441+0000", 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2129999999999998e-06 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275451+0000", 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0727000000000001e-05 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275483+0000", 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2011999999999998e-05 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275504+0000", 2024-04-26T07:49:17.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0267000000000001e-05 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275646+0000", 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014206900000000001 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275879+0000", 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000233315 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:17.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.276359+0000", 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048021899999999999 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.277529+0000", 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011702609999999999 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278354+0000", 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00082486600000000005 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278506+0000", 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015169599999999999 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278626+0000", 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120362 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.628718706000001, 2024-04-26T07:49:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027584929999999999, 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 847 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285533+0000", 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3159999999999999e-06 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285544+0000", 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1253999999999999e-05 2024-04-26T07:49:17.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285575+0000", 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0738999999999998e-05 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285589+0000", 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4343e-05 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285702+0000", 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112649 2024-04-26T07:49:17.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285921+0000", 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021945499999999999 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.286238+0000", 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031702400000000001 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.287549+0000", 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001310879 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288004+0000", 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045514399999999999 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288167+0000", 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016323100000000001 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288289+0000", 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121459 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.981 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.624835155, 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002936106, 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.982 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 849 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289416+0000", 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7129999999999999e-06 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289425+0000", 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6369999999999994e-06 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289450+0000", 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4433000000000001e-05 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289462+0000", 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1956999999999999e-05 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289591+0000", 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289827+0000", 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023558800000000001 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:17.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.290310+0000", 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048358899999999998 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.291493+0000", 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001182324 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292082+0000", 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058951499999999998 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292242+0000", 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159309 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292350+0000", 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108492 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.580228955999999, 2024-04-26T07:49:17.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026241229999999999, 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 868 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334022+0000", 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8610000000000001e-06 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334031+0000", 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3759999999999997e-06 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334055+0000", 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3272999999999999e-05 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334066+0000", 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1498000000000001e-05 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334185+0000", 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118355 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334409+0000", 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022421499999999999 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334721+0000", 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031224699999999998 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336020+0000", 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012986829999999999 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336496+0000", 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047615 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336578+0000", 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2452000000000003e-05 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336644+0000", 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6013000000000006e-05 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.992 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.486948220000002, 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032794199999999999, 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.993 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 907 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427303+0000", 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.446e-06 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427315+0000", 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1707e-05 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427348+0000", 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2642999999999999e-05 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427363+0000", 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5037e-05 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427519+0000", 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015594200000000001 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427915+0000", 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039595599999999999 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.428501+0000", 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058595900000000005 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.429998+0000", 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014978210000000001 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430311+0000", 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031217400000000002 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430468+0000", 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015785500000000001 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430580+0000", 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011188000000000001 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:17.998 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.482525185999997, 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002976916, 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 909 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:17.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431726+0000", 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8759999999999999e-06 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431735+0000", 2024-04-26T07:49:18.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.577e-06 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431761+0000", 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5117e-05 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431773+0000", 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2526e-05 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431878+0000", 2024-04-26T07:49:18.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010459300000000001 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432020+0000", 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014283899999999999 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432300+0000", 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279664 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.433338+0000", 2024-04-26T07:49:18.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001038115 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434437+0000", 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001098878 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434590+0000", 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015255800000000001 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434701+0000", 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111173 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.389679614999999, 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026912619999999998, 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 949 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524572+0000", 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4870000000000001e-06 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524584+0000", 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.242e-05 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524615+0000", 2024-04-26T07:49:18.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0156000000000001e-05 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524630+0000", 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5327000000000001e-05 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524785+0000", 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015463799999999999 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525023+0000", 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023835800000000001 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525339+0000", 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031561799999999999 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.526523+0000", 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184367 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527111+0000", 2024-04-26T07:49:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058795500000000003 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527193+0000", 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2459000000000005e-05 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527261+0000", 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7477000000000005e-05 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.386048090999999, 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025643620000000002, 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 951 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528203+0000", 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5600000000000001e-06 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528211+0000", 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8060000000000001e-06 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528236+0000", 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4933999999999999e-05 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528249+0000", 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2935999999999999e-05 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528348+0000", 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8822999999999999e-05 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528473+0000", 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012490900000000001 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528743+0000", 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026996099999999999 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.529961+0000", 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012176299999999999 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530617+0000", 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065623799999999996 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530701+0000", 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4419000000000006e-05 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530765+0000", 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4146000000000006e-05 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.371749901000001, 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002689145, 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.015 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 955 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542501+0000", 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1639999999999999e-06 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542513+0000", 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1456e-05 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542543+0000", 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0190000000000001e-05 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542558+0000", 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4866e-05 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542681+0000", 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012343200000000001 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542905+0000", 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223155 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.543219+0000", 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031459800000000003 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.544603+0000", 2024-04-26T07:49:18.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013838489999999999 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545039+0000", 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043600300000000002 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545124+0000", 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4999000000000004e-05 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545188+0000", 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4432999999999998e-05 2024-04-26T07:49:18.020 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.368173239999997, 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026964580000000001, 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 957 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546078+0000", 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0700000000000001e-06 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546088+0000", 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0067e-05 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546118+0000", 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0429999999999998e-05 2024-04-26T07:49:18.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546136+0000", 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7520000000000002e-05 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546252+0000", 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115945 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546400+0000", 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014764199999999999 2024-04-26T07:49:18.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546672+0000", 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027279099999999998 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.547902+0000", 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001230014 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548616+0000", 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071360399999999995 2024-04-26T07:49:18.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548707+0000", 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1372999999999994e-05 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548772+0000", 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5001999999999999e-05 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.026 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.027 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:18.028 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:18.028 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:18.027+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:18.129 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:18.125+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:18.230 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:18.229+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:18.237 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:18.237 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:18.237 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:18.238 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:18.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:18.342 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:18.341+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:18.431 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:18.431+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:18.465 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:18.466 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:18.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:18.532 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:18.531+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:18.633 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:18.631+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.091224930999999, 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012204097000000001, 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.663 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 44 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571159+0000", 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7500000000000001e-06 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571176+0000", 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7359000000000001e-05 2024-04-26T07:49:18.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571214+0000", 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7942999999999999e-05 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571240+0000", 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6084e-05 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571398+0000", 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015818000000000001 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571415+0000", 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6739e-05 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583000+0000", 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011585332 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583359+0000", 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035870999999999999 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.052079493999997, 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003073423, 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.668 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 56 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:18.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610304+0000", 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1540000000000002e-06 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610315+0000", 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1596e-05 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610348+0000", 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2379999999999998e-05 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610364+0000", 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6466000000000001e-05 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610544+0000", 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179963 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610849+0000", 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030534099999999999 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.611143+0000", 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029372300000000002 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.612446+0000", 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013032129999999999 2024-04-26T07:49:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613250+0000", 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080378299999999997 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613319+0000", 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8774000000000003e-05 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613374+0000", 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.503e-05 2024-04-26T07:49:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596391211392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.048835453000002, 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033841380000000001, 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.674 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 57 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613546+0000", 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7770000000000001e-06 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613554+0000", 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7789999999999996e-06 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613578+0000", 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4236999999999999e-05 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613592+0000", 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4106e-05 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613725+0000", 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013219999999999999 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613921+0000", 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019679800000000001 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.614275+0000", 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035357100000000001 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.615361+0000", 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010861880000000001 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616713+0000", 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013521900000000001 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616818+0000", 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010427 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616929+0000", 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111022 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.054198407999998, 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045711500000000004, 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 207 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608185+0000", 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2270000000000002e-06 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608199+0000", 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4049999999999999e-05 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608231+0000", 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608247+0000", 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6696000000000001e-05 2024-04-26T07:49:18.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608402+0000", 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015428499999999999 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608762+0000", 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036012099999999998 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.609476+0000", 2024-04-26T07:49:18.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071385399999999999 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612197+0000", 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027211480000000001 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612606+0000", 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040884 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612688+0000", 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1935999999999996e-05 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612753+0000", 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5075999999999998e-05 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.016164144000001, 2024-04-26T07:49:18.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003481442, 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 216 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646219+0000", 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8430000000000001e-06 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646232+0000", 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.358e-05 2024-04-26T07:49:18.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646268+0000", 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5846999999999997e-05 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646295+0000", 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6752999999999999e-05 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646431+0000", 2024-04-26T07:49:18.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013639500000000001 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646656+0000", 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022519900000000001 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.647143+0000", 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487009 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649075+0000", 2024-04-26T07:49:18.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019313640000000001 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649552+0000", 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000476959 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649634+0000", 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1877000000000002e-05 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649697+0000", 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3615999999999995e-05 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.968158670999998, 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036454130000000001, 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 227 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694224+0000", 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3099999999999999e-06 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694235+0000", 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1559999999999999e-05 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694267+0000", 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694282+0000", 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5150000000000001e-05 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694426+0000", 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144058 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694676+0000", 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024983500000000001 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.695121+0000", 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00044507299999999999 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.696591+0000", 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001469878 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697715+0000", 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011244009999999999 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697800+0000", 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4722000000000006e-05 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697867+0000", 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6508999999999996e-05 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.696 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.960722519000001, 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032415780000000002, 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 229 2024-04-26T07:49:18.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701660+0000", 2024-04-26T07:49:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.244e-06 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701671+0000", 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1326e-05 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701703+0000", 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2023999999999997e-05 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701718+0000", 2024-04-26T07:49:18.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5133000000000001e-05 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701833+0000", 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114916 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702050+0000", 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216624 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702472+0000", 2024-04-26T07:49:18.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042268699999999999 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.703941+0000", 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001468128 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704755+0000", 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000814637 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704833+0000", 2024-04-26T07:49:18.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8226000000000006e-05 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704899+0000", 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5633e-05 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.953722900999999, 2024-04-26T07:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003426648, 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 231 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708659+0000", 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2630000000000002e-06 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708671+0000", 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1379999999999999e-05 2024-04-26T07:49:18.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708702+0000", 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1761999999999998e-05 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708719+0000", 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6954000000000001e-05 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708844+0000", 2024-04-26T07:49:18.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012488199999999999 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709085+0000", 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000240905 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709507+0000", 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042178700000000002 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711076+0000", 2024-04-26T07:49:18.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015689530000000001 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711928+0000", 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085241699999999995 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712016+0000", 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7219000000000006e-05 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712084+0000", 2024-04-26T07:49:18.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8126000000000005e-05 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.655233283000001, 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029394930000000001, 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 730 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007149+0000", 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2500000000000001e-06 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007160+0000", 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1516e-05 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007192+0000", 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1362999999999998e-05 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007207+0000", 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5114e-05 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007316+0000", 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109252 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007539+0000", 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022263200000000001 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007886+0000", 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034704000000000001 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009051+0000", 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001164881 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009882+0000", 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083153899999999995 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009971+0000", 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9183000000000003e-05 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.010086+0000", 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011472300000000001 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.713 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.641624557999997, 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028721110000000001, 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.714 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 736 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020758+0000", 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.187e-06 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020769+0000", 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1263e-05 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020800+0000", 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.129e-05 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020815+0000", 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4737e-05 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020938+0000", 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012298499999999999 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.021157+0000", 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021933799999999999 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.021474+0000", 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031639199999999998 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.022654+0000", 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00118045 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023470+0000", 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081556700000000001 2024-04-26T07:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023556+0000", 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6612000000000004e-05 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023628+0000", 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1290000000000004e-05 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.719 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.637745909000003, 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051848809999999997, 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 738 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024636+0000", 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0999999999999998e-06 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024647+0000", 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1270000000000001e-05 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024679+0000", 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1069999999999999e-05 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024698+0000", 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9887000000000001e-05 2024-04-26T07:49:18.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024806+0000", 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010731899999999999 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024938+0000", 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013236899999999999 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.025208+0000", 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027009700000000001 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.026465+0000", 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012567800000000001 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029663+0000", 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003197667 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029751+0000", 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8578999999999993e-05 2024-04-26T07:49:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029819+0000", 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7743000000000005e-05 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.541650834000002, 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003055978, 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.725 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 778 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120731+0000", 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2869999999999999e-06 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120743+0000", 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1656e-05 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120774+0000", 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1309999999999997e-05 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120790+0000", 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5187e-05 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120910+0000", 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119979 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121125+0000", 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000215324 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121440+0000", 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031488499999999999 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.122682+0000", 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001242033 2024-04-26T07:49:18.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123599+0000", 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00091723900000000003 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123718+0000", 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119306 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123785+0000", 2024-04-26T07:49:18.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6772000000000004e-05 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.484054258999997, 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030101080000000001, 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.731 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 802 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178328+0000", 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5830000000000001e-06 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178340+0000", 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1347e-05 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178371+0000", 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1303000000000002e-05 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178386+0000", 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5043e-05 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178500+0000", 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114339 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178722+0000", 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022198199999999999 2024-04-26T07:49:18.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.179047+0000", 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000324667 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.180162+0000", 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001114711 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181123+0000", 2024-04-26T07:49:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00096165200000000001 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181220+0000", 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7139000000000006e-05 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181336+0000", 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011534199999999999 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.398469462000001, 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029079560000000002, 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 838 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263913+0000", 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9929999999999998e-06 2024-04-26T07:49:18.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263925+0000", 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.269e-05 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263953+0000", 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7900000000000001e-05 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263967+0000", 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.438e-05 2024-04-26T07:49:18.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264085+0000", 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117982 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264310+0000", 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022483099999999999 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264674+0000", 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036400700000000001 2024-04-26T07:49:18.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.265887+0000", 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00121247 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266611+0000", 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072435100000000003 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266700+0000", 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412999999999995e-05 2024-04-26T07:49:18.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266818+0000", 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011893899999999999 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.369829191999997, 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029764090000000002, 2024-04-26T07:49:18.742 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 850 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292553+0000", 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4399999999999999e-06 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292565+0000", 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.154e-05 2024-04-26T07:49:18.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292595+0000", 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0433000000000002e-05 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292613+0000", 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7759999999999999e-05 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292738+0000", 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012527600000000001 2024-04-26T07:49:18.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292948+0000", 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020985099999999999 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.293260+0000", 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031240100000000002 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.294440+0000", 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00117979 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295370+0000", 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092946599999999999 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295460+0000", 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0529e-05 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295527+0000", 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6922999999999996e-05 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.365832601000001, 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029089200000000002, 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.748 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 852 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296550+0000", 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.39e-06 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296563+0000", 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2763e-05 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296593+0000", 2024-04-26T07:49:18.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0929999999999997e-05 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296611+0000", 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7453e-05 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296715+0000", 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000104522 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296846+0000", 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130066 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.297118+0000", 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027257399999999998 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.298189+0000", 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001071242 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299293+0000", 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001103845 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299388+0000", 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4462000000000005e-05 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299456+0000", 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8672999999999998e-05 2024-04-26T07:49:18.753 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.318357159999998, 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003029908, 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.754 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 873 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344025+0000", 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6959999999999999e-06 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344036+0000", 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1226999999999999e-05 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344061+0000", 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5309000000000001e-05 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344080+0000", 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8853000000000001e-05 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344227+0000", 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014731600000000001 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344358+0000", 2024-04-26T07:49:18.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013102900000000001 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344646+0000", 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000287965 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.345790+0000", 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001143926 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346903+0000", 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011127610000000001 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346987+0000", 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4350000000000004e-05 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.347053+0000", 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5475999999999994e-05 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.759 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.173591387999998, 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031214210000000001, 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.760 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 934 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488791+0000", 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6199999999999999e-06 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488806+0000", 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4963000000000001e-05 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488840+0000", 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3793e-05 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488862+0000", 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2325999999999999e-05 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488994+0000", 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013211899999999999 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489218+0000", 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223482 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489533+0000", 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031546100000000001 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.490516+0000", 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00098278499999999991 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491625+0000", 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001108904 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491793+0000", 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167873 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491910+0000", 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117095 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:936 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:18.765 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.169526607999998, 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002857437, 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 936 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:18.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492855+0000", 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492868+0000", 2024-04-26T07:49:18.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2413e-05 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492898+0000", 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.044e-05 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492915+0000", 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7414e-05 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493014+0000", 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8992000000000004e-05 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493159+0000", 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144046 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493437+0000", 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027894999999999998 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.494751+0000", 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013136669999999999 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495553+0000", 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000802339 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495648+0000", 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4265999999999995e-05 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495711+0000", 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3089999999999994e-05 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.166437299999998, 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030389750000000002, 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:18.771 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 937 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:18.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495945+0000", 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.84e-06 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495955+0000", 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0787e-05 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495986+0000", 2024-04-26T07:49:18.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1093000000000002e-05 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496005+0000", 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8236e-05 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496127+0000", 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000122069 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:18.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496372+0000", 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024480200000000002 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496723+0000", 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000351357 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.497773+0000", 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001050411 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498698+0000", 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092447199999999997 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498861+0000", 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016297600000000001 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498982+0000", 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120932 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.776 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.777 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:18.777 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:18.777 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:18.778 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:18.779 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:18.775+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:18.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:18.879 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:18.877+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:18.908 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:18.909 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:18.909 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:18.909 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:18.923 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:18.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:49:18.980 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:18.977+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:18.995 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:19.026 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:19.026 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:19.044 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:19.044 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:19.055 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:19.059 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:19.087 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:19.087 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:19.104 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:19.103+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:19.104 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:19.104 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:19.121 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:19.121 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:19.143 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:19.144 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:19.169 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:19.181 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:19.181 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:19.182 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:19.181+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:19.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:19.284 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:19.283+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:19.363 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:19.363 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:19.377 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:19.420 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:19.419+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:19.485 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:19.483+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:19.545 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:19.545 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:19.560 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:19.604 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:19.603+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:19.687 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:19.683+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:19.729 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:19.729 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:19.743 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:19.788 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:19.785+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:19.889 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:19.887+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:19.909 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:19.910 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:19.924 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:19.990 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:19.989+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:20.019 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:49:20.091 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:20.089+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:20.092 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:20.092 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:20.107 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:20.192 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:20.191+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:20.228 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:20.229 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:20.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:20.293 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:20.289+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:20.394 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:20.391+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:20.407 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:20.407 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:20.421 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:20.494 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:20.493+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:20.587 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:20.587 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:20.595 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:20.595+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:20.602 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:20.696 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:20.693+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:20.768 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:20.768 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:20.782 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:20.827 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:20.825+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:20.898 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:20.897+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:20.953 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:20.953 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:20.970 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:20.999 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:20.995+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:21.100 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:21.099+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:21.185 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:21.185 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:21.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:21.201 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:21.199+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:21.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:21.301 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:21.299+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:21.340 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:21.340 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:21.358 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:21.358 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:21.374 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:21.374 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:21.403 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:21.399+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:21.404 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:21.404 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:21.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:21.404 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:21.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.404 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.786385344000003, 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033594160000000001, 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 60 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616351+0000", 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616354+0000", 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6689999999999999e-06 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616368+0000", 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3834e-05 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616402+0000", 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4374e-05 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616423+0000", 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0463e-05 2024-04-26T07:49:21.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616683+0000", 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025968399999999999 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616891+0000", 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020896200000000001 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.617093+0000", 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020192800000000001 2024-04-26T07:49:21.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.618682+0000", 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001588622 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619567+0000", 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088509500000000002 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619658+0000", 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0613999999999997e-05 2024-04-26T07:49:21.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.619710+0000", 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2170999999999999e-05 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.798478246999998, 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036576569999999999, 2024-04-26T07:49:21.410 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 206 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604258+0000", 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604261+0000", 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9670000000000001e-06 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604275+0000", 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4299e-05 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604311+0000", 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5822999999999999e-05 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604334+0000", 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3643e-05 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604551+0000", 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216725 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.604804+0000", 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025264200000000002 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.605291+0000", 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048759900000000002 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.606997+0000", 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017059969999999999 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607762+0000", 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000764287 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607848+0000", 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6372000000000006e-05 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.607915+0000", 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7303000000000003e-05 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.779116600999998, 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037312830000000002, 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 210 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.416 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623619+0000", 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623621+0000", 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.17e-06 2024-04-26T07:49:21.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623652+0000", 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0626000000000001e-05 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623684+0000", 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2227000000000002e-05 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623771+0000", 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6761999999999994e-05 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.623889+0000", 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117799 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624118+0000", 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022958500000000001 2024-04-26T07:49:21.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.624575+0000", 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045616299999999999 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.626553+0000", 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019780470000000001 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627208+0000", 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065578499999999998 2024-04-26T07:49:21.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627290+0000", 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1578999999999999e-05 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.627351+0000", 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.054e-05 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.748988169999997, 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033420799999999999, 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 218 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653748+0000", 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653750+0000", 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3970000000000001e-06 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653763+0000", 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2969999999999999e-05 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653792+0000", 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9006e-05 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653810+0000", 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8127000000000001e-05 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.653993+0000", 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018242099999999999 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654194+0000", 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020185900000000001 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.654670+0000", 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000475713 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656455+0000", 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017852250000000001 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.656943+0000", 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487756 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657029+0000", 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6209000000000001e-05 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657090+0000", 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0396999999999998e-05 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.727570073999999, 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033562660000000001, 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.427 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 222 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675166+0000", 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675168+0000", 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675180+0000", 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2047e-05 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675211+0000", 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0858999999999997e-05 2024-04-26T07:49:21.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675232+0000", 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1356999999999999e-05 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675395+0000", 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016215500000000001 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.675586+0000", 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019177500000000001 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.676113+0000", 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00052622900000000002 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.677601+0000", 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014887450000000001 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678377+0000", 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077597400000000002 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678461+0000", 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3505999999999996e-05 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.678522+0000", 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1255999999999998e-05 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.697570704999997, 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031931009999999998, 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 230 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705165+0000", 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705167+0000", 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-06 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705197+0000", 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9869000000000002e-05 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705231+0000", 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3673000000000001e-05 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705252+0000", 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1263e-05 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705367+0000", 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011446300000000001 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.705680+0000", 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000313488 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.706150+0000", 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046996899999999999 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.707600+0000", 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449835 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708208+0000", 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00060854500000000005 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708298+0000", 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9166000000000007e-05 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708358+0000", 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0686000000000001e-05 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.678971451999999, 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003327539, 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.438 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 235 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723764+0000", 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723767+0000", 2024-04-26T07:49:21.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3760000000000002e-06 2024-04-26T07:49:21.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723779+0000", 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2247e-05 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723810+0000", 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1059000000000002e-05 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.723826+0000", 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5656999999999999e-05 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724005+0000", 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017883499999999999 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724223+0000", 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021812200000000001 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.724630+0000", 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040747599999999999 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726230+0000", 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016001469999999999 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.726939+0000", 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00070894100000000004 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727030+0000", 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1086000000000002e-05 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727092+0000", 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1593000000000005e-05 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:286 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.445 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.660988664000001, 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026259930000000001, 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 286 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:21.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741747+0000", 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741749+0000", 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.638e-06 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741757+0000", 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3569999999999998e-06 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741776+0000", 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9038999999999998e-05 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741786+0000", 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5959999999999993e-06 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741948+0000", 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016250999999999999 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742036+0000", 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7423000000000006e-05 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.742409+0000", 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037309099999999998 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743302+0000", 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089340399999999999 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744240+0000", 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093760399999999998 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744273+0000", 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3232999999999998e-05 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.744373+0000", 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100098 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:407 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.629164269999997, 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026471760000000002, 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.451 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 407 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773572+0000", 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773576+0000", 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773591+0000", 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5302999999999999e-05 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773623+0000", 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2438999999999999e-05 2024-04-26T07:49:21.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773638+0000", 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.52e-05 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773723+0000", 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4641000000000005e-05 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.773925+0000", 2024-04-26T07:49:21.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020203300000000001 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774081+0000", 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015608199999999999 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.774704+0000", 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062264000000000004 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776074+0000", 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001370263 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776154+0000", 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9955000000000003e-05 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.776219+0000", 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4677000000000004e-05 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:504 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.577309855000003, 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037292779999999999, 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 504 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825426+0000", 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825427+0000", 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4900000000000005e-07 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825431+0000", 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4410000000000003e-06 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825442+0000", 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1017e-05 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825448+0000", 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5289999999999999e-06 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825515+0000", 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7586e-05 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825562+0000", 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6901999999999999e-05 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.825698+0000", 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013569100000000001 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.826258+0000", 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056041999999999995 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829095+0000", 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028365259999999998 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829127+0000", 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2422000000000002e-05 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.829155+0000", 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7895e-05 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:519 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.568474549000001, 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029444100000000002, 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.462 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 519 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834261+0000", 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834262+0000", 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.54e-07 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834266+0000", 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0559999999999998e-06 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834276+0000", 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0358e-05 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834281+0000", 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.921e-06 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834315+0000", 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3241999999999998e-05 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834362+0000", 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7784000000000002e-05 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834496+0000", 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013395700000000001 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.834908+0000", 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041137900000000002 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837100+0000", 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021918939999999998 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837160+0000", 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0334000000000002e-05 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.837206+0000", 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5731e-05 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:593 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.519461231999998, 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025057040000000001, 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 593 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883275+0000", 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883276+0000", 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.037e-06 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883280+0000", 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6550000000000003e-06 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883291+0000", 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0365e-05 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883296+0000", 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7219999999999996e-06 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883465+0000", 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168288 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883665+0000", 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019998499999999999 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.883886+0000", 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221709 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.884456+0000", 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056955199999999997 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885669+0000", 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012126109999999999 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885715+0000", 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6786000000000002e-05 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.885780+0000", 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4993999999999995e-05 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:682 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.465039331, 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031954090000000002, 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.473 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 682 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937697+0000", 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937698+0000", 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.796e-06 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937704+0000", 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.02e-06 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937719+0000", 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4450999999999999e-05 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937730+0000", 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1014e-05 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.937856+0000", 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125745 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938082+0000", 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022634 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.938405+0000", 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032353599999999997 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.939200+0000", 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079451399999999996 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940737+0000", 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015365979999999999 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940833+0000", 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6543e-05 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.940892+0000", 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8851999999999998e-05 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.26131007, 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00284126, 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 787 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141426+0000", 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141428+0000", 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5500000000000001e-06 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141441+0000", 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2218999999999999e-05 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141473+0000", 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2310000000000001e-05 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141489+0000", 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.641e-05 2024-04-26T07:49:21.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141613+0000", 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012340499999999999 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.141819+0000", 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000206689 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.142121+0000", 2024-04-26T07:49:21.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030182100000000002 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.143508+0000", 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001386728 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144119+0000", 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061134899999999996 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144203+0000", 2024-04-26T07:49:21.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4075999999999999e-05 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.144267+0000", 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3702999999999996e-05 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.257412918999997, 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00248438, 2024-04-26T07:49:21.484 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 789 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145323+0000", 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145325+0000", 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145337+0000", 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1953000000000001e-05 2024-04-26T07:49:21.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145368+0000", 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0830000000000001e-05 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145382+0000", 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.468e-05 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145511+0000", 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012859199999999999 2024-04-26T07:49:21.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145631+0000", 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012016 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.145921+0000", 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000290313 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147455+0000", 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533612 2024-04-26T07:49:21.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147668+0000", 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021323100000000001 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147747+0000", 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9122999999999994e-05 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.147807+0000", 2024-04-26T07:49:21.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0065999999999997e-05 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.203368738999998, 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030206859999999999, 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.490 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 811 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199367+0000", 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199369+0000", 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0930000000000001e-06 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199380+0000", 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.066e-05 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199411+0000", 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0793999999999997e-05 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199425+0000", 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4623e-05 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199578+0000", 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000152922 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.199801+0000", 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000222778 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.200131+0000", 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000329904 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.201384+0000", 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001253517 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202237+0000", 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000852613 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202325+0000", 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8449000000000006e-05 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.202388+0000", 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2333000000000001e-05 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.495 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.199242579, 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002781384, 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 813 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:21.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203493+0000", 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203495+0000", 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4139999999999999e-06 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203503+0000", 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6659999999999997e-06 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203527+0000", 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4094e-05 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203540+0000", 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.219e-05 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203694+0000", 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015443799999999999 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.203809+0000", 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114793 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.204098+0000", 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028924400000000002 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.205098+0000", 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001000038 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206123+0000", 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010251349999999999 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206213+0000", 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9859999999999997e-05 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.206275+0000", 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1512000000000003e-05 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.019048454999997, 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026918419999999998, 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.501 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 889 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383687+0000", 2024-04-26T07:49:21.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383690+0000", 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383703+0000", 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3210000000000001e-05 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383732+0000", 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383746+0000", 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.419e-05 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.383884+0000", 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013818899999999999 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384090+0000", 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020580199999999999 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.384384+0000", 2024-04-26T07:49:21.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029394399999999998 2024-04-26T07:49:21.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.385836+0000", 2024-04-26T07:49:21.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014521409999999999 2024-04-26T07:49:21.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386230+0000", 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039381399999999998 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386314+0000", 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4222999999999996e-05 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.386379+0000", 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4879e-05 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.015399334999998, 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026751219999999998, 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 891 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387337+0000", 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387339+0000", 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9999999999999999e-06 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387350+0000", 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.115e-05 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387381+0000", 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1143999999999999e-05 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387395+0000", 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4562999999999999e-05 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387495+0000", 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9415999999999998e-05 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387614+0000", 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118799 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.387927+0000", 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031333400000000002 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389238+0000", 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013112530000000001 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389871+0000", 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063316800000000003 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.389951+0000", 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9862000000000002e-05 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.390012+0000", 2024-04-26T07:49:21.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0433000000000002e-05 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.650761233000001, 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031879370000000001, 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1020 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751975+0000", 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751976+0000", 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6330000000000001e-06 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.751983+0000", 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7070000000000003e-06 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752000+0000", 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7169000000000001e-05 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752011+0000", 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.099e-05 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752123+0000", 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112154 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752277+0000", 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015411299999999999 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:21.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.752536+0000", 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025889199999999999 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.753314+0000", 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077766900000000004 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755045+0000", 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001731376 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755117+0000", 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1963000000000002e-05 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:02.755163+0000", 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5271000000000001e-05 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:21.519 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:21.520 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:21.520 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:21.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:21.521 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:21.522 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:21.522 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:21.522 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:21.523 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:21.523 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:21.523 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:21.524 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:21.525 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:21.521+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:21.625 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:21.625+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:21.727 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:21.727+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:21.728 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:21.728 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:21.729 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:21.729 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:21.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:21.829 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:21.827+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:21.900 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:21.900 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:21.901 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:21.901 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:21.901 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:21.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:21.930 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:21.927+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:22.030 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:22.030 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:22.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.469475252999999, 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089363580000000001, 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2 2024-04-26T07:49:22.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559516+0000", 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3180000000000001e-06 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559526+0000", 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8190000000000003e-06 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559547+0000", 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1675000000000002e-05 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559563+0000", 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5582000000000001e-05 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561240+0000", 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676978 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561260+0000", 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0590000000000001e-05 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568285+0000", 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070247670000000003 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568450+0000", 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016462900000000001 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:22.035 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.418846627999997, 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030230650000000001, 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 38 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610144+0000", 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.517e-06 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610152+0000", 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5820000000000002e-06 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610171+0000", 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8621e-05 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610180+0000", 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9029999999999993e-06 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610293+0000", 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113552 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610492+0000", 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000199008 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610724+0000", 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023223499999999999 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.611841+0000", 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011162769999999999 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613006+0000", 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001165475 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613098+0000", 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1608999999999997e-05 2024-04-26T07:49:22.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613165+0000", 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7286000000000006e-05 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:50 7.15 e26/25 7:a93a5511:::notify.2:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.431514518999997, 2024-04-26T07:49:22.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029468020000000001, 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597475+0000", 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2600000000000002e-07 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597485+0000", 2024-04-26T07:49:22.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8600000000000005e-06 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597524+0000", 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9156999999999998e-05 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597545+0000", 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1625999999999999e-05 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597750+0000", 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020436900000000001 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597798+0000", 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7732999999999999e-05 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600300+0000", 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025022859999999998 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600421+0000", 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121045 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.318240097, 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030667120000000001, 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 193 2024-04-26T07:49:22.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710751+0000", 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2529999999999999e-06 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710763+0000", 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.225e-05 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710795+0000", 2024-04-26T07:49:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2286999999999998e-05 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710810+0000", 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5102999999999999e-05 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710951+0000", 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014038899999999999 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711181+0000", 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022999199999999999 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711433+0000", 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025236200000000001 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.712618+0000", 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184596 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713695+0000", 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001076975 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713765+0000", 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0396999999999997e-05 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713815+0000", 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0108000000000002e-05 2024-04-26T07:49:22.052 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.415972330000002, 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044673070000000002, 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.053 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 208 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:22.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613019+0000", 2024-04-26T07:49:22.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:49:22.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613032+0000", 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3390000000000001e-05 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613059+0000", 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6369000000000001e-05 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613073+0000", 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613182+0000", 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108902 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613370+0000", 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018796899999999999 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613779+0000", 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040870700000000002 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.614995+0000", 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012161030000000001 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617272+0000", 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022775450000000002 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617365+0000", 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2866000000000002e-05 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617484+0000", 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011849900000000001 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.397598082999998, 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033767699999999999, 2024-04-26T07:49:22.062 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 212 2024-04-26T07:49:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631393+0000", 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631403+0000", 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0757000000000001e-05 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631434+0000", 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0685999999999997e-05 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631452+0000", 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8289999999999999e-05 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631578+0000", 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012580499999999999 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631799+0000", 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221072 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.632219+0000", 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041983999999999999 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.633745+0000", 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015256410000000001 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634566+0000", 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000821234 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634652+0000", 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5521999999999999e-05 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634767+0000", 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115763 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.068 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.371652781000002, 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:49:22.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.3466466, 2024-04-26T07:49:22.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037018250000000002, 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 224 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682344+0000", 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3199999999999998e-06 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682358+0000", 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3223e-05 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682389+0000", 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1819000000000001e-05 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682404+0000", 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4773000000000001e-05 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682559+0000", 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015474900000000001 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682925+0000", 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000365724 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.683728+0000", 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000803096 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685343+0000", 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016147939999999999 2024-04-26T07:49:22.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685828+0000", 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048552900000000001 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685924+0000", 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5488999999999993e-05 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.686044+0000", 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120309 2024-04-26T07:49:22.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.312107328000003, 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031929739999999999, 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 233 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716884+0000", 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5799999999999999e-06 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716896+0000", 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2013e-05 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716928+0000", 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1739000000000002e-05 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716942+0000", 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4367e-05 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717058+0000", 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116239 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717283+0000", 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022485499999999999 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717719+0000", 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043577999999999998 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719168+0000", 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449021 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719862+0000", 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069427499999999995 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719954+0000", 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1939000000000002e-05 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.720074+0000", 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120166 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.085 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:320 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.282301728999997, 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041265579999999998, 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 320 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746689+0000", 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.75e-06 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746697+0000", 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4770000000000003e-06 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746719+0000", 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1543e-05 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746730+0000", 2024-04-26T07:49:22.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1041e-05 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746802+0000", 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.237e-05 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746936+0000", 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013430000000000001 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:22.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747126+0000", 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018941100000000001 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747902+0000", 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077641500000000003 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750700+0000", 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002797875 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750759+0000", 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8622999999999998e-05 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750813+0000", 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4753000000000002e-05 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:392 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.091 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.264618974000001, 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003372562, 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 392 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764371+0000", 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0699999999999999e-06 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764376+0000", 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4530000000000001e-06 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764391+0000", 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764398+0000", 2024-04-26T07:49:22.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6650000000000003e-06 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764458+0000", 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9580000000000002e-05 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764518+0000", 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9833000000000001e-05 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764632+0000", 2024-04-26T07:49:22.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114765 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.765112+0000", 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047932900000000002 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767688+0000", 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002576339 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767719+0000", 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1307999999999999e-05 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767742+0000", 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2892999999999999e-05 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:481 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:22.097 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.215630322000003, 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029129989999999999, 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 481 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:22.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813359+0000", 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2399999999999997e-07 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813363+0000", 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7699999999999999e-06 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813373+0000", 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0564000000000001e-05 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813378+0000", 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9869999999999999e-06 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813431+0000", 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2601e-05 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813486+0000", 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5525000000000001e-05 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813616+0000", 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129195 2024-04-26T07:49:22.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.814126+0000", 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051048 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816215+0000", 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020892279999999998 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816247+0000", 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1523000000000003e-05 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816271+0000", 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4402000000000001e-05 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.103 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.015261146, 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030638950000000001, 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 733 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013730+0000", 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.723e-06 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013742+0000", 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2099999999999999e-05 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013774+0000", 2024-04-26T07:49:22.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1686000000000001e-05 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013791+0000", 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7433000000000001e-05 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013903+0000", 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111562 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014125+0000", 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221962 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014446+0000", 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032154800000000001 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.015730+0000", 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012836189999999999 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016636+0000", 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090594600000000003 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016725+0000", 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8945999999999998e-05 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016791+0000", 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6370000000000003e-05 2024-04-26T07:49:22.109 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.866169618999997, 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031006810000000001, 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.110 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 796 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162821+0000", 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2000000000000001e-06 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162832+0000", 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1123e-05 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162863+0000", 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1053000000000002e-05 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162878+0000", 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4627000000000001e-05 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163055+0000", 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017737800000000001 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163271+0000", 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021579100000000001 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163582+0000", 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031048799999999999 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.164646+0000", 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064391 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165770+0000", 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001123895 2024-04-26T07:49:22.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165858+0000", 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7604999999999999e-05 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165920+0000", 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2130000000000003e-05 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.862096815999998, 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030619419999999998, 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 798 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166894+0000", 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0669999999999999e-06 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166905+0000", 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0689999999999999e-05 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166931+0000", 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5982e-05 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166943+0000", 2024-04-26T07:49:22.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2269999999999999e-05 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167088+0000", 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144983 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167220+0000", 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000131989 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:22.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167484+0000", 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026388399999999998 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.168382+0000", 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089864600000000002 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169799+0000", 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014165250000000001 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169885+0000", 2024-04-26T07:49:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6629e-05 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169954+0000", 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8276999999999997e-05 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.843826550999999, 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029491159999999999, 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.121 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 805 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185164+0000", 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2800000000000002e-06 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185176+0000", 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1576000000000001e-05 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185207+0000", 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0657000000000001e-05 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185224+0000", 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6943e-05 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185347+0000", 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012364200000000001 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185557+0000", 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000209385 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185867+0000", 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031047799999999999 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.186792+0000", 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092501900000000001 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.187956+0000", 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011643210000000001 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188043+0000", 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6621999999999998e-05 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188111+0000", 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8193000000000003e-05 2024-04-26T07:49:22.126 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.775330955000001, 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002965442, 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 834 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253659+0000", 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.813e-06 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253669+0000", 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5529999999999998e-06 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253695+0000", 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5542999999999999e-05 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253707+0000", 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2320000000000001e-05 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253850+0000", 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143356 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253974+0000", 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012351899999999999 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.254248+0000", 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000274104 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.255127+0000", 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00087949999999999996 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256473+0000", 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013458890000000001 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256560+0000", 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7206000000000005e-05 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256623+0000", 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2638999999999994e-05 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:22.132 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.616993346000001, 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034075350000000002, 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 901 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411998+0000", 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412011+0000", 2024-04-26T07:49:22.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2873e-05 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412042+0000", 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1168999999999999e-05 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412058+0000", 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5480000000000001e-05 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412219+0000", 2024-04-26T07:49:22.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016089899999999999 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412592+0000", 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037354 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.413172+0000", 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00057962499999999995 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.414322+0000", 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001149705 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415207+0000", 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088520199999999997 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415294+0000", 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6860000000000005e-05 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415403+0000", 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010914200000000001 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.612275175000001, 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033765959999999999, 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.138 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 903 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416716+0000", 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.08e-06 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416729+0000", 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.378e-05 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416762+0000", 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3173000000000002e-05 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416777+0000", 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4873e-05 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416907+0000", 2024-04-26T07:49:22.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417143+0000", 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023651499999999999 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417631+0000", 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048777599999999999 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.418763+0000", 2024-04-26T07:49:22.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011318599999999999 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419805+0000", 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001041742 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419970+0000", 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016569499999999999 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.420090+0000", 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119553 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.511725063, 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003600907, 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.144 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 946 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517266+0000", 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2730000000000001e-06 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517278+0000", 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1987000000000001e-05 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517310+0000", 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1843e-05 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517325+0000", 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5197e-05 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517439+0000", 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113785 2024-04-26T07:49:22.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517663+0000", 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022453499999999999 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517999+0000", 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033559099999999999 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.519130+0000", 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001131544 2024-04-26T07:49:22.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520581+0000", 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014505950000000001 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520744+0000", 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016345199999999999 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520864+0000", 2024-04-26T07:49:22.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120105 2024-04-26T07:49:22.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.150 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.150 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.150 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:22.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:49:22.151 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:22.027+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:22.152 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:22.153 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:22.151+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:22.253 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:22.251+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:22.274 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T07:49:22.274 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T07:49:22.311 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:22.311 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:22.312 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:22.312 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:22.328 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:22.353 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:22.351+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:22.440 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:22.440 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:22.440 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:22.440 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:22.440 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:22.454 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:22.455+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:22.454 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:22.555 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:22.553+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:22.570 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.949490175999998, 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026678100000000001, 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 42 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620179+0000", 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2400000000000002e-06 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620193+0000", 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3886000000000001e-05 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620222+0000", 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8736000000000001e-05 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620243+0000", 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0832e-05 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620365+0000", 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012243700000000001 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620549+0000", 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018372899999999999 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620684+0000", 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135723 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.621541+0000", 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085632299999999998 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622750+0000", 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001209168 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622801+0000", 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0991e-05 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622845+0000", 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3745000000000002e-05 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.967943063999996, 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0056514750000000004, 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 52 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601727+0000", 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.163e-06 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601761+0000", 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3847999999999998e-05 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602013+0000", 2024-04-26T07:49:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025215399999999998 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602102+0000", 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9066000000000004e-05 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602273+0000", 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000171182 2024-04-26T07:49:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602651+0000", 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037720000000000001 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602995+0000", 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000344247 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.604820+0000", 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018254160000000001 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607233+0000", 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024128230000000001 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607309+0000", 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6224999999999996e-05 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607376+0000", 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6150999999999997e-05 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.842339027000001, 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031921969999999999, 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 236 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727332+0000", 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4869999999999998e-06 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727346+0000", 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4836e-05 2024-04-26T07:49:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727380+0000", 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3692999999999997e-05 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727400+0000", 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9979999999999998e-05 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727531+0000", 2024-04-26T07:49:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130949 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727788+0000", 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025688499999999999 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.728200+0000", 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041179900000000002 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.729730+0000", 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001530572 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730356+0000", 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062611800000000005 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730446+0000", 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9319000000000003e-05 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730520+0000", 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4559000000000002e-05 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.828799216, 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028999310000000001, 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 283 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740869+0000", 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.155e-06 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740884+0000", 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.543e-05 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740899+0000", 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4533e-05 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740905+0000", 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4010000000000002e-06 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740970+0000", 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4888000000000006e-05 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741087+0000", 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116388 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741223+0000", 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013601800000000001 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741950+0000", 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072763400000000001 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743680+0000", 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017300309999999999 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743719+0000", 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8732000000000001e-05 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743768+0000", 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8721000000000003e-05 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.532465064, 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028979790000000002, 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 742 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037205+0000", 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.683e-06 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037217+0000", 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2347000000000001e-05 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037249+0000", 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1652999999999997e-05 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037264+0000", 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5053e-05 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037398+0000", 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134449 2024-04-26T07:49:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037637+0000", 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000238388 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037984+0000", 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000347401 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039386+0000", 2024-04-26T07:49:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001402375 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039941+0000", 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00055470499999999996 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040031+0000", 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9870000000000005e-05 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040100+0000", 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9054999999999995e-05 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.491816728000003, 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026953580000000001, 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 760 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077853+0000", 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2199999999999999e-06 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077864+0000", 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.136e-05 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077895+0000", 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1380000000000001e-05 2024-04-26T07:49:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077910+0000", 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4683e-05 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078033+0000", 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012319499999999999 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078253+0000", 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021987499999999999 2024-04-26T07:49:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078568+0000", 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031487099999999999 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.079737+0000", 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001169364 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080396+0000", 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065863100000000002 2024-04-26T07:49:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080482+0000", 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5673000000000005e-05 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080546+0000", 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4105999999999999e-05 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.488136918000002, 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026454019999999998, 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 762 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081532+0000", 2024-04-26T07:49:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081560+0000", 2024-04-26T07:49:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8153e-05 2024-04-26T07:49:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081592+0000", 2024-04-26T07:49:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1757000000000001e-05 2024-04-26T07:49:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081611+0000", 2024-04-26T07:49:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8626000000000001e-05 2024-04-26T07:49:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081721+0000", 2024-04-26T07:49:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110296 2024-04-26T07:49:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081849+0000", 2024-04-26T07:49:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012843199999999999 2024-04-26T07:49:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.082121+0000", 2024-04-26T07:49:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027200800000000002 2024-04-26T07:49:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.083234+0000", 2024-04-26T07:49:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011123769999999999 2024-04-26T07:49:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084026+0000", 2024-04-26T07:49:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079225400000000005 2024-04-26T07:49:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084109+0000", 2024-04-26T07:49:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2641999999999999e-05 2024-04-26T07:49:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084176+0000", 2024-04-26T07:49:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7037000000000002e-05 2024-04-26T07:49:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.354473949000003, 2024-04-26T07:49:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026859850000000001, 2024-04-26T07:49:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 817 2024-04-26T07:49:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215197+0000", 2024-04-26T07:49:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.444e-06 2024-04-26T07:49:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215210+0000", 2024-04-26T07:49:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3016e-05 2024-04-26T07:49:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215241+0000", 2024-04-26T07:49:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1050000000000003e-05 2024-04-26T07:49:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215256+0000", 2024-04-26T07:49:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5293000000000001e-05 2024-04-26T07:49:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215390+0000", 2024-04-26T07:49:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013440199999999999 2024-04-26T07:49:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215620+0000", 2024-04-26T07:49:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022916200000000001 2024-04-26T07:49:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215891+0000", 2024-04-26T07:49:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027189100000000002 2024-04-26T07:49:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217059+0000", 2024-04-26T07:49:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011680670000000001 2024-04-26T07:49:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217578+0000", 2024-04-26T07:49:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051814600000000004 2024-04-26T07:49:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217748+0000", 2024-04-26T07:49:22.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017023200000000001 2024-04-26T07:49:22.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217879+0000", 2024-04-26T07:49:22.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013128200000000001 2024-04-26T07:49:22.629 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.629 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.629 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.630 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.630 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:22.630 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.350659786000001, 2024-04-26T07:49:22.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030863079999999998, 2024-04-26T07:49:22.630 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.631 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.631 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.631 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.631 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.631 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.631 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 819 2024-04-26T07:49:22.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.632 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:22.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:22.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219009+0000", 2024-04-26T07:49:22.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6300000000000001e-06 2024-04-26T07:49:22.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219018+0000", 2024-04-26T07:49:22.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7830000000000004e-06 2024-04-26T07:49:22.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219043+0000", 2024-04-26T07:49:22.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4902999999999999e-05 2024-04-26T07:49:22.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219055+0000", 2024-04-26T07:49:22.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2733e-05 2024-04-26T07:49:22.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219187+0000", 2024-04-26T07:49:22.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013202600000000001 2024-04-26T07:49:22.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219416+0000", 2024-04-26T07:49:22.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000228595 2024-04-26T07:49:22.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219921+0000", 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00050526200000000003 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221111+0000", 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001189264 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221824+0000", 2024-04-26T07:49:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071316700000000001 2024-04-26T07:49:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221979+0000", 2024-04-26T07:49:22.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015522600000000001 2024-04-26T07:49:22.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.222094+0000", 2024-04-26T07:49:22.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114719 2024-04-26T07:49:22.641 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.641 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.642 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.642 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.642 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:22.642 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.298793521999997, 2024-04-26T07:49:22.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033639400000000002, 2024-04-26T07:49:22.642 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.643 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.643 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.643 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.643 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.643 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.643 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 841 2024-04-26T07:49:22.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.643 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:22.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270876+0000", 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5239999999999999e-06 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270888+0000", 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.239e-05 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270919+0000", 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0386e-05 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270937+0000", 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8023e-05 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271091+0000", 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153802 2024-04-26T07:49:22.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271447+0000", 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035622099999999999 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.272032+0000", 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058492799999999997 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273324+0000", 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012923559999999999 2024-04-26T07:49:22.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273958+0000", 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063414899999999998 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274114+0000", 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015607800000000001 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274238+0000", 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012308299999999999 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.294228771999997, 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031880070000000001, 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.649 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 843 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275441+0000", 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2129999999999998e-06 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275451+0000", 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0727000000000001e-05 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275483+0000", 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2011999999999998e-05 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275504+0000", 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0267000000000001e-05 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275646+0000", 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014206900000000001 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275879+0000", 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000233315 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.276359+0000", 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048021899999999999 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.277529+0000", 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011702609999999999 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278354+0000", 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00082486600000000005 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278506+0000", 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015169599999999999 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278626+0000", 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120362 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.655 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.284136646999997, 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027584929999999999, 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.656 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 847 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:22.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285533+0000", 2024-04-26T07:49:22.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3159999999999999e-06 2024-04-26T07:49:22.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285544+0000", 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1253999999999999e-05 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285575+0000", 2024-04-26T07:49:22.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0738999999999998e-05 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285589+0000", 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4343e-05 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285702+0000", 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112649 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285921+0000", 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021945499999999999 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.286238+0000", 2024-04-26T07:49:22.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031702400000000001 2024-04-26T07:49:22.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.287549+0000", 2024-04-26T07:49:22.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001310879 2024-04-26T07:49:22.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288004+0000", 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045514399999999999 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288167+0000", 2024-04-26T07:49:22.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016323100000000001 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288289+0000", 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121459 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.665 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.665 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:22.665 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.280253096000003, 2024-04-26T07:49:22.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002936106, 2024-04-26T07:49:22.665 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.665 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.665 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.666 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 849 2024-04-26T07:49:22.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.666 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:22.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:22.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289416+0000", 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7129999999999999e-06 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289425+0000", 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6369999999999994e-06 2024-04-26T07:49:22.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289450+0000", 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4433000000000001e-05 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289462+0000", 2024-04-26T07:49:22.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1956999999999999e-05 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289591+0000", 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289827+0000", 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023558800000000001 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.290310+0000", 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048358899999999998 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.291493+0000", 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001182324 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292082+0000", 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058951499999999998 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292242+0000", 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159309 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292350+0000", 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108492 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.235646897000002, 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026241229999999999, 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.673 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 868 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334022+0000", 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8610000000000001e-06 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334031+0000", 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3759999999999997e-06 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334055+0000", 2024-04-26T07:49:22.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3272999999999999e-05 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334066+0000", 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1498000000000001e-05 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334185+0000", 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118355 2024-04-26T07:49:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334409+0000", 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022421499999999999 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334721+0000", 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031224699999999998 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336020+0000", 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012986829999999999 2024-04-26T07:49:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336496+0000", 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047615 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336578+0000", 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2452000000000003e-05 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336644+0000", 2024-04-26T07:49:22.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6013000000000006e-05 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.142366160999998, 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032794199999999999, 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.679 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 907 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427303+0000", 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.446e-06 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427315+0000", 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1707e-05 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427348+0000", 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2642999999999999e-05 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427363+0000", 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5037e-05 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427519+0000", 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015594200000000001 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427915+0000", 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039595599999999999 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.428501+0000", 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058595900000000005 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.429998+0000", 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014978210000000001 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430311+0000", 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031217400000000002 2024-04-26T07:49:22.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430468+0000", 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015785500000000001 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430580+0000", 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011188000000000001 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.684 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.137943127, 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002976916, 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 909 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431726+0000", 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8759999999999999e-06 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431735+0000", 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.577e-06 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431761+0000", 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5117e-05 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431773+0000", 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2526e-05 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431878+0000", 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010459300000000001 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432020+0000", 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014283899999999999 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432300+0000", 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279664 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.433338+0000", 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001038115 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434437+0000", 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001098878 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434590+0000", 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015255800000000001 2024-04-26T07:49:22.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434701+0000", 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111173 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.045097556000002, 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026912619999999998, 2024-04-26T07:49:22.690 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 949 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524572+0000", 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4870000000000001e-06 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524584+0000", 2024-04-26T07:49:22.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.242e-05 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524615+0000", 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0156000000000001e-05 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524630+0000", 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5327000000000001e-05 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524785+0000", 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015463799999999999 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525023+0000", 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023835800000000001 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525339+0000", 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031561799999999999 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.526523+0000", 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184367 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527111+0000", 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058795500000000003 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527193+0000", 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2459000000000005e-05 2024-04-26T07:49:22.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527261+0000", 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7477000000000005e-05 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.041466032000002, 2024-04-26T07:49:22.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025643620000000002, 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 951 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528203+0000", 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5600000000000001e-06 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528211+0000", 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8060000000000001e-06 2024-04-26T07:49:22.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528236+0000", 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4933999999999999e-05 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528249+0000", 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2935999999999999e-05 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528348+0000", 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8822999999999999e-05 2024-04-26T07:49:22.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528473+0000", 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012490900000000001 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528743+0000", 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026996099999999999 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.529961+0000", 2024-04-26T07:49:22.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012176299999999999 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530617+0000", 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065623799999999996 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530701+0000", 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4419000000000006e-05 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530765+0000", 2024-04-26T07:49:22.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4146000000000006e-05 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.027167841999997, 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002689145, 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.702 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 955 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542501+0000", 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1639999999999999e-06 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542513+0000", 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1456e-05 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542543+0000", 2024-04-26T07:49:22.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0190000000000001e-05 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542558+0000", 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4866e-05 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542681+0000", 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012343200000000001 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542905+0000", 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223155 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.543219+0000", 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031459800000000003 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.544603+0000", 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013838489999999999 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545039+0000", 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043600300000000002 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545124+0000", 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4999000000000004e-05 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545188+0000", 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4432999999999998e-05 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.707 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.023591181, 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026964580000000001, 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 957 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.708 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546078+0000", 2024-04-26T07:49:22.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0700000000000001e-06 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546088+0000", 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0067e-05 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546118+0000", 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0429999999999998e-05 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546136+0000", 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7520000000000002e-05 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546252+0000", 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115945 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546400+0000", 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014764199999999999 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:22.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546672+0000", 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027279099999999998 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.547902+0000", 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001230014 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548616+0000", 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071360399999999995 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:22.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548707+0000", 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1372999999999994e-05 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548772+0000", 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5001999999999999e-05 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:22.713 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:22.715 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:22.715 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:22.713+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:22.816 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:22.815+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:22.871 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:22.871 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:22.871 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:22.871 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:22.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:22.930 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:22.929+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:23.002 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:23.003 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:23.003 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:23.003 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:23.003 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:23.015 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:23.029 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:49:23.029 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:23.025+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:23.119 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:23.115+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:23.143 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.569904493000003, 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012204097000000001, 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.144 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 44 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:23.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571159+0000", 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7500000000000001e-06 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571176+0000", 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7359000000000001e-05 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571214+0000", 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7942999999999999e-05 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571240+0000", 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6084e-05 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571398+0000", 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015818000000000001 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571415+0000", 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6739e-05 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583000+0000", 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011585332 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583359+0000", 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035870999999999999 2024-04-26T07:49:23.148 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.530759056000001, 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003073423, 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.149 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 56 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610304+0000", 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1540000000000002e-06 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610315+0000", 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1596e-05 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610348+0000", 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2379999999999998e-05 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610364+0000", 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6466000000000001e-05 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610544+0000", 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179963 2024-04-26T07:49:23.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610849+0000", 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030534099999999999 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.611143+0000", 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029372300000000002 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.612446+0000", 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013032129999999999 2024-04-26T07:49:23.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613250+0000", 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080378299999999997 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613319+0000", 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8774000000000003e-05 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613374+0000", 2024-04-26T07:49:23.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.503e-05 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596391211392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.527515014999999, 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033841380000000001, 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.155 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 57 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613546+0000", 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7770000000000001e-06 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613554+0000", 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7789999999999996e-06 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613578+0000", 2024-04-26T07:49:23.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4236999999999999e-05 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613592+0000", 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4106e-05 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613725+0000", 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013219999999999999 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613921+0000", 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019679800000000001 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.614275+0000", 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035357100000000001 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.615361+0000", 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010861880000000001 2024-04-26T07:49:23.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616713+0000", 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013521900000000001 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616818+0000", 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010427 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616929+0000", 2024-04-26T07:49:23.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111022 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.532877970000001, 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045711500000000004, 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.161 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 207 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608185+0000", 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2270000000000002e-06 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608199+0000", 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4049999999999999e-05 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608231+0000", 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:23.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608247+0000", 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6696000000000001e-05 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608402+0000", 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015428499999999999 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608762+0000", 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036012099999999998 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.609476+0000", 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071385399999999999 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612197+0000", 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027211480000000001 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612606+0000", 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040884 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612688+0000", 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1935999999999996e-05 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612753+0000", 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5075999999999998e-05 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.166 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.494843705999997, 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003481442, 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 216 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646219+0000", 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8430000000000001e-06 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646232+0000", 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.358e-05 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646268+0000", 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5846999999999997e-05 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646295+0000", 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6752999999999999e-05 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646431+0000", 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013639500000000001 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646656+0000", 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022519900000000001 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.647143+0000", 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487009 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649075+0000", 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019313640000000001 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649552+0000", 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000476959 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649634+0000", 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1877000000000002e-05 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649697+0000", 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3615999999999995e-05 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.446838233000001, 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036454130000000001, 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.172 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 227 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694224+0000", 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3099999999999999e-06 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694235+0000", 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1559999999999999e-05 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694267+0000", 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:23.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694282+0000", 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5150000000000001e-05 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694426+0000", 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144058 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694676+0000", 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024983500000000001 2024-04-26T07:49:23.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.695121+0000", 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00044507299999999999 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.696591+0000", 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001469878 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697715+0000", 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011244009999999999 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697800+0000", 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4722000000000006e-05 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697867+0000", 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6508999999999996e-05 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.177 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.439402080999997, 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032415780000000002, 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.178 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 229 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701660+0000", 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.244e-06 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701671+0000", 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1326e-05 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701703+0000", 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2023999999999997e-05 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701718+0000", 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5133000000000001e-05 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701833+0000", 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114916 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702050+0000", 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216624 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702472+0000", 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042268699999999999 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.703941+0000", 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001468128 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704755+0000", 2024-04-26T07:49:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000814637 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704833+0000", 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8226000000000006e-05 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704899+0000", 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5633e-05 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.432402463000003, 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003426648, 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 231 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708659+0000", 2024-04-26T07:49:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2630000000000002e-06 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708671+0000", 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1379999999999999e-05 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708702+0000", 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1761999999999998e-05 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708719+0000", 2024-04-26T07:49:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6954000000000001e-05 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708844+0000", 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012488199999999999 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709085+0000", 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000240905 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709507+0000", 2024-04-26T07:49:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042178700000000002 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711076+0000", 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015689530000000001 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711928+0000", 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085241699999999995 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712016+0000", 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7219000000000006e-05 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712084+0000", 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8126000000000005e-05 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.133912844999998, 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029394930000000001, 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 730 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007149+0000", 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2500000000000001e-06 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007160+0000", 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1516e-05 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007192+0000", 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1362999999999998e-05 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007207+0000", 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5114e-05 2024-04-26T07:49:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007316+0000", 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109252 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007539+0000", 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022263200000000001 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007886+0000", 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034704000000000001 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009051+0000", 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001164881 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009882+0000", 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083153899999999995 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009971+0000", 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9183000000000003e-05 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.010086+0000", 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011472300000000001 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.12030412, 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028721110000000001, 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 736 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020758+0000", 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.187e-06 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020769+0000", 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1263e-05 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020800+0000", 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.129e-05 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020815+0000", 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4737e-05 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020938+0000", 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012298499999999999 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.021157+0000", 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021933799999999999 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.021474+0000", 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031639199999999998 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.022654+0000", 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00118045 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023470+0000", 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081556700000000001 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023556+0000", 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6612000000000004e-05 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023628+0000", 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1290000000000004e-05 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.116425470999999, 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051848809999999997, 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 738 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024636+0000", 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0999999999999998e-06 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024647+0000", 2024-04-26T07:49:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1270000000000001e-05 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024679+0000", 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1069999999999999e-05 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024698+0000", 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9887000000000001e-05 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024806+0000", 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010731899999999999 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024938+0000", 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013236899999999999 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.025208+0000", 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027009700000000001 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.026465+0000", 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012567800000000001 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029663+0000", 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003197667 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029751+0000", 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8578999999999993e-05 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029819+0000", 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7743000000000005e-05 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.020330395999999, 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003055978, 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 778 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120731+0000", 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2869999999999999e-06 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120743+0000", 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1656e-05 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120774+0000", 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1309999999999997e-05 2024-04-26T07:49:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120790+0000", 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5187e-05 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120910+0000", 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119979 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121125+0000", 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000215324 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121440+0000", 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031488499999999999 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.122682+0000", 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001242033 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123599+0000", 2024-04-26T07:49:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00091723900000000003 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123718+0000", 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119306 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123785+0000", 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6772000000000004e-05 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.962733821, 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030101080000000001, 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 802 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178328+0000", 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5830000000000001e-06 2024-04-26T07:49:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178340+0000", 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1347e-05 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178371+0000", 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1303000000000002e-05 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178386+0000", 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5043e-05 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178500+0000", 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114339 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178722+0000", 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022198199999999999 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.179047+0000", 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000324667 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.180162+0000", 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001114711 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181123+0000", 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00096165200000000001 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181220+0000", 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7139000000000006e-05 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181336+0000", 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011534199999999999 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.877149023999998, 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029079560000000002, 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 838 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263913+0000", 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9929999999999998e-06 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263925+0000", 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.269e-05 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263953+0000", 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7900000000000001e-05 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263967+0000", 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.438e-05 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264085+0000", 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117982 2024-04-26T07:49:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264310+0000", 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022483099999999999 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264674+0000", 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036400700000000001 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.265887+0000", 2024-04-26T07:49:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00121247 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266611+0000", 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072435100000000003 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266700+0000", 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412999999999995e-05 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266818+0000", 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011893899999999999 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.848508754000001, 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029764090000000002, 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 850 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292553+0000", 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4399999999999999e-06 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292565+0000", 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.154e-05 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292595+0000", 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0433000000000002e-05 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292613+0000", 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7759999999999999e-05 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292738+0000", 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012527600000000001 2024-04-26T07:49:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292948+0000", 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020985099999999999 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.293260+0000", 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031240100000000002 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.294440+0000", 2024-04-26T07:49:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00117979 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295370+0000", 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092946599999999999 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295460+0000", 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0529e-05 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295527+0000", 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6922999999999996e-05 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.844512162999997, 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029089200000000002, 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 852 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296550+0000", 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.39e-06 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296563+0000", 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2763e-05 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296593+0000", 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0929999999999997e-05 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296611+0000", 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7453e-05 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296715+0000", 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000104522 2024-04-26T07:49:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296846+0000", 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130066 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.297118+0000", 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027257399999999998 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.298189+0000", 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001071242 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299293+0000", 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001103845 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299388+0000", 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4462000000000005e-05 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299456+0000", 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8672999999999998e-05 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.797036722000001, 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003029908, 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 873 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344025+0000", 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6959999999999999e-06 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344036+0000", 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1226999999999999e-05 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344061+0000", 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5309000000000001e-05 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344080+0000", 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8853000000000001e-05 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344227+0000", 2024-04-26T07:49:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014731600000000001 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344358+0000", 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013102900000000001 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344646+0000", 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000287965 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.345790+0000", 2024-04-26T07:49:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001143926 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346903+0000", 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011127610000000001 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346987+0000", 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4350000000000004e-05 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.347053+0000", 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5475999999999994e-05 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.652270950000002, 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031214210000000001, 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 934 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488791+0000", 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6199999999999999e-06 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488806+0000", 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4963000000000001e-05 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488840+0000", 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3793e-05 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488862+0000", 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2325999999999999e-05 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488994+0000", 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013211899999999999 2024-04-26T07:49:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489218+0000", 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223482 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489533+0000", 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031546100000000001 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.490516+0000", 2024-04-26T07:49:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00098278499999999991 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491625+0000", 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001108904 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491793+0000", 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167873 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491910+0000", 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117095 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:936 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.648206170000002, 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002857437, 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 936 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492855+0000", 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492868+0000", 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2413e-05 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492898+0000", 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.044e-05 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492915+0000", 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7414e-05 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493014+0000", 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8992000000000004e-05 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493159+0000", 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144046 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493437+0000", 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027894999999999998 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.494751+0000", 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013136669999999999 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495553+0000", 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000802339 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495648+0000", 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4265999999999995e-05 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495711+0000", 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3089999999999994e-05 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.645116862000002, 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030389750000000002, 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 937 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495945+0000", 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.84e-06 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495955+0000", 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0787e-05 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495986+0000", 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1093000000000002e-05 2024-04-26T07:49:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496005+0000", 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8236e-05 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496127+0000", 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000122069 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496372+0000", 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024480200000000002 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496723+0000", 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000351357 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.497773+0000", 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001050411 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498698+0000", 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092447199999999997 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498861+0000", 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016297600000000001 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498982+0000", 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120932 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:23.260 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:23.261 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:23.262 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:23.259+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:23.363 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:23.361+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:23.395 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:23.395 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:23.395 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:23.395 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:23.410 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:23.463 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:23.463+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:23.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:23.532 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:23.532 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:23.532 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:23.532 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:23.532 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:23.546 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:23.592 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:23.591+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:23.665 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:23.665+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:23.682 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:23.682 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:23.699 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:23.700 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:23.715 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:23.716 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:23.721 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:23.721 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:23.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:23.721 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:23.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.721 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:46 7.1f e26/25 7:f95f44c2:::notify.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.1396996, 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081628929999999992, 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:23.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578311+0000", 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2460000000000002e-06 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578328+0000", 2024-04-26T07:49:23.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7090000000000001e-05 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578380+0000", 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.126e-05 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578417+0000", 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7008999999999998e-05 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578579+0000", 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016204899999999999 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578632+0000", 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3103000000000003e-05 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586350+0000", 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007717944 2024-04-26T07:49:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586472+0000", 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000122192 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.625061+0000", 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.092947621, 2024-04-26T07:49:23.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034725649999999999, 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 211 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625061+0000", 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625061+0000", 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625065+0000", 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7400000000000002e-06 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625080+0000", 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4839e-05 2024-04-26T07:49:23.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625118+0000", 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8733999999999999e-05 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625144+0000", 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.525e-05 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625293+0000", 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149918 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625528+0000", 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023430200000000001 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.625973+0000", 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044475899999999997 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.627472+0000", 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014989650000000001 2024-04-26T07:49:23.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.628379+0000", 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00090716199999999999 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.628466+0000", 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7552999999999993e-05 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.628534+0000", 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7342999999999995e-05 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.731 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.709822+0000", 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.008186604000002, 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042047630000000003, 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.732 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 232 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709822+0000", 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709822+0000", 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709825+0000", 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0230000000000001e-06 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709838+0000", 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2480000000000001e-05 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709871+0000", 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3149999999999999e-05 2024-04-26T07:49:23.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709887+0000", 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5858999999999998e-05 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.710069+0000", 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018238299999999999 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.710285+0000", 2024-04-26T07:49:23.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021657800000000001 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.710723+0000", 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043705000000000003 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.712431+0000", 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017083860000000001 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.713826+0000", 2024-04-26T07:49:23.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013952120000000001 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.713916+0000", 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9538999999999998e-05 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.714027+0000", 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111103 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:263 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.734486+0000", 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.983522858000001, 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0035318810000000002, 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 263 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.738 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.734486+0000", 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.734486+0000", 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.734488+0000", 2024-04-26T07:49:23.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9429999999999999e-06 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.734499+0000", 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0803e-05 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.734525+0000", 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6554e-05 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.734544+0000", 2024-04-26T07:49:23.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8830000000000001e-05 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.734694+0000", 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000150588 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.734925+0000", 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023100900000000001 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.735431+0000", 2024-04-26T07:49:23.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050514899999999998 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.736698+0000", 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001266966 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737813+0000", 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011154369999999999 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737930+0000", 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000116696 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.738018+0000", 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7905999999999995e-05 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:280 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.743 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.737412+0000", 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.980596546000001, 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031719090000000001, 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 280 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737412+0000", 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737412+0000", 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737414+0000", 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6270000000000001e-06 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737426+0000", 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2327000000000001e-05 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737450+0000", 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3756000000000001e-05 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737465+0000", 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4917e-05 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737661+0000", 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019633500000000001 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.737964+0000", 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000302594 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.738523+0000", 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00055898199999999997 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.739920+0000", 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013977760000000001 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.740256+0000", 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033597100000000001 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.740434+0000", 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000177911 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.740584+0000", 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014971299999999999 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:303 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.749 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.741634+0000", 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.976374618999998, 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031594679999999999, 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 303 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.741634+0000", 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.741634+0000", 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.741637+0000", 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5170000000000002e-06 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.741650+0000", 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3009e-05 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.741687+0000", 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7437000000000001e-05 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.741707+0000", 2024-04-26T07:49:23.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0253000000000001e-05 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.742022+0000", 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031516399999999999 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.742181+0000", 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000159059 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.742530+0000", 2024-04-26T07:49:23.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000348513 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.743815+0000", 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012845739999999999 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744479+0000", 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000664827 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744592+0000", 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113039 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.744793+0000", 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020107600000000001 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:366 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.755 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.751512+0000", 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.966496530000001, 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029348999999999998, 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 366 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751512+0000", 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751512+0000", 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751514+0000", 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.86e-06 2024-04-26T07:49:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751526+0000", 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2140000000000001e-05 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751557+0000", 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1223000000000002e-05 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751578+0000", 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0769999999999999e-05 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.751747+0000", 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016862499999999999 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752057+0000", 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000310771 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.752528+0000", 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047080599999999999 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753940+0000", 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0014116949999999999 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.754218+0000", 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027772799999999998 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.754342+0000", 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012439600000000001 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.754447+0000", 2024-04-26T07:49:23.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104886 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:374 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.753008+0000", 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.965000568999997, 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042259139999999999, 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.762 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 374 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753008+0000", 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753008+0000", 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753010+0000", 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.373e-06 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753022+0000", 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1853e-05 2024-04-26T07:49:23.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753056+0000", 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3377000000000002e-05 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753078+0000", 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2249999999999999e-05 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753501+0000", 2024-04-26T07:49:23.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042283899999999999 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753686+0000", 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018520900000000001 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.754052+0000", 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036590700000000001 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.755126+0000", 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010742779999999999 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.756983+0000", 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018566329999999999 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.757129+0000", 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000145747 2024-04-26T07:49:23.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.757234+0000", 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105448 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:501 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.821372+0000", 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.896636954999998, 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033767379999999998, 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.768 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 501 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.821372+0000", 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.821372+0000", 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.821375+0000", 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9629999999999998e-06 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.821390+0000", 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.554e-05 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.821429+0000", 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9270000000000002e-05 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.821452+0000", 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2676000000000001e-05 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.821589+0000", 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000136446 2024-04-26T07:49:23.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.821790+0000", 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000201084 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.822070+0000", 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028077199999999999 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.823877+0000", 2024-04-26T07:49:23.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018066569999999999 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.824507+0000", 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00063003500000000004 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.824651+0000", 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014339299999999999 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.824748+0000", 2024-04-26T07:49:23.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7901999999999999e-05 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:510 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.825652+0000", 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.892356990000003, 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030045039999999999, 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.774 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 510 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.825652+0000", 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.825652+0000", 2024-04-26T07:49:23.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.825653+0000", 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.72e-06 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.825662+0000", 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.354e-06 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.825683+0000", 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1729000000000002e-05 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.825695+0000", 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1174e-05 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.825796+0000", 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101085 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.825913+0000", 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117076 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.826164+0000", 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250929 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.828303+0000", 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0021397539999999998 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.828412+0000", 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109022 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.828536+0000", 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012324800000000001 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.828656+0000", 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120413 2024-04-26T07:49:23.779 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.993061+0000", 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.724947831000001, 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047914869999999997, 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.780 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 726 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993061+0000", 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993061+0000", 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993062+0000", 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6700000000000001e-06 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993073+0000", 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0186e-05 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993096+0000", 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2867e-05 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993115+0000", 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9979999999999998e-05 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993219+0000", 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000103082 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993330+0000", 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011117599999999999 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993580+0000", 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025037200000000001 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.994520+0000", 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00094018699999999999 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997726+0000", 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032055159999999998 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997795+0000", 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9620000000000001e-05 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997852+0000", 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6830999999999998e-05 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:738 6.6 e29/23 6:6192870f:::obj_delete_at_hint.0000000053:head v 29'6, mlcod=29'4)", 2024-04-26T07:49:23.785 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.022856+0000", 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.695152706999998, 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038019479999999999, 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.022856+0000", 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.022856+0000", 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.022858+0000", 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5999999999999999e-06 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.022867+0000", 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6830000000000003e-06 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.022891+0000", 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4182999999999999e-05 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.022912+0000", 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0242999999999999e-05 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.023054+0000", 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014250600000000001 2024-04-26T07:49:23.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.023093+0000", 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9082999999999998e-05 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.026589+0000", 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034959280000000001 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.026658+0000", 2024-04-26T07:49:23.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8721999999999997e-05 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.110516+0000", 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.607492894000004, 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029148139999999999, 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 775 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.110516+0000", 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.110516+0000", 2024-04-26T07:49:23.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.110518+0000", 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6369999999999999e-06 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.110532+0000", 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3823e-05 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.110563+0000", 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1170000000000001e-05 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.110578+0000", 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4980000000000001e-05 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.110699+0000", 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120876 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.110912+0000", 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021297800000000001 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.111221+0000", 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030882700000000002 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.112319+0000", 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001098445 2024-04-26T07:49:23.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.113128+0000", 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00080851999999999996 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.113297+0000", 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016854199999999999 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.113431+0000", 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013401600000000001 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.114889+0000", 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.603119788999997, 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002948179, 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.796 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 777 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.114889+0000", 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.114889+0000", 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.114891+0000", 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.277e-06 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.114902+0000", 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1379999999999999e-05 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.114936+0000", 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3015999999999997e-05 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.114954+0000", 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8726e-05 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.115072+0000", 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118266 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.115290+0000", 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021721500000000001 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.115766+0000", 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047667599999999999 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.117019+0000", 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00125299 2024-04-26T07:49:23.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.117669+0000", 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00064928100000000003 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.117758+0000", 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9133000000000002e-05 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.117837+0000", 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9219000000000002e-05 2024-04-26T07:49:23.801 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.189188+0000", 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.528820883999998, 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034994050000000001, 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.802 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 808 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.189188+0000", 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.189188+0000", 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.189190+0000", 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3700000000000002e-06 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.189204+0000", 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3757000000000001e-05 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.189233+0000", 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9606000000000001e-05 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.189248+0000", 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4754e-05 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.189409+0000", 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000160631 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.189773+0000", 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000364144 2024-04-26T07:49:23.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.190341+0000", 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00056768599999999997 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.192081+0000", 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001739829 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.192527+0000", 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044621899999999998 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.192614+0000", 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7396000000000001e-05 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.192687+0000", 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3013e-05 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.207671+0000", 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.510337937000003, 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045415459999999996, 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 816 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.808 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207671+0000", 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207671+0000", 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207672+0000", 2024-04-26T07:49:23.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6029999999999999e-06 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207680+0000", 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9030000000000004e-06 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207701+0000", 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0754000000000002e-05 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207711+0000", 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0213e-05 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207792+0000", 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0649000000000007e-05 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207912+0000", 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120362 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:23.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208172+0000", 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000259588 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.209381+0000", 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012095910000000001 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.212061+0000", 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026794940000000001 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.212147+0000", 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6277000000000001e-05 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.212212+0000", 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5111999999999996e-05 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.813 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.360985+0000", 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.357023771000001, 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031757109999999999, 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 880 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.360985+0000", 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.360985+0000", 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.360988+0000", 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7700000000000002e-06 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.361018+0000", 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0029999999999999e-05 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.361051+0000", 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3339e-05 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.361067+0000", 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5574e-05 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.361180+0000", 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113405 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.361432+0000", 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025172500000000001 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.361771+0000", 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033927799999999999 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.362765+0000", 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00099433799999999999 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.364024+0000", 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012586730000000001 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.364099+0000", 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4742999999999999e-05 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.364161+0000", 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1835999999999995e-05 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.368165+0000", 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.349843497000002, 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027605680000000001, 2024-04-26T07:49:23.819 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 883 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368165+0000", 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368165+0000", 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368167+0000", 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5570000000000001e-06 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368175+0000", 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5930000000000006e-06 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368200+0000", 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4244e-05 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368212+0000", 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.238e-05 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368322+0000", 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109659 2024-04-26T07:49:23.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368551+0000", 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022918400000000001 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.368918+0000", 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036705100000000002 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.370009+0000", 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010907309999999999 2024-04-26T07:49:23.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.370767+0000", 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000758317 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.370858+0000", 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0802000000000002e-05 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.370926+0000", 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8050000000000001e-05 2024-04-26T07:49:23.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.439122+0000", 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.278886137000001, 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002942109, 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 913 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439122+0000", 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439122+0000", 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439125+0000", 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.43e-06 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439137+0000", 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1929999999999999e-05 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439168+0000", 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1479000000000001e-05 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439184+0000", 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5247e-05 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439329+0000", 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000145062 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439569+0000", 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000240685 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.439887+0000", 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031806400000000001 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.440872+0000", 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00098446899999999997 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.441922+0000", 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010505779999999999 2024-04-26T07:49:23.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.442002+0000", 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9178999999999995e-05 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.442065+0000", 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2985999999999996e-05 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.466762+0000", 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.251246772000002, 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027281950000000001, 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 925 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.466762+0000", 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.466762+0000", 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.466764+0000", 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2330000000000001e-06 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.466776+0000", 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1884e-05 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.466807+0000", 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1123e-05 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.466822+0000", 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5265999999999999e-05 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.466935+0000", 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011260900000000001 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.467155+0000", 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021994500000000001 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.467468+0000", 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031334100000000002 2024-04-26T07:49:23.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.468487+0000", 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001018938 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.469347+0000", 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00086014999999999996 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.469430+0000", 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2868999999999996e-05 2024-04-26T07:49:23.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.469490+0000", 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9837000000000003e-05 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:23.836 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:23.837 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:23.837 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:23.838 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:23.838 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:23.839 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:23.839 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:23.840 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:23.840 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:23.840 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:23.840 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:23.841 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:23.833+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:23.938 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:23.937+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:23.969 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:23.969 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:23.984 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:24.039 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:24.037+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:24.105 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:24.106 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:24.120 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:24.163 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:24.163+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:24.242 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:24.241+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:24.244 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:24.244 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:24.258 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:24.343 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:24.341+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:24.426 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:24.426 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:24.440 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:24.487 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:24.487+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:24.545 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:24.543+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:24.558 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:24.558 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:24.572 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:24.646 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:24.644+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:24.738 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:24.739 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:24.746 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:24.744+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:24.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:24.848 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:24.844+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:24.879 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:24.879 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:24.894 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:24.948 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:24.947+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:25.015 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:25.015 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:25.029 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:25.049 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:25.044+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:25.053 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:49:25.150 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:25.147+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:25.197 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:25.197 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:25.211 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:25.259 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:25.259+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:25.323 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:25.323 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:25.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr:Note: switching to '5bfac0af933f1833ec096c3048e2c80e20507e52'. 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T07:49:25.349 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr: git switch -c 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr:Or undo this operation with: 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr: git switch - 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-26T07:49:25.350 INFO:tasks.workunit.client.0.smithi053.stderr:HEAD is now at 5bfac0af933 add the option rgw_s3select_disable(boolean). upon turning-on this option, it rejects s3select-requests with an error-message 2024-04-26T07:49:25.353 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:25.348+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:25.354 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T07:49:25.406 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:49:25.406 INFO:tasks.workunit.client.0.smithi053.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T07:49:25.409 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T07:49:25.409 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T07:49:25.451 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:25.451 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:25.453 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:25.451+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:25.463 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:25.555 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:25.551+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:25.616 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:25.617 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:25.630 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:25.655 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:25.655+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:25.748 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:25.749 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:25.756 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:25.755+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:25.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:25.842 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:25.857 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:25.855+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:25.872 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:25.873 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:25.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:25.978 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:25.976+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:25.981 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:25.982 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:26.002 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:26.003 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:26.019 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:26.035 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:26.035 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.489262070000002, 2024-04-26T07:49:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089363580000000001, 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:26.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559513+0000", 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559516+0000", 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3180000000000001e-06 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559526+0000", 2024-04-26T07:49:26.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8190000000000003e-06 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559547+0000", 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1675000000000002e-05 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.559563+0000", 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5582000000000001e-05 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561240+0000", 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676978 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.561260+0000", 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0590000000000001e-05 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568285+0000", 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070247670000000003 2024-04-26T07:49:26.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.568450+0000", 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016462900000000001 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.438633445000001, 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030230650000000001, 2024-04-26T07:49:26.054 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 38 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610142+0000", 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610144+0000", 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.517e-06 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610152+0000", 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5820000000000002e-06 2024-04-26T07:49:26.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610171+0000", 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8621e-05 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610180+0000", 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9029999999999993e-06 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610293+0000", 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113552 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610492+0000", 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000199008 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.610724+0000", 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023223499999999999 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.611841+0000", 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011162769999999999 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613006+0000", 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001165475 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613098+0000", 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1608999999999997e-05 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.613165+0000", 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7286000000000006e-05 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:50 7.15 e26/25 7:a93a5511:::notify.2:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.451301336, 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029468020000000001, 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.060 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597474+0000", 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597475+0000", 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2600000000000002e-07 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597485+0000", 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8600000000000005e-06 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597524+0000", 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9156999999999998e-05 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597545+0000", 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1625999999999999e-05 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597750+0000", 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020436900000000001 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.597798+0000", 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7732999999999999e-05 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600300+0000", 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025022859999999998 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.600421+0000", 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121045 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:26.064 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.338026913999997, 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030667120000000001, 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 193 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710749+0000", 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710751+0000", 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2529999999999999e-06 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710763+0000", 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.225e-05 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710795+0000", 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2286999999999998e-05 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710810+0000", 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5102999999999999e-05 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.710951+0000", 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014038899999999999 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711181+0000", 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022999199999999999 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.711433+0000", 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025236200000000001 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.712618+0000", 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184596 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713695+0000", 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001076975 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713765+0000", 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0396999999999997e-05 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.713815+0000", 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0108000000000002e-05 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.435759146999999, 2024-04-26T07:49:26.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044673070000000002, 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 208 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613016+0000", 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613019+0000", 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613032+0000", 2024-04-26T07:49:26.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3390000000000001e-05 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613059+0000", 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6369000000000001e-05 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613073+0000", 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613182+0000", 2024-04-26T07:49:26.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108902 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613370+0000", 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018796899999999999 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.613779+0000", 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040870700000000002 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.614995+0000", 2024-04-26T07:49:26.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012161030000000001 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617272+0000", 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022775450000000002 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617365+0000", 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2866000000000002e-05 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.617484+0000", 2024-04-26T07:49:26.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011849900000000001 2024-04-26T07:49:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:26.076 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.417384900000002, 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033767699999999999, 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 212 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631391+0000", 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631393+0000", 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1600000000000001e-06 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631403+0000", 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0757000000000001e-05 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631434+0000", 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0685999999999997e-05 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631452+0000", 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8289999999999999e-05 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631578+0000", 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012580499999999999 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.631799+0000", 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221072 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.632219+0000", 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041983999999999999 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.633745+0000", 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015256410000000001 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634566+0000", 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000821234 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634652+0000", 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5521999999999999e-05 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.634767+0000", 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115763 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.391439597999998, 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.082 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:49:26.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:49:26.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.366433417000003, 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037018250000000002, 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 224 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682342+0000", 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682344+0000", 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3199999999999998e-06 2024-04-26T07:49:26.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682358+0000", 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3223e-05 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682389+0000", 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1819000000000001e-05 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682404+0000", 2024-04-26T07:49:26.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4773000000000001e-05 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682559+0000", 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015474900000000001 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.682925+0000", 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000365724 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.683728+0000", 2024-04-26T07:49:26.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000803096 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685343+0000", 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016147939999999999 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685828+0000", 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048552900000000001 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.685924+0000", 2024-04-26T07:49:26.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5488999999999993e-05 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.686044+0000", 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120309 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.331894145, 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031929739999999999, 2024-04-26T07:49:26.093 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 233 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716881+0000", 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716884+0000", 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5799999999999999e-06 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716896+0000", 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2013e-05 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716928+0000", 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1739000000000002e-05 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.716942+0000", 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4367e-05 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717058+0000", 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116239 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717283+0000", 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022485499999999999 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.717719+0000", 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043577999999999998 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719168+0000", 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001449021 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719862+0000", 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069427499999999995 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.719954+0000", 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1939000000000002e-05 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.720074+0000", 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120166 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:320 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.302088546, 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041265579999999998, 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 320 2024-04-26T07:49:26.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746687+0000", 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746689+0000", 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.75e-06 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746697+0000", 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4770000000000003e-06 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746719+0000", 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1543e-05 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746730+0000", 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1041e-05 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746802+0000", 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.237e-05 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.746936+0000", 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013430000000000001 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747126+0000", 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018941100000000001 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.747902+0000", 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00077641500000000003 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750700+0000", 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002797875 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750759+0000", 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8622999999999998e-05 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.750813+0000", 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4753000000000002e-05 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:392 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.104 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.284405790999998, 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003372562, 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 392 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764370+0000", 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764371+0000", 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0699999999999999e-06 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764376+0000", 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4530000000000001e-06 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764391+0000", 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4327e-05 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764398+0000", 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6650000000000003e-06 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764458+0000", 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9580000000000002e-05 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764518+0000", 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9833000000000001e-05 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.764632+0000", 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114765 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.765112+0000", 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047932900000000002 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767688+0000", 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002576339 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767719+0000", 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1307999999999999e-05 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.767742+0000", 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2892999999999999e-05 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:481 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.235417138999999, 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029129989999999999, 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.110 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 481 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813358+0000", 2024-04-26T07:49:26.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813359+0000", 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2399999999999997e-07 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813363+0000", 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7699999999999999e-06 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813373+0000", 2024-04-26T07:49:26.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0564000000000001e-05 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813378+0000", 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9869999999999999e-06 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813431+0000", 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2601e-05 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813486+0000", 2024-04-26T07:49:26.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5525000000000001e-05 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.813616+0000", 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129195 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.814126+0000", 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051048 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816215+0000", 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020892279999999998 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816247+0000", 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1523000000000003e-05 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.816271+0000", 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4402000000000001e-05 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.035047962999997, 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030638950000000001, 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 733 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.116 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013727+0000", 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013730+0000", 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.723e-06 2024-04-26T07:49:26.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013742+0000", 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2099999999999999e-05 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013774+0000", 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1686000000000001e-05 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013791+0000", 2024-04-26T07:49:26.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7433000000000001e-05 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.013903+0000", 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111562 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014125+0000", 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000221962 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.014446+0000", 2024-04-26T07:49:26.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032154800000000001 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.015730+0000", 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012836189999999999 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016636+0000", 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090594600000000003 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016725+0000", 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8945999999999998e-05 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.016791+0000", 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6370000000000003e-05 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.885956436000001, 2024-04-26T07:49:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031006810000000001, 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 796 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162819+0000", 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162821+0000", 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2000000000000001e-06 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162832+0000", 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1123e-05 2024-04-26T07:49:26.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162863+0000", 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1053000000000002e-05 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.162878+0000", 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4627000000000001e-05 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163055+0000", 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017737800000000001 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163271+0000", 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021579100000000001 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.163582+0000", 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031048799999999999 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.164646+0000", 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064391 2024-04-26T07:49:26.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165770+0000", 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001123895 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165858+0000", 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7604999999999999e-05 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.165920+0000", 2024-04-26T07:49:26.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2130000000000003e-05 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.881883633000001, 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030619419999999998, 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.127 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 798 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166892+0000", 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166894+0000", 2024-04-26T07:49:26.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0669999999999999e-06 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166905+0000", 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0689999999999999e-05 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166931+0000", 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5982e-05 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.166943+0000", 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2269999999999999e-05 2024-04-26T07:49:26.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167088+0000", 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144983 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167220+0000", 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000131989 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:26.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.167484+0000", 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026388399999999998 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.168382+0000", 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00089864600000000002 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169799+0000", 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014165250000000001 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169885+0000", 2024-04-26T07:49:26.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6629e-05 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.169954+0000", 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8276999999999997e-05 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.863613368000003, 2024-04-26T07:49:26.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029491159999999999, 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 805 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185162+0000", 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185164+0000", 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2800000000000002e-06 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185176+0000", 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1576000000000001e-05 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185207+0000", 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0657000000000001e-05 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185224+0000", 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6943e-05 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185347+0000", 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012364200000000001 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185557+0000", 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000209385 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.185867+0000", 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031047799999999999 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.186792+0000", 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092501900000000001 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.187956+0000", 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011643210000000001 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188043+0000", 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6621999999999998e-05 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.188111+0000", 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8193000000000003e-05 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.137 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.795117771999998, 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002965442, 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.138 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 834 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253658+0000", 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253659+0000", 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.813e-06 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253669+0000", 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5529999999999998e-06 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253695+0000", 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5542999999999999e-05 2024-04-26T07:49:26.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253707+0000", 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2320000000000001e-05 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253850+0000", 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143356 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.253974+0000", 2024-04-26T07:49:26.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012351899999999999 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.254248+0000", 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000274104 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.255127+0000", 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00087949999999999996 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256473+0000", 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013458890000000001 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256560+0000", 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7206000000000005e-05 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.256623+0000", 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2638999999999994e-05 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.636780162999997, 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034075350000000002, 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.144 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 901 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411995+0000", 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.411998+0000", 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412011+0000", 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2873e-05 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412042+0000", 2024-04-26T07:49:26.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1168999999999999e-05 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412058+0000", 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5480000000000001e-05 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412219+0000", 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016089899999999999 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.412592+0000", 2024-04-26T07:49:26.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037354 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.413172+0000", 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00057962499999999995 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.414322+0000", 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001149705 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415207+0000", 2024-04-26T07:49:26.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00088520199999999997 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415294+0000", 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6860000000000005e-05 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.415403+0000", 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010914200000000001 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.632061991999997, 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033765959999999999, 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 903 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416713+0000", 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416716+0000", 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.08e-06 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416729+0000", 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.378e-05 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416762+0000", 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3173000000000002e-05 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416777+0000", 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4873e-05 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.416907+0000", 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417143+0000", 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023651499999999999 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.417631+0000", 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048777599999999999 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.418763+0000", 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011318599999999999 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419805+0000", 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001041742 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.419970+0000", 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016569499999999999 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.420090+0000", 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119553 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.531511879999996, 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003600907, 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.155 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 946 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517264+0000", 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517266+0000", 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2730000000000001e-06 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517278+0000", 2024-04-26T07:49:26.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1987000000000001e-05 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517310+0000", 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1843e-05 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517325+0000", 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5197e-05 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517439+0000", 2024-04-26T07:49:26.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113785 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517663+0000", 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022453499999999999 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.517999+0000", 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033559099999999999 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.519130+0000", 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001131544 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520581+0000", 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014505950000000001 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520744+0000", 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016345199999999999 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.520864+0000", 2024-04-26T07:49:26.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120105 2024-04-26T07:49:26.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.161 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.161 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.161 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:26.162 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:26.162 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:26.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:26.163 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:26.164 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:26.164 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:26.164 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:26.164 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:26.165 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:26.166 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T07:49:26.166 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:26.159+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:26.223 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T07:49:26.263 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:26.260+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:26.264 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T07:49:26.265 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T07:49:26.265 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T07:49:26.304 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T07:49:26.307 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-26T07:49:26.307 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T07:49:26.323 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:26.323 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:26.323 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:26.323 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:26.327 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-04-26T07:49:26.329 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-04-26T07:49:26.329 DEBUG:teuthology.orchestra.run.smithi053:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5bfac0af933f1833ec096c3048e2c80e20507e52 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-04-26T07:49:26.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:26.364 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:26.363+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:26.465 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:26.463+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:26.498 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:26.498 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:26.498 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:26.498 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:26.498 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:26.512 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:26.566 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:26.563+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:26.648 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:26.648 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:26.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:26.648 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:26.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.648 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4449.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 61.025332216999999, 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026678100000000001, 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4449", 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/1845071944", 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 42 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620177+0000", 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620179+0000", 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2400000000000002e-06 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620193+0000", 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3886000000000001e-05 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620222+0000", 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8736000000000001e-05 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620243+0000", 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0832e-05 2024-04-26T07:49:26.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620365+0000", 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012243700000000001 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620549+0000", 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018372899999999999 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.620684+0000", 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135723 2024-04-26T07:49:26.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.621541+0000", 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085632299999999998 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622750+0000", 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001209168 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622801+0000", 2024-04-26T07:49:26.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0991e-05 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:25.622845+0000", 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3745000000000002e-05 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.043785104999998, 2024-04-26T07:49:26.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0056514750000000004, 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 52 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601727+0000", 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.163e-06 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601761+0000", 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3847999999999998e-05 2024-04-26T07:49:26.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602013+0000", 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025215399999999998 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602102+0000", 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9066000000000004e-05 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602273+0000", 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000171182 2024-04-26T07:49:26.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602651+0000", 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037720000000000001 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602995+0000", 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000344247 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.604820+0000", 2024-04-26T07:49:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018254160000000001 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607233+0000", 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024128230000000001 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607309+0000", 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6224999999999996e-05 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607376+0000", 2024-04-26T07:49:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6150999999999997e-05 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.918181068000003, 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031921969999999999, 2024-04-26T07:49:26.660 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 236 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727332+0000", 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4869999999999998e-06 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727346+0000", 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4836e-05 2024-04-26T07:49:26.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727380+0000", 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3692999999999997e-05 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727400+0000", 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9979999999999998e-05 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727531+0000", 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130949 2024-04-26T07:49:26.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727788+0000", 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025688499999999999 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.728200+0000", 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041179900000000002 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.729730+0000", 2024-04-26T07:49:26.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001530572 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730356+0000", 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062611800000000005 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730446+0000", 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9319000000000003e-05 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730520+0000", 2024-04-26T07:49:26.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4559000000000002e-05 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.904641257000002, 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028999310000000001, 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.666 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 283 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740869+0000", 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.155e-06 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740884+0000", 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.543e-05 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740899+0000", 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4533e-05 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740905+0000", 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4010000000000002e-06 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740970+0000", 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4888000000000006e-05 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741087+0000", 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116388 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741223+0000", 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013601800000000001 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741950+0000", 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072763400000000001 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743680+0000", 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017300309999999999 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743719+0000", 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8732000000000001e-05 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743768+0000", 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8721000000000003e-05 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.671 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.608307105000002, 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028979790000000002, 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 742 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:26.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037205+0000", 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.683e-06 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037217+0000", 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2347000000000001e-05 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037249+0000", 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1652999999999997e-05 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037264+0000", 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5053e-05 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037398+0000", 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134449 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037637+0000", 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000238388 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037984+0000", 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000347401 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039386+0000", 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001402375 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039941+0000", 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00055470499999999996 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040031+0000", 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9870000000000005e-05 2024-04-26T07:49:26.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040100+0000", 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9054999999999995e-05 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.567658768999998, 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026953580000000001, 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.677 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 760 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077853+0000", 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2199999999999999e-06 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077864+0000", 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.136e-05 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077895+0000", 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1380000000000001e-05 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077910+0000", 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4683e-05 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078033+0000", 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012319499999999999 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078253+0000", 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021987499999999999 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078568+0000", 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031487099999999999 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.079737+0000", 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001169364 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080396+0000", 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065863100000000002 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080482+0000", 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5673000000000005e-05 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080546+0000", 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4105999999999999e-05 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.682 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.563978958999996, 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026454019999999998, 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.683 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 762 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081530+0000", 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081532+0000", 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081560+0000", 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8153e-05 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081592+0000", 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1757000000000001e-05 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081611+0000", 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8626000000000001e-05 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081721+0000", 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110296 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.081849+0000", 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012843199999999999 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.082121+0000", 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027200800000000002 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.083234+0000", 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011123769999999999 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084026+0000", 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079225400000000005 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084109+0000", 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2641999999999999e-05 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.084176+0000", 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7037000000000002e-05 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.688 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.430315989999997, 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026859850000000001, 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 817 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215193+0000", 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215197+0000", 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.444e-06 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215210+0000", 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3016e-05 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215241+0000", 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1050000000000003e-05 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215256+0000", 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5293000000000001e-05 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215390+0000", 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013440199999999999 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215620+0000", 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022916200000000001 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.215891+0000", 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027189100000000002 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217059+0000", 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011680670000000001 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217578+0000", 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051814600000000004 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217748+0000", 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017023200000000001 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.217879+0000", 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013128200000000001 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.694 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.426501827000003, 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030863079999999998, 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 819 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219009+0000", 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6300000000000001e-06 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219018+0000", 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7830000000000004e-06 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219043+0000", 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4902999999999999e-05 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219055+0000", 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2733e-05 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219187+0000", 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013202600000000001 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219416+0000", 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000228595 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219921+0000", 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00050526200000000003 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221111+0000", 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001189264 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221824+0000", 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071316700000000001 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221979+0000", 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015522600000000001 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.222094+0000", 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114719 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.374635562999998, 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033639400000000002, 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.700 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 841 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270876+0000", 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5239999999999999e-06 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270888+0000", 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.239e-05 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270919+0000", 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0386e-05 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270937+0000", 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8023e-05 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271091+0000", 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153802 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271447+0000", 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035622099999999999 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.272032+0000", 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058492799999999997 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273324+0000", 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012923559999999999 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273958+0000", 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063414899999999998 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274114+0000", 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015607800000000001 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274238+0000", 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012308299999999999 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.370070812999998, 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031880070000000001, 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 843 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275441+0000", 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2129999999999998e-06 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275451+0000", 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0727000000000001e-05 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275483+0000", 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2011999999999998e-05 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275504+0000", 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0267000000000001e-05 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275646+0000", 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014206900000000001 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275879+0000", 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000233315 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.276359+0000", 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048021899999999999 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.277529+0000", 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011702609999999999 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278354+0000", 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00082486600000000005 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278506+0000", 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015169599999999999 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278626+0000", 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120362 2024-04-26T07:49:26.711 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.359978687999998, 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027584929999999999, 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.712 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 847 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285533+0000", 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3159999999999999e-06 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285544+0000", 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1253999999999999e-05 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285575+0000", 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0738999999999998e-05 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285589+0000", 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4343e-05 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285702+0000", 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112649 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285921+0000", 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021945499999999999 2024-04-26T07:49:26.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.286238+0000", 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031702400000000001 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.287549+0000", 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001310879 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288004+0000", 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045514399999999999 2024-04-26T07:49:26.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288167+0000", 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016323100000000001 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288289+0000", 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121459 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.356095136999997, 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002936106, 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 849 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289416+0000", 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7129999999999999e-06 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289425+0000", 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6369999999999994e-06 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289450+0000", 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4433000000000001e-05 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289462+0000", 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1956999999999999e-05 2024-04-26T07:49:26.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289591+0000", 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289827+0000", 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023558800000000001 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.290310+0000", 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048358899999999998 2024-04-26T07:49:26.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.291493+0000", 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001182324 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292082+0000", 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058951499999999998 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292242+0000", 2024-04-26T07:49:26.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159309 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292350+0000", 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108492 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.311488937999997, 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026241229999999999, 2024-04-26T07:49:26.723 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 868 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334020+0000", 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334022+0000", 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8610000000000001e-06 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334031+0000", 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3759999999999997e-06 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334055+0000", 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3272999999999999e-05 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334066+0000", 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1498000000000001e-05 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334185+0000", 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118355 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334409+0000", 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022421499999999999 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.334721+0000", 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031224699999999998 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336020+0000", 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012986829999999999 2024-04-26T07:49:26.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336496+0000", 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00047615 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336578+0000", 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2452000000000003e-05 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.336644+0000", 2024-04-26T07:49:26.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6013000000000006e-05 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.218208202, 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032794199999999999, 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.729 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 907 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427303+0000", 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.446e-06 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427315+0000", 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1707e-05 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427348+0000", 2024-04-26T07:49:26.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2642999999999999e-05 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427363+0000", 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5037e-05 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427519+0000", 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015594200000000001 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427915+0000", 2024-04-26T07:49:26.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039595599999999999 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.428501+0000", 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058595900000000005 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.429998+0000", 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014978210000000001 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430311+0000", 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031217400000000002 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430468+0000", 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015785500000000001 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430580+0000", 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011188000000000001 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.213785168000001, 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002976916, 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 909 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431726+0000", 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8759999999999999e-06 2024-04-26T07:49:26.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431735+0000", 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.577e-06 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431761+0000", 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5117e-05 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431773+0000", 2024-04-26T07:49:26.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2526e-05 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431878+0000", 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010459300000000001 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432020+0000", 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014283899999999999 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432300+0000", 2024-04-26T07:49:26.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279664 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.433338+0000", 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001038115 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434437+0000", 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001098878 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434590+0000", 2024-04-26T07:49:26.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015255800000000001 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434701+0000", 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111173 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.120939597000003, 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026912619999999998, 2024-04-26T07:49:26.740 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 949 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524570+0000", 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524572+0000", 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4870000000000001e-06 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524584+0000", 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.242e-05 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524615+0000", 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0156000000000001e-05 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524630+0000", 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5327000000000001e-05 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.524785+0000", 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015463799999999999 2024-04-26T07:49:26.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525023+0000", 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023835800000000001 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.525339+0000", 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031561799999999999 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.526523+0000", 2024-04-26T07:49:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001184367 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527111+0000", 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058795500000000003 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527193+0000", 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2459000000000005e-05 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.527261+0000", 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7477000000000005e-05 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.117308072999997, 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025643620000000002, 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.746 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 951 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528201+0000", 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528203+0000", 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5600000000000001e-06 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528211+0000", 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8060000000000001e-06 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528236+0000", 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4933999999999999e-05 2024-04-26T07:49:26.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528249+0000", 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2935999999999999e-05 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528348+0000", 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8822999999999999e-05 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528473+0000", 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012490900000000001 2024-04-26T07:49:26.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.528743+0000", 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026996099999999999 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.529961+0000", 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012176299999999999 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530617+0000", 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065623799999999996 2024-04-26T07:49:26.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530701+0000", 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4419000000000006e-05 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.530765+0000", 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4146000000000006e-05 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.751 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.103009882999999, 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002689145, 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 955 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542499+0000", 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542501+0000", 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1639999999999999e-06 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542513+0000", 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1456e-05 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542543+0000", 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0190000000000001e-05 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542558+0000", 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4866e-05 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542681+0000", 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012343200000000001 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.542905+0000", 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223155 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.543219+0000", 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031459800000000003 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.544603+0000", 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013838489999999999 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545039+0000", 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043600300000000002 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545124+0000", 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4999000000000004e-05 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.545188+0000", 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4432999999999998e-05 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.099433222000002, 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026964580000000001, 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:26.757 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 957 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:26.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546078+0000", 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0700000000000001e-06 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546088+0000", 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0067e-05 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546118+0000", 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0429999999999998e-05 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546136+0000", 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7520000000000002e-05 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:26.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546252+0000", 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115945 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546400+0000", 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014764199999999999 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546672+0000", 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027279099999999998 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.547902+0000", 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001230014 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548616+0000", 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071360399999999995 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548707+0000", 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1372999999999994e-05 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:26.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:26.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548772+0000", 2024-04-26T07:49:26.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5001999999999999e-05 2024-04-26T07:49:26.763 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.763 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.763 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.763 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:26.763 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:26.763 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:26.765 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:26.765 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records in 2024-04-26T07:49:26.765 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records out 2024-04-26T07:49:26.765 INFO:tasks.workunit.client.0.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00895566 s, 1.2 GB/s 2024-04-26T07:49:26.765 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:26.760+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:26.865 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:26.860+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:26.887 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_26 2024-04-26T07:49:26.923 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:26.923 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:26.923 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:26.923 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:26.939 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:26.967 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:26.963+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:27.041 INFO:tasks.workunit.client.0.smithi053.stdout:quota set for the bucket: buck_2024_03_26_07_49_26 2024-04-26T07:49:27.067 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:27.064+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:27.096 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:27.096 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:27.096 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:27.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:27.198 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:27.196+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:27.269 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:27.264+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 59.700398268999997, 2024-04-26T07:49:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012204097000000001, 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 44 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571159+0000", 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7500000000000001e-06 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571176+0000", 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7359000000000001e-05 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571214+0000", 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7942999999999999e-05 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571240+0000", 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6084e-05 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571398+0000", 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015818000000000001 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571415+0000", 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6739e-05 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583000+0000", 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011585332 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583359+0000", 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035870999999999999 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.661252832000002, 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003073423, 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 56 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610304+0000", 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1540000000000002e-06 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610315+0000", 2024-04-26T07:49:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1596e-05 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610348+0000", 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2379999999999998e-05 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610364+0000", 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6466000000000001e-05 2024-04-26T07:49:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610544+0000", 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179963 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610849+0000", 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030534099999999999 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.611143+0000", 2024-04-26T07:49:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029372300000000002 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.612446+0000", 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013032129999999999 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613250+0000", 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080378299999999997 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613319+0000", 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8774000000000003e-05 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613374+0000", 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.503e-05 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596391211392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.658008791, 2024-04-26T07:49:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033841380000000001, 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 57 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613546+0000", 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7770000000000001e-06 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613554+0000", 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7789999999999996e-06 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613578+0000", 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4236999999999999e-05 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613592+0000", 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4106e-05 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613725+0000", 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013219999999999999 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613921+0000", 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019679800000000001 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.614275+0000", 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035357100000000001 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.615361+0000", 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010861880000000001 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616713+0000", 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013521900000000001 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616818+0000", 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010427 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616929+0000", 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111022 2024-04-26T07:49:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.663371746000003, 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045711500000000004, 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 207 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608185+0000", 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2270000000000002e-06 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608199+0000", 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4049999999999999e-05 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608231+0000", 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608247+0000", 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6696000000000001e-05 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608402+0000", 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015428499999999999 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608762+0000", 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036012099999999998 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.609476+0000", 2024-04-26T07:49:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071385399999999999 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612197+0000", 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027211480000000001 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612606+0000", 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040884 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612688+0000", 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1935999999999996e-05 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612753+0000", 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5075999999999998e-05 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.625337481999999, 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003481442, 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 216 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646219+0000", 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8430000000000001e-06 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646232+0000", 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.358e-05 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646268+0000", 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5846999999999997e-05 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646295+0000", 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6752999999999999e-05 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646431+0000", 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013639500000000001 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646656+0000", 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022519900000000001 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.647143+0000", 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487009 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649075+0000", 2024-04-26T07:49:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019313640000000001 2024-04-26T07:49:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649552+0000", 2024-04-26T07:49:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000476959 2024-04-26T07:49:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649634+0000", 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1877000000000002e-05 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649697+0000", 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3615999999999995e-05 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.577332009000003, 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036454130000000001, 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 227 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694224+0000", 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3099999999999999e-06 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694235+0000", 2024-04-26T07:49:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1559999999999999e-05 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694267+0000", 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694282+0000", 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5150000000000001e-05 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694426+0000", 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144058 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694676+0000", 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024983500000000001 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.695121+0000", 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00044507299999999999 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.696591+0000", 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001469878 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697715+0000", 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011244009999999999 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697800+0000", 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4722000000000006e-05 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697867+0000", 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6508999999999996e-05 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.569895856999999, 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032415780000000002, 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 229 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701660+0000", 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.244e-06 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701671+0000", 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1326e-05 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701703+0000", 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2023999999999997e-05 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701718+0000", 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5133000000000001e-05 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701833+0000", 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114916 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702050+0000", 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216624 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702472+0000", 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042268699999999999 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.703941+0000", 2024-04-26T07:49:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001468128 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704755+0000", 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000814637 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704833+0000", 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8226000000000006e-05 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704899+0000", 2024-04-26T07:49:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5633e-05 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.562896238999997, 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003426648, 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 231 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708659+0000", 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2630000000000002e-06 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708671+0000", 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1379999999999999e-05 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708702+0000", 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1761999999999998e-05 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708719+0000", 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6954000000000001e-05 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708844+0000", 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012488199999999999 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709085+0000", 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000240905 2024-04-26T07:49:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709507+0000", 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042178700000000002 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711076+0000", 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015689530000000001 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711928+0000", 2024-04-26T07:49:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085241699999999995 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712016+0000", 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7219000000000006e-05 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712084+0000", 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8126000000000005e-05 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.264406620999999, 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029394930000000001, 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 730 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007149+0000", 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2500000000000001e-06 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007160+0000", 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1516e-05 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007192+0000", 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1362999999999998e-05 2024-04-26T07:49:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007207+0000", 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5114e-05 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007316+0000", 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109252 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007539+0000", 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022263200000000001 2024-04-26T07:49:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007886+0000", 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034704000000000001 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009051+0000", 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001164881 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009882+0000", 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083153899999999995 2024-04-26T07:49:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009971+0000", 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9183000000000003e-05 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.010086+0000", 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011472300000000001 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.250797896000002, 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028721110000000001, 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 736 2024-04-26T07:49:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020758+0000", 2024-04-26T07:49:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.187e-06 2024-04-26T07:49:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020769+0000", 2024-04-26T07:49:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1263e-05 2024-04-26T07:49:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020800+0000", 2024-04-26T07:49:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.129e-05 2024-04-26T07:49:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020815+0000", 2024-04-26T07:49:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4737e-05 2024-04-26T07:49:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020938+0000", 2024-04-26T07:49:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012298499999999999 2024-04-26T07:49:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.021157+0000", 2024-04-26T07:49:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021933799999999999 2024-04-26T07:49:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.021474+0000", 2024-04-26T07:49:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031639199999999998 2024-04-26T07:49:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.022654+0000", 2024-04-26T07:49:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00118045 2024-04-26T07:49:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023470+0000", 2024-04-26T07:49:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081556700000000001 2024-04-26T07:49:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023556+0000", 2024-04-26T07:49:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6612000000000004e-05 2024-04-26T07:49:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023628+0000", 2024-04-26T07:49:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1290000000000004e-05 2024-04-26T07:49:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.246919247000001, 2024-04-26T07:49:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051848809999999997, 2024-04-26T07:49:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 738 2024-04-26T07:49:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024636+0000", 2024-04-26T07:49:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0999999999999998e-06 2024-04-26T07:49:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024647+0000", 2024-04-26T07:49:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1270000000000001e-05 2024-04-26T07:49:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024679+0000", 2024-04-26T07:49:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1069999999999999e-05 2024-04-26T07:49:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024698+0000", 2024-04-26T07:49:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9887000000000001e-05 2024-04-26T07:49:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024806+0000", 2024-04-26T07:49:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010731899999999999 2024-04-26T07:49:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024938+0000", 2024-04-26T07:49:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013236899999999999 2024-04-26T07:49:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.025208+0000", 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027009700000000001 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.026465+0000", 2024-04-26T07:49:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012567800000000001 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029663+0000", 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003197667 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029751+0000", 2024-04-26T07:49:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8578999999999993e-05 2024-04-26T07:49:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029819+0000", 2024-04-26T07:49:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7743000000000005e-05 2024-04-26T07:49:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.150824172, 2024-04-26T07:49:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003055978, 2024-04-26T07:49:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 778 2024-04-26T07:49:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120731+0000", 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2869999999999999e-06 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120743+0000", 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1656e-05 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120774+0000", 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1309999999999997e-05 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120790+0000", 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5187e-05 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120910+0000", 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119979 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121125+0000", 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000215324 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121440+0000", 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031488499999999999 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.122682+0000", 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001242033 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123599+0000", 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00091723900000000003 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123718+0000", 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119306 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123785+0000", 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6772000000000004e-05 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.093227597000002, 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030101080000000001, 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.357 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 802 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:27.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178328+0000", 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5830000000000001e-06 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178340+0000", 2024-04-26T07:49:27.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1347e-05 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178371+0000", 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1303000000000002e-05 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178386+0000", 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5043e-05 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178500+0000", 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114339 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178722+0000", 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022198199999999999 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.179047+0000", 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000324667 2024-04-26T07:49:27.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.180162+0000", 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001114711 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181123+0000", 2024-04-26T07:49:27.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00096165200000000001 2024-04-26T07:49:27.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181220+0000", 2024-04-26T07:49:27.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7139000000000006e-05 2024-04-26T07:49:27.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181336+0000", 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011534199999999999 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.007642799999999, 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029079560000000002, 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.364 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 838 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263913+0000", 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9929999999999998e-06 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263925+0000", 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.269e-05 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263953+0000", 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7900000000000001e-05 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263967+0000", 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.438e-05 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264085+0000", 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117982 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264310+0000", 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022483099999999999 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264674+0000", 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036400700000000001 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.265887+0000", 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00121247 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266611+0000", 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072435100000000003 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266700+0000", 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412999999999995e-05 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266818+0000", 2024-04-26T07:49:27.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011893899999999999 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.979002530000002, 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029764090000000002, 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.370 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 850 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:27.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292553+0000", 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4399999999999999e-06 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292565+0000", 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.154e-05 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292595+0000", 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0433000000000002e-05 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292613+0000", 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7759999999999999e-05 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292738+0000", 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012527600000000001 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292948+0000", 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020985099999999999 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:27.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.293260+0000", 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031240100000000002 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.294440+0000", 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00117979 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295370+0000", 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092946599999999999 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295460+0000", 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0529e-05 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295527+0000", 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6922999999999996e-05 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.975005938999999, 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029089200000000002, 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.377 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 852 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296550+0000", 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.39e-06 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296563+0000", 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2763e-05 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296593+0000", 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0929999999999997e-05 2024-04-26T07:49:27.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296611+0000", 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7453e-05 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296715+0000", 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000104522 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296846+0000", 2024-04-26T07:49:27.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130066 2024-04-26T07:49:27.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:27.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.297118+0000", 2024-04-26T07:49:27.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027257399999999998 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.298189+0000", 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001071242 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299293+0000", 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001103845 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299388+0000", 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4462000000000005e-05 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299456+0000", 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8672999999999998e-05 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.927530498000003, 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003029908, 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.384 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 873 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344025+0000", 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6959999999999999e-06 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344036+0000", 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1226999999999999e-05 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344061+0000", 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5309000000000001e-05 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344080+0000", 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8853000000000001e-05 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344227+0000", 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014731600000000001 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344358+0000", 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013102900000000001 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344646+0000", 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000287965 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.345790+0000", 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001143926 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346903+0000", 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011127610000000001 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346987+0000", 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4350000000000004e-05 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.347053+0000", 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5475999999999994e-05 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.782764726000003, 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031214210000000001, 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.390 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 934 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:27.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488791+0000", 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6199999999999999e-06 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488806+0000", 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4963000000000001e-05 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488840+0000", 2024-04-26T07:49:27.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3793e-05 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488862+0000", 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2325999999999999e-05 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488994+0000", 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013211899999999999 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489218+0000", 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223482 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489533+0000", 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031546100000000001 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.490516+0000", 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00098278499999999991 2024-04-26T07:49:27.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491625+0000", 2024-04-26T07:49:27.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001108904 2024-04-26T07:49:27.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491793+0000", 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167873 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491910+0000", 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117095 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:936 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.778699946000003, 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002857437, 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 936 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492853+0000", 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492855+0000", 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8199999999999999e-06 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492868+0000", 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2413e-05 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492898+0000", 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.044e-05 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.492915+0000", 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7414e-05 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493014+0000", 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8992000000000004e-05 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493159+0000", 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144046 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.493437+0000", 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027894999999999998 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.494751+0000", 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013136669999999999 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495553+0000", 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000802339 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495648+0000", 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4265999999999995e-05 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495711+0000", 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3089999999999994e-05 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.775610638000003, 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030389750000000002, 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:27.402 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 937 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:27.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495945+0000", 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.84e-06 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495955+0000", 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0787e-05 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495986+0000", 2024-04-26T07:49:27.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1093000000000002e-05 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496005+0000", 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8236e-05 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496127+0000", 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000122069 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496372+0000", 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024480200000000002 2024-04-26T07:49:27.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496723+0000", 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000351357 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.497773+0000", 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001050411 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498698+0000", 2024-04-26T07:49:27.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092447199999999997 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498861+0000", 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016297600000000001 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498982+0000", 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120932 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:27.407 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:27.408 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:27.408 INFO:tasks.workunit.client.0.smithi053.stdout:quota enabled for the bucket: buck_2024_03_26_07_49_26 2024-04-26T07:49:27.409 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 10Mb. 2024-04-26T07:49:27.409 INFO:tasks.workunit.client.0.smithi053.stdout:upload file successful 2024-04-26T07:49:27.409 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:27.409 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - Test max objects passed 2024-04-26T07:49:27.409 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:27.410 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:27.410 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:27.407+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:27.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:49:27.510 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:27.507+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:27.540 INFO:tasks.workunit.client.0.smithi053.stdout:user qa_user deleted 2024-04-26T07:49:27.540 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:27.549 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:27.549 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:27.549 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:27.549 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:27.564 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:27.602 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records in 2024-04-26T07:49:27.602 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records out 2024-04-26T07:49:27.602 INFO:tasks.workunit.client.0.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0585134 s, 179 MB/s 2024-04-26T07:49:27.652 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:27.651+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:27.712 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:27.711+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:27.735 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:27.735 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:27.735 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:27.735 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:27.735 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:27.743 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_27 2024-04-26T07:49:27.751 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:49:27.843 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:27.843+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:27.914 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:27.912+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:27.933 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:46 7.1f e26/25 7:f95f44c2:::notify.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.352514906000003, 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081628929999999992, 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578311+0000", 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2460000000000002e-06 2024-04-26T07:49:27.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578328+0000", 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7090000000000001e-05 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578380+0000", 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.126e-05 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578417+0000", 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7008999999999998e-05 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578579+0000", 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016204899999999999 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578632+0000", 2024-04-26T07:49:27.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3103000000000003e-05 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586350+0000", 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007717944 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586472+0000", 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000122192 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.709822+0000", 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.221001909999998, 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042047630000000003, 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 232 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.939 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709822+0000", 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709822+0000", 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709825+0000", 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0230000000000001e-06 2024-04-26T07:49:27.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709838+0000", 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2480000000000001e-05 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709871+0000", 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3149999999999999e-05 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.709887+0000", 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5858999999999998e-05 2024-04-26T07:49:27.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.710069+0000", 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018238299999999999 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.710285+0000", 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021657800000000001 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.710723+0000", 2024-04-26T07:49:27.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043705000000000003 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.712431+0000", 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017083860000000001 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.713826+0000", 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013952120000000001 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.713916+0000", 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9538999999999998e-05 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.714027+0000", 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111103 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:374 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.753008+0000", 2024-04-26T07:49:27.944 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.177815875, 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042259139999999999, 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 374 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753008+0000", 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753008+0000", 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753010+0000", 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.373e-06 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753022+0000", 2024-04-26T07:49:27.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1853e-05 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753056+0000", 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3377000000000002e-05 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753078+0000", 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2249999999999999e-05 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753501+0000", 2024-04-26T07:49:27.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042283899999999999 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.753686+0000", 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018520900000000001 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.754052+0000", 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036590700000000001 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.755126+0000", 2024-04-26T07:49:27.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010742779999999999 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.756983+0000", 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018566329999999999 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.757129+0000", 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000145747 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.757234+0000", 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105448 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.993061+0000", 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.937763136999997, 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047914869999999997, 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.950 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 726 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993061+0000", 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993061+0000", 2024-04-26T07:49:27.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993062+0000", 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6700000000000001e-06 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993073+0000", 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0186e-05 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993096+0000", 2024-04-26T07:49:27.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2867e-05 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993115+0000", 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9979999999999998e-05 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993219+0000", 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000103082 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993330+0000", 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011117599999999999 2024-04-26T07:49:27.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993580+0000", 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025037200000000001 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.994520+0000", 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00094018699999999999 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997726+0000", 2024-04-26T07:49:27.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032055159999999998 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997795+0000", 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9620000000000001e-05 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997852+0000", 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6830999999999998e-05 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.207671+0000", 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.723153242999999, 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045415459999999996, 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 816 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207671+0000", 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207671+0000", 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207672+0000", 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6029999999999999e-06 2024-04-26T07:49:27.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207680+0000", 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9030000000000004e-06 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207701+0000", 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0754000000000002e-05 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207711+0000", 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0213e-05 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207792+0000", 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0649000000000007e-05 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.207912+0000", 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120362 2024-04-26T07:49:27.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.208172+0000", 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000259588 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.209381+0000", 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012095910000000001 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.212061+0000", 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026794940000000001 2024-04-26T07:49:27.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.212147+0000", 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6277000000000001e-05 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.212212+0000", 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5111999999999996e-05 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1077 4.c 4:31eca341:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868608+0000", 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.062215862, 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047869030000000003, 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1077 2024-04-26T07:49:27.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868608+0000", 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868608+0000", 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868612+0000", 2024-04-26T07:49:27.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6669999999999998e-06 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868626+0000", 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.38e-05 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868668+0000", 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2395999999999999e-05 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868695+0000", 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7046000000000002e-05 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868904+0000", 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020938599999999999 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869270+0000", 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036535799999999998 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869651+0000", 2024-04-26T07:49:27.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038135399999999998 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872630+0000", 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029789370000000001 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873124+0000", 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049395000000000005 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873271+0000", 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014673900000000001 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873395+0000", 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012427 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1081 4.3d 4:bebb386e:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.0620774129999999, 2024-04-26T07:49:27.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066071109999999997, 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1081 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868748+0000", 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.68e-06 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868758+0000", 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4900000000000006e-06 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868781+0000", 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2989999999999998e-05 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868798+0000", 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7686999999999999e-05 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869173+0000", 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037481999999999999 2024-04-26T07:49:27.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869499+0000", 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032565200000000001 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869868+0000", 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036949800000000001 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872636+0000", 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002768005 2024-04-26T07:49:27.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875065+0000", 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024284910000000001 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875199+0000", 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134599 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875354+0000", 2024-04-26T07:49:27.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015419899999999999 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1082 4.22 4:47838f18:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.06193157, 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071607529999999997, 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.973 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1082 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868894+0000", 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3999999999999999e-06 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868902+0000", 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.32e-06 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868922+0000", 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.978e-05 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868938+0000", 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.592e-05 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.870448+0000", 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001510646 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.870736+0000", 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028800800000000002 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871097+0000", 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036016800000000001 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875126+0000", 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040298039999999997 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875884+0000", 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00075710800000000004 2024-04-26T07:49:27.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875982+0000", 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8339999999999997e-05 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.876053+0000", 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1259000000000003e-05 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.978 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1086 4.1 4:8294b3c5:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.0618326149999999, 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070958210000000004, 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1086 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868993+0000", 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6670000000000001e-06 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869002+0000", 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7399999999999993e-06 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869023+0000", 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.126e-05 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869038+0000", 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5113000000000001e-05 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871303+0000", 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022652420000000002 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871601+0000", 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029784800000000003 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872002+0000", 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040058800000000001 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875718+0000", 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037166320000000001 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875893+0000", 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017413899999999999 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875975+0000", 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2542999999999999e-05 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.876087+0000", 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112049 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1111 3.1d e53/17 3:b91fd52e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_2:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.67855211999999998, 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010266506999999999, 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.984 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252274+0000", 2024-04-26T07:49:27.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.08e-06 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254939+0000", 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026646360000000002 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254973+0000", 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4029999999999998e-05 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254989+0000", 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5967000000000001e-05 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.255132+0000", 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014352500000000001 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.255177+0000", 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4916999999999997e-05 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262405+0000", 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007228473 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262538+0000", 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132879 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1199 4.3d 4:bebb386e:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:27.988 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531901+0000", 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.39892339500000001, 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053976919999999999, 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1199 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531901+0000", 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531901+0000", 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531901+0000", 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5099999999999999e-07 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531905+0000", 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0879999999999997e-06 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531916+0000", 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531923+0000", 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4309999999999997e-06 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532040+0000", 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011678799999999999 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532238+0000", 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019811500000000001 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532518+0000", 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000280198 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.534285+0000", 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001766316 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537200+0000", 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002914977 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537252+0000", 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1879999999999998e-05 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537298+0000", 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6653999999999998e-05 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1200 4.22 4:47838f18:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531943+0000", 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.39888101300000001, 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053492440000000004, 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:27.994 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1200 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531943+0000", 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531943+0000", 2024-04-26T07:49:27.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531943+0000", 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7800000000000001e-07 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531947+0000", 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1269999999999999e-06 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531955+0000", 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2560000000000002e-06 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531961+0000", 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0530000000000003e-06 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532087+0000", 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125845 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532260+0000", 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000173363 2024-04-26T07:49:27.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532518+0000", 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025825499999999999 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.536026+0000", 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003507264 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537178+0000", 2024-04-26T07:49:27.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011527250000000001 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537241+0000", 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2949999999999999e-05 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537292+0000", 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0828000000000002e-05 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:27.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1204 4.1 4:8294b3c5:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531986+0000", 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.39883805100000003, 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052555839999999998, 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1204 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:28.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531986+0000", 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531986+0000", 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531986+0000", 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9400000000000005e-07 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531989+0000", 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7310000000000002e-06 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531998+0000", 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3010000000000007e-06 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532004+0000", 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0310000000000004e-06 2024-04-26T07:49:28.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532110+0000", 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010616300000000001 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532232+0000", 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121834 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532372+0000", 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014061999999999999 2024-04-26T07:49:28.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:28.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.534936+0000", 2024-04-26T07:49:28.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025640709999999998 2024-04-26T07:49:28.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:28.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537143+0000", 2024-04-26T07:49:28.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022066439999999998 2024-04-26T07:49:28.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537199+0000", 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6125000000000002e-05 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537241+0000", 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2469999999999998e-05 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1211 4.30 4:0d330af4:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.732659+0000", 2024-04-26T07:49:28.006 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.19816451099999999, 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050250750000000004, 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1211 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732659+0000", 2024-04-26T07:49:28.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732659+0000", 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732660+0000", 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2999999999999999e-07 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732665+0000", 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1359999999999996e-06 2024-04-26T07:49:28.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732676+0000", 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0706999999999999e-05 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732684+0000", 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2919999999999996e-06 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732758+0000", 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3776999999999995e-05 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732918+0000", 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000160221 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733105+0000", 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186794 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734650+0000", 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001544669 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737600+0000", 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002950303 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737640+0000", 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0105999999999999e-05 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737684+0000", 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4240000000000003e-05 2024-04-26T07:49:28.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1213 4.1 4:80ac3107:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.732705+0000", 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.198118611, 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049801439999999997, 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:28.012 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1213 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732705+0000", 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732705+0000", 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732706+0000", 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8400000000000004e-07 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732710+0000", 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3939999999999998e-06 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732720+0000", 2024-04-26T07:49:28.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0020999999999999e-05 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732728+0000", 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.379e-06 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732811+0000", 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3502000000000001e-05 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732945+0000", 2024-04-26T07:49:28.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013340300000000001 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733116+0000", 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017107600000000001 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734851+0000", 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001735339 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737530+0000", 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026792159999999999 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737632+0000", 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010173799999999999 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737685+0000", 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3392e-05 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1214 4.18 4:19ac740b:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.732749+0000", 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.198074467, 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054314009999999998, 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:28.018 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1214 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732749+0000", 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732749+0000", 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:28.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732750+0000", 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732754+0000", 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8139999999999998e-06 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732764+0000", 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9259999999999995e-06 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732771+0000", 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1280000000000002e-06 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733416+0000", 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00064522899999999998 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733528+0000", 2024-04-26T07:49:28.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011150300000000001 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733687+0000", 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015970599999999999 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737594+0000", 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039065970000000004 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.738058+0000", 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000464072 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.738128+0000", 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9680999999999999e-05 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.738181+0000", 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3114e-05 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1215 4.30 4:0cf91bb5:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.732788+0000", 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.19803563199999999, 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050805499999999996, 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1215 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:28.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732788+0000", 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732788+0000", 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732789+0000", 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2900000000000003e-07 2024-04-26T07:49:28.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732793+0000", 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0600000000000001e-06 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732802+0000", 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0480000000000004e-06 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732813+0000", 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0959e-05 2024-04-26T07:49:28.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734024+0000", 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012104189999999999 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734146+0000", 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000122378 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734302+0000", 2024-04-26T07:49:28.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015635200000000001 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.735174+0000", 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00087202199999999997 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737721+0000", 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025467469999999998 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737808+0000", 2024-04-26T07:49:28.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6835000000000005e-05 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737869+0000", 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1001000000000001e-05 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1218 4.1b 4:dba1a29a:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.732824+0000", 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.19800014799999999, 2024-04-26T07:49:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047902700000000001, 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1218 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732824+0000", 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732824+0000", 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732824+0000", 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4000000000000001e-07 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732828+0000", 2024-04-26T07:49:28.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8929999999999998e-06 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732838+0000", 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4069999999999999e-06 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732845+0000", 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.126e-06 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732965+0000", 2024-04-26T07:49:28.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120523 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733148+0000", 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000182518 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733363+0000", 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000214911 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734617+0000", 2024-04-26T07:49:28.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012540229999999999 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737500+0000", 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028830290000000001 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737550+0000", 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0194000000000001e-05 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:28.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737614+0000", 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4005999999999997e-05 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1220 4.18 4:19860ea6:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.732863+0000", 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.19796076500000001, 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054626739999999998, 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:28.035 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1220 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732863+0000", 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732863+0000", 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732864+0000", 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2099999999999997e-07 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732868+0000", 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5560000000000001e-06 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732878+0000", 2024-04-26T07:49:28.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5340000000000005e-06 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732887+0000", 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4860000000000003e-06 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734003+0000", 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001115752 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:28.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734120+0000", 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000116493 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.734279+0000", 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015949599999999999 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737699+0000", 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034202730000000001 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:28.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.738228+0000", 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00052912599999999999 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.738280+0000", 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1697999999999999e-05 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.738326+0000", 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5738999999999997e-05 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4775.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.830793+0000", 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.10003058200000001, 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043727369999999998, 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4775", 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/4266234575", 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 42 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:28.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.830793+0000", 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.830793+0000", 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.830796+0000", 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.249e-06 2024-04-26T07:49:28.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.830805+0000", 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0569999999999999e-06 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.830825+0000", 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0259e-05 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.830834+0000", 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7900000000000005e-06 2024-04-26T07:49:28.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.830911+0000", 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7033000000000006e-05 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.830920+0000", 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4040000000000001e-06 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835036+0000", 2024-04-26T07:49:28.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041160199999999997 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835166+0000", 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129925 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:28.045 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:28.046 INFO:tasks.workunit.client.0.smithi053.stdout:bucket quota max_objs set for the given user: buck_2024_03_26_07_49_27 2024-04-26T07:49:28.047 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:28.047 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:28.044+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:28.147 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:28.144+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:28.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:28.227 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:28.227 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:28.243 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:28.270 INFO:tasks.workunit.client.0.smithi053.stdout:quota enabled for the bucket: buck_2024_03_26_07_49_27 2024-04-26T07:49:28.270 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 10Mb. 2024-04-26T07:49:28.270 INFO:tasks.workunit.client.0.smithi053.stdout:upload file successful 2024-04-26T07:49:28.270 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:28.270 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - Test max objects for the given user passed 2024-04-26T07:49:28.270 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:28.287 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:28.287+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:28.312 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:28.312 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:28.329 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:28.330 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:28.348 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:28.349 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:28.347+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:28.364 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:28.365 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:28.371 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:28.371 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:28.372 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:28.372 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:28.372 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:28.387 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:28.388 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:28.389 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:28.410 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:28.410 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:28.431 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:28.432 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:28.450 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:28.450 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:28.475 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:28.475+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:28.530 INFO:tasks.workunit.client.0.smithi053.stdout:user qa_user deleted 2024-04-26T07:49:28.531 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:28.551 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:28.547+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:28.557 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:28.557 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:28.572 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:28.624 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records in 2024-04-26T07:49:28.624 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records out 2024-04-26T07:49:28.624 INFO:tasks.workunit.client.0.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0918328 s, 114 MB/s 2024-04-26T07:49:28.652 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:28.648+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:28.743 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:28.744 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:28.753 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:28.748+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:28.758 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:28.779 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_28 2024-04-26T07:49:28.854 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:28.851+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:28.887 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:28.887 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:28.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:28.908 INFO:tasks.workunit.client.0.smithi053.stdout:quota set for the bucket: buck_2024_03_26_07_49_28 2024-04-26T07:49:28.955 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:28.952+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:29.056 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:29.052+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:29.075 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:29.076 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:29.092 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:29.127 INFO:tasks.workunit.client.0.smithi053.stdout:quota enabled for the bucket: buck_2024_03_26_07_49_28 2024-04-26T07:49:29.127 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 10Mb. 2024-04-26T07:49:29.127 INFO:tasks.workunit.client.0.smithi053.stdout:upload file successful 2024-04-26T07:49:29.136 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records in 2024-04-26T07:49:29.136 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records out 2024-04-26T07:49:29.137 INFO:tasks.workunit.client.0.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00812839 s, 1.3 GB/s 2024-04-26T07:49:29.157 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:29.152+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:29.200 INFO:tasks.workunit.client.0.smithi053.stdout:readding file to bucket: 10MBfile1 2024-04-26T07:49:29.200 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:29.201 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-04-26T07:49:29.201 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:29.212 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:29.212 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:29.226 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:29.257 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:29.252+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:29.355 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:29.355 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:29.358 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:29.356+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:29.370 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:29.449 INFO:tasks.workunit.client.0.smithi053.stdout:user qa_user deleted 2024-04-26T07:49:29.450 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:29.459 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:29.456+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:29.498 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:29.498 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:29.502 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records in 2024-04-26T07:49:29.502 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records out 2024-04-26T07:49:29.502 INFO:tasks.workunit.client.0.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0487844 s, 215 MB/s 2024-04-26T07:49:29.512 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:29.560 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:29.556+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:29.649 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:29.649 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:29.661 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:29.659+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:29.665 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:29.674 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_29 2024-04-26T07:49:29.762 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:29.760+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:29.792 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:29.792 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:29.808 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:29.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:49:29.902 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:29.900+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:29.965 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:29.963+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:29.969 INFO:tasks.workunit.client.0.smithi053.stdout:bucket quota max_objs set for the given user: buck_2024_03_26_07_49_29 2024-04-26T07:49:29.978 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:29.978 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:29.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:30.082 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:30.080+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:30.157 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:30.157 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:30.166 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:30.164+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:30.173 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:30.212 INFO:tasks.workunit.client.0.smithi053.stdout:quota enabled for the bucket: buck_2024_03_26_07_49_29 2024-04-26T07:49:30.212 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 10Mb. 2024-04-26T07:49:30.212 INFO:tasks.workunit.client.0.smithi053.stdout:upload file successful 2024-04-26T07:49:30.267 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:30.267+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:30.278 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records in 2024-04-26T07:49:30.278 INFO:tasks.workunit.client.0.smithi053.stderr:1+0 records out 2024-04-26T07:49:30.278 INFO:tasks.workunit.client.0.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0616219 s, 170 MB/s 2024-04-26T07:49:30.306 INFO:tasks.workunit.client.0.smithi053.stdout:readding file to bucket: 10MBfile1 2024-04-26T07:49:30.306 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:30.306 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-04-26T07:49:30.306 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:30.324 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:30.324 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:30.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:30.368 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:30.367+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:30.455 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:30.455 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:30.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:30.469 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:30.464+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:30.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:30.569 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:30.568+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:30.593 INFO:tasks.workunit.client.0.smithi053.stdout:user qa_user deleted 2024-04-26T07:49:30.593 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:30.634 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:30.634 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:30.649 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:30.653 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:30.654 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:30.674 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:30.674 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:30.674 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:30.672+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:30.691 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:30.691 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:30.710 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:30.710 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:30.731 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:30.732 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:30.757 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:30.758 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:30.771 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:30.768+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:30.773 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:30.773 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:30.773 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:30.773 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:30.773 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:30.774 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_30 2024-04-26T07:49:30.780 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:30.780 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:30.787 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:30.800 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:30.837 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:49:30.874 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:30.871+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:30.930 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:30.930 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:30.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:30.930 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:30.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.930 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:30.930 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:30.930 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 61.328062308, 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0056514750000000004, 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 52 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601724+0000", 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601727+0000", 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.163e-06 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.601761+0000", 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3847999999999998e-05 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602013+0000", 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025215399999999998 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602102+0000", 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9066000000000004e-05 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602273+0000", 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000171182 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602651+0000", 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00037720000000000001 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.602995+0000", 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000344247 2024-04-26T07:49:30.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.604820+0000", 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018254160000000001 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607233+0000", 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024128230000000001 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607309+0000", 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6224999999999996e-05 2024-04-26T07:49:30.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.607376+0000", 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6150999999999997e-05 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.202458270999998, 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031921969999999999, 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.936 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 236 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727328+0000", 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727332+0000", 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4869999999999998e-06 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727346+0000", 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4836e-05 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727380+0000", 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3692999999999997e-05 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727400+0000", 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9979999999999998e-05 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727531+0000", 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130949 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.727788+0000", 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025688499999999999 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.728200+0000", 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00041179900000000002 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.729730+0000", 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001530572 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730356+0000", 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00062611800000000005 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730446+0000", 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9319000000000003e-05 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.730520+0000", 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4559000000000002e-05 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.188918459999996, 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028999310000000001, 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 283 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740868+0000", 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740869+0000", 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.155e-06 2024-04-26T07:49:30.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740884+0000", 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.543e-05 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740899+0000", 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4533e-05 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740905+0000", 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4010000000000002e-06 2024-04-26T07:49:30.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.740970+0000", 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4888000000000006e-05 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741087+0000", 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116388 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741223+0000", 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013601800000000001 2024-04-26T07:49:30.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.741950+0000", 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072763400000000001 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743680+0000", 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017300309999999999 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743719+0000", 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8732000000000001e-05 2024-04-26T07:49:30.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.743768+0000", 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8721000000000003e-05 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.892584307999996, 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028979790000000002, 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.947 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 742 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037202+0000", 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037205+0000", 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.683e-06 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037217+0000", 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2347000000000001e-05 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037249+0000", 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1652999999999997e-05 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037264+0000", 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5053e-05 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037398+0000", 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134449 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037637+0000", 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000238388 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.037984+0000", 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000347401 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039386+0000", 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001402375 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.039941+0000", 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00055470499999999996 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040031+0000", 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9870000000000005e-05 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.040100+0000", 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9054999999999995e-05 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.851935972, 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026953580000000001, 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 760 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.953 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077850+0000", 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077853+0000", 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2199999999999999e-06 2024-04-26T07:49:30.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077864+0000", 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.136e-05 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077895+0000", 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1380000000000001e-05 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.077910+0000", 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4683e-05 2024-04-26T07:49:30.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078033+0000", 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012319499999999999 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078253+0000", 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021987499999999999 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.078568+0000", 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031487099999999999 2024-04-26T07:49:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.079737+0000", 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001169364 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080396+0000", 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00065863100000000002 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080482+0000", 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5673000000000005e-05 2024-04-26T07:49:30.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.080546+0000", 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4105999999999999e-05 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.710779029999998, 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030863079999999998, 2024-04-26T07:49:30.958 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 819 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219007+0000", 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219009+0000", 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6300000000000001e-06 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219018+0000", 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7830000000000004e-06 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219043+0000", 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4902999999999999e-05 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219055+0000", 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2733e-05 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219187+0000", 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013202600000000001 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219416+0000", 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000228595 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.219921+0000", 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00050526200000000003 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221111+0000", 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001189264 2024-04-26T07:49:30.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221824+0000", 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071316700000000001 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.221979+0000", 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015522600000000001 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.222094+0000", 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114719 2024-04-26T07:49:30.963 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.658912766, 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033639400000000002, 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 841 2024-04-26T07:49:30.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270874+0000", 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270876+0000", 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5239999999999999e-06 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270888+0000", 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.239e-05 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270919+0000", 2024-04-26T07:49:30.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0386e-05 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.270937+0000", 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8023e-05 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271091+0000", 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153802 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.271447+0000", 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035622099999999999 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.272032+0000", 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058492799999999997 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273324+0000", 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012923559999999999 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.273958+0000", 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00063414899999999998 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274114+0000", 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015607800000000001 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.274238+0000", 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012308299999999999 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.969 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.654348016, 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031880070000000001, 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.970 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 843 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275438+0000", 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275441+0000", 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2129999999999998e-06 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275451+0000", 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0727000000000001e-05 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275483+0000", 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2011999999999998e-05 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275504+0000", 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0267000000000001e-05 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275646+0000", 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014206900000000001 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.275879+0000", 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000233315 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.276359+0000", 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048021899999999999 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.277529+0000", 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011702609999999999 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278354+0000", 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00082486600000000005 2024-04-26T07:49:30.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278506+0000", 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015169599999999999 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.278626+0000", 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120362 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.975 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.644255891, 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027584929999999999, 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 847 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285530+0000", 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285533+0000", 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3159999999999999e-06 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285544+0000", 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1253999999999999e-05 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285575+0000", 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0738999999999998e-05 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285589+0000", 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4343e-05 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285702+0000", 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112649 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.285921+0000", 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021945499999999999 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.286238+0000", 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031702400000000001 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.287549+0000", 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001310879 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288004+0000", 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00045514399999999999 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288167+0000", 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016323100000000001 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.288289+0000", 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121459 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.640372339999999, 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002936106, 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.981 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 849 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289414+0000", 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289416+0000", 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7129999999999999e-06 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289425+0000", 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6369999999999994e-06 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289450+0000", 2024-04-26T07:49:30.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4433000000000001e-05 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289462+0000", 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1956999999999999e-05 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289591+0000", 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012954899999999999 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.289827+0000", 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023558800000000001 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.290310+0000", 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00048358899999999998 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.291493+0000", 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001182324 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292082+0000", 2024-04-26T07:49:30.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058951499999999998 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292242+0000", 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159309 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292350+0000", 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108492 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.502485405000002, 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032794199999999999, 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 907 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427301+0000", 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427303+0000", 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.446e-06 2024-04-26T07:49:30.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427315+0000", 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1707e-05 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427348+0000", 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2642999999999999e-05 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427363+0000", 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5037e-05 2024-04-26T07:49:30.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427519+0000", 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015594200000000001 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.427915+0000", 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039595599999999999 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.428501+0000", 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058595900000000005 2024-04-26T07:49:30.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.429998+0000", 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014978210000000001 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430311+0000", 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031217400000000002 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430468+0000", 2024-04-26T07:49:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015785500000000001 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.430580+0000", 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011188000000000001 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.498062371000003, 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002976916, 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.992 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 909 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431724+0000", 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431726+0000", 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8759999999999999e-06 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431735+0000", 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.577e-06 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431761+0000", 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5117e-05 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431773+0000", 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2526e-05 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.431878+0000", 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010459300000000001 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432020+0000", 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014283899999999999 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.432300+0000", 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279664 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.433338+0000", 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001038115 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434437+0000", 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001098878 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434590+0000", 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015255800000000001 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.434701+0000", 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111173 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.383710424999997, 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026964580000000001, 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:30.998 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 957 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546076+0000", 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:30.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546078+0000", 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0700000000000001e-06 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546088+0000", 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0067e-05 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546118+0000", 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0429999999999998e-05 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546136+0000", 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7520000000000002e-05 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546252+0000", 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000115945 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546400+0000", 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014764199999999999 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:31.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.546672+0000", 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027279099999999998 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.547902+0000", 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001230014 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548616+0000", 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071360399999999995 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548707+0000", 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1372999999999994e-05 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.548772+0000", 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5001999999999999e-05 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1078 4.2d 4:b6e5726c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:31.003 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:26.868489+0000", 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.0612973979999998, 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028281040000000001, 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1078 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868489+0000", 2024-04-26T07:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868489+0000", 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868493+0000", 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.721e-06 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868506+0000", 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.383e-05 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868533+0000", 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6013999999999999e-05 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868546+0000", 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3733999999999999e-05 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868611+0000", 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5086999999999995e-05 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868723+0000", 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111496 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.868833+0000", 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011056 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.869530+0000", 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00069682299999999995 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.871230+0000", 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016995409999999999 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.871271+0000", 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1739999999999997e-05 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:26.871317+0000", 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5558e-05 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4833.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94811125110192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.141805+0000", 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.7879817120000001, 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027657150000000002, 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.009 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4833", 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/4142730500", 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 51 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141805+0000", 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141805+0000", 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141805+0000", 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8299999999999996e-07 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141810+0000", 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4510000000000002e-06 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141819+0000", 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.448e-06 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141828+0000", 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4540000000000007e-06 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141858+0000", 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0329999999999999e-05 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141899+0000", 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0478000000000001e-05 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.141974+0000", 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5556000000000006e-05 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.142309+0000", 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033519499999999999 2024-04-26T07:49:31.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.144485+0000", 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021754090000000001 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.144529+0000", 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.405e-05 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.144570+0000", 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1560999999999997e-05 2024-04-26T07:49:31.014 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1196 4.2d 4:b6e5726c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.531269+0000", 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.3985176419999998, 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034175799999999999, 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1196 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531269+0000", 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531269+0000", 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531296+0000", 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7316000000000001e-05 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531345+0000", 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8708000000000002e-05 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531365+0000", 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0499000000000001e-05 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531373+0000", 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1440000000000003e-06 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531424+0000", 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0386999999999997e-05 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531481+0000", 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7281000000000003e-05 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.531579+0000", 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7912999999999996e-05 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.532166+0000", 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00058730299999999996 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.534605+0000", 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024391650000000001 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.534636+0000", 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0694000000000001e-05 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.534686+0000", 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0170000000000002e-05 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.020 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4881.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.693333+0000", 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.2364534819999999, 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031474329999999998, 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4881", 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/2607548073", 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 50 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693333+0000", 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693333+0000", 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693334+0000", 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.16e-07 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693337+0000", 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6660000000000001e-06 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693348+0000", 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1044e-05 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693355+0000", 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0899999999999999e-06 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693407+0000", 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1224999999999998e-05 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693457+0000", 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0689999999999997e-05 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.693534+0000", 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6196e-05 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.694044+0000", 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051054799999999999 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696407+0000", 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0023628310000000001 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696437+0000", 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9978e-05 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696480+0000", 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3349000000000001e-05 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4881.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94219746749936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.696536+0000", 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.2332501690000002, 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027087769999999999, 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.026 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4881", 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/2607548073", 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 51 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696536+0000", 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696536+0000", 2024-04-26T07:49:31.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696537+0000", 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1900000000000002e-07 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696540+0000", 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3510000000000002e-06 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696550+0000", 2024-04-26T07:49:31.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5200000000000003e-06 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696554+0000", 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.561e-06 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696606+0000", 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1452999999999997e-05 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696688+0000", 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1879999999999995e-05 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.696837+0000", 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014926499999999999 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.697340+0000", 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00050288399999999999 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.699117+0000", 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001777374 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.699175+0000", 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7852000000000001e-05 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.699245+0000", 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9918000000000004e-05 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4775.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.847963+0000", 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.08182307, 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034157300000000001, 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4775", 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/4266234575", 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 50 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.032 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.847963+0000", 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.847963+0000", 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.847965+0000", 2024-04-26T07:49:31.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.826e-06 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.847972+0000", 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7460000000000003e-06 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.847990+0000", 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8182999999999999e-05 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.847999+0000", 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4080000000000004e-06 2024-04-26T07:49:31.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.848059+0000", 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9843999999999998e-05 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.848064+0000", 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3919999999999996e-06 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.850255+0000", 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021914259999999998 2024-04-26T07:49:31.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.850307+0000", 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1885000000000002e-05 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.850373+0000", 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6064999999999999e-05 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.850790+0000", 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000416666 2024-04-26T07:49:31.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.851327+0000", 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00053739100000000002 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.851356+0000", 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9319000000000002e-05 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.851379+0000", 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2578999999999998e-05 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.037 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.5006.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:30.700033+0000", 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.22975332800000001, 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043348010000000001, 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.5006", 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/2929180545", 2024-04-26T07:49:31.038 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 50 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700033+0000", 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700033+0000", 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700034+0000", 2024-04-26T07:49:31.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2619999999999999e-06 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700040+0000", 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0499999999999997e-06 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700056+0000", 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5736e-05 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700065+0000", 2024-04-26T07:49:31.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8189999999999998e-06 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700277+0000", 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021172500000000001 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700351+0000", 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4753999999999996e-05 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.700475+0000", 2024-04-26T07:49:31.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012376999999999999 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.701015+0000", 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00053988899999999999 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.704260+0000", 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032450439999999999 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.704322+0000", 2024-04-26T07:49:31.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2432000000000001e-05 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:30.704368+0000", 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.532e-05 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.043 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:31.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:31.045 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:31.045 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_26_07_49_30 with max size as zero 2024-04-26T07:49:31.045 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:31.045 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:31.046 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:31.043+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:31.146 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:31.143+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:31.168 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:31.168 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1743 8.b 8:d2546775:root::buck_2024_03_26_07_49_31:head [create,call version.set in=58b,writefull 0~192 in=192b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:31.167690+0000", 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.001705505, 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001724426, 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "waiting for sub ops", 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.169 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1743 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167690+0000", 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167690+0000", 2024-04-26T07:49:31.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167692+0000", 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.189e-06 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167697+0000", 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1089999999999997e-06 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167708+0000", 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1851000000000001e-05 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167715+0000", 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6000000000000003e-06 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167759+0000", 2024-04-26T07:49:31.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4206000000000003e-05 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167844+0000", 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4376000000000007e-05 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:31.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.167938+0000", 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4648000000000006e-05 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.168502+0000", 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000563515 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.174 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.175 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-04-26T07:49:31.175 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 1 2024-04-26T07:49:31.175 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:31.175 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_31 2024-04-26T07:49:31.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:31.246 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:31.244+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:31.301 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:31.301 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:31.301 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:31.301 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:31.301 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:31.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:31.347 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:31.347+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:31.372 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:31.372 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_26_07_49_31 with max objects as zero 2024-04-26T07:49:31.372 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:31.372 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:31.448 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:31.447+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:31.480 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 63.909100707999997, 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012204097000000001, 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:31.481 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 44 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571159+0000", 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7500000000000001e-06 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571176+0000", 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7359000000000001e-05 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571214+0000", 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7942999999999999e-05 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571240+0000", 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6084e-05 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571398+0000", 2024-04-26T07:49:31.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015818000000000001 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571415+0000", 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6739e-05 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583000+0000", 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011585332 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583359+0000", 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035870999999999999 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 61.869955271000002, 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003073423, 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.487 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 56 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:31.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610304+0000", 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1540000000000002e-06 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610315+0000", 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1596e-05 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610348+0000", 2024-04-26T07:49:31.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2379999999999998e-05 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610364+0000", 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6466000000000001e-05 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610544+0000", 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179963 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610849+0000", 2024-04-26T07:49:31.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030534099999999999 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.611143+0000", 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029372300000000002 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.612446+0000", 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013032129999999999 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613250+0000", 2024-04-26T07:49:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080378299999999997 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613319+0000", 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8774000000000003e-05 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613374+0000", 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.503e-05 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596391211392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 61.86671123, 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033841380000000001, 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 57 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613546+0000", 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7770000000000001e-06 2024-04-26T07:49:31.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613554+0000", 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7789999999999996e-06 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613578+0000", 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4236999999999999e-05 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613592+0000", 2024-04-26T07:49:31.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4106e-05 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613725+0000", 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013219999999999999 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613921+0000", 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019679800000000001 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:31.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.614275+0000", 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035357100000000001 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.615361+0000", 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010861880000000001 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616713+0000", 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013521900000000001 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616818+0000", 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010427 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616929+0000", 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111022 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:31.498 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.872074185000002, 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045711500000000004, 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 207 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:31.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608185+0000", 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2270000000000002e-06 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608199+0000", 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4049999999999999e-05 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608231+0000", 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608247+0000", 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6696000000000001e-05 2024-04-26T07:49:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608402+0000", 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015428499999999999 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608762+0000", 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036012099999999998 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.609476+0000", 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071385399999999999 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612197+0000", 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027211480000000001 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612606+0000", 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040884 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612688+0000", 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1935999999999996e-05 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612753+0000", 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5075999999999998e-05 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.504 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.834039920999999, 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003481442, 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 216 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646219+0000", 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8430000000000001e-06 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646232+0000", 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.358e-05 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646268+0000", 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5846999999999997e-05 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646295+0000", 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6752999999999999e-05 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.507 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646431+0000", 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013639500000000001 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646656+0000", 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022519900000000001 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.647143+0000", 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487009 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649075+0000", 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019313640000000001 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649552+0000", 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000476959 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649634+0000", 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1877000000000002e-05 2024-04-26T07:49:31.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649697+0000", 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3615999999999995e-05 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.786034448000002, 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036454130000000001, 2024-04-26T07:49:31.510 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 227 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694224+0000", 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3099999999999999e-06 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694235+0000", 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1559999999999999e-05 2024-04-26T07:49:31.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694267+0000", 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694282+0000", 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5150000000000001e-05 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694426+0000", 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144058 2024-04-26T07:49:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694676+0000", 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024983500000000001 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.695121+0000", 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00044507299999999999 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.696591+0000", 2024-04-26T07:49:31.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001469878 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697715+0000", 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011244009999999999 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697800+0000", 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4722000000000006e-05 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697867+0000", 2024-04-26T07:49:31.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6508999999999996e-05 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.778598295999998, 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032415780000000002, 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.516 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 229 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701660+0000", 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.244e-06 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701671+0000", 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1326e-05 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701703+0000", 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2023999999999997e-05 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701718+0000", 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5133000000000001e-05 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701833+0000", 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114916 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702050+0000", 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216624 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702472+0000", 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042268699999999999 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.703941+0000", 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001468128 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704755+0000", 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000814637 2024-04-26T07:49:31.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704833+0000", 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8226000000000006e-05 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704899+0000", 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5633e-05 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.771598677999997, 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003426648, 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 231 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708659+0000", 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2630000000000002e-06 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708671+0000", 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1379999999999999e-05 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708702+0000", 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1761999999999998e-05 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708719+0000", 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6954000000000001e-05 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708844+0000", 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012488199999999999 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709085+0000", 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000240905 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709507+0000", 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042178700000000002 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711076+0000", 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015689530000000001 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711928+0000", 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085241699999999995 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712016+0000", 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7219000000000006e-05 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712084+0000", 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8126000000000005e-05 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.473109059999999, 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029394930000000001, 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.527 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 730 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007149+0000", 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2500000000000001e-06 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007160+0000", 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1516e-05 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007192+0000", 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1362999999999998e-05 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007207+0000", 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5114e-05 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007316+0000", 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109252 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007539+0000", 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022263200000000001 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007886+0000", 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034704000000000001 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009051+0000", 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001164881 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009882+0000", 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083153899999999995 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009971+0000", 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9183000000000003e-05 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.010086+0000", 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011472300000000001 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.532 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.459500335000001, 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028721110000000001, 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 736 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.533 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020755+0000", 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020758+0000", 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.187e-06 2024-04-26T07:49:31.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020769+0000", 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1263e-05 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020800+0000", 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.129e-05 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020815+0000", 2024-04-26T07:49:31.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4737e-05 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.020938+0000", 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012298499999999999 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.021157+0000", 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021933799999999999 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.021474+0000", 2024-04-26T07:49:31.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031639199999999998 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.022654+0000", 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00118045 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023470+0000", 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081556700000000001 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023556+0000", 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6612000000000004e-05 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.023628+0000", 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1290000000000004e-05 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.455621686000001, 2024-04-26T07:49:31.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051848809999999997, 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 738 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024636+0000", 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0999999999999998e-06 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024647+0000", 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1270000000000001e-05 2024-04-26T07:49:31.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024679+0000", 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1069999999999999e-05 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024698+0000", 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9887000000000001e-05 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024806+0000", 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010731899999999999 2024-04-26T07:49:31.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024938+0000", 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013236899999999999 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.025208+0000", 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027009700000000001 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.026465+0000", 2024-04-26T07:49:31.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012567800000000001 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029663+0000", 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003197667 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029751+0000", 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8578999999999993e-05 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029819+0000", 2024-04-26T07:49:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7743000000000005e-05 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.359526611, 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003055978, 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.544 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 778 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120731+0000", 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2869999999999999e-06 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120743+0000", 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1656e-05 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120774+0000", 2024-04-26T07:49:31.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1309999999999997e-05 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120790+0000", 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5187e-05 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120910+0000", 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119979 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121125+0000", 2024-04-26T07:49:31.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000215324 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121440+0000", 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031488499999999999 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.122682+0000", 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001242033 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123599+0000", 2024-04-26T07:49:31.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00091723900000000003 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123718+0000", 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119306 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123785+0000", 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6772000000000004e-05 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.301930036000002, 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030101080000000001, 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 802 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.550 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178328+0000", 2024-04-26T07:49:31.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5830000000000001e-06 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178340+0000", 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1347e-05 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178371+0000", 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1303000000000002e-05 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178386+0000", 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5043e-05 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178500+0000", 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114339 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178722+0000", 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022198199999999999 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:31.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.179047+0000", 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000324667 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.180162+0000", 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001114711 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181123+0000", 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00096165200000000001 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181220+0000", 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7139000000000006e-05 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181336+0000", 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011534199999999999 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.216345238999999, 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029079560000000002, 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 838 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263911+0000", 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263913+0000", 2024-04-26T07:49:31.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9929999999999998e-06 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263925+0000", 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.269e-05 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263953+0000", 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7900000000000001e-05 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.263967+0000", 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.438e-05 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264085+0000", 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117982 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264310+0000", 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022483099999999999 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.264674+0000", 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036400700000000001 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.265887+0000", 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00121247 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266611+0000", 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00072435100000000003 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266700+0000", 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412999999999995e-05 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.266818+0000", 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011893899999999999 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.561 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.187704969000002, 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029764090000000002, 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 850 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292553+0000", 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4399999999999999e-06 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292565+0000", 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.154e-05 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292595+0000", 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0433000000000002e-05 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292613+0000", 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7759999999999999e-05 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292738+0000", 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012527600000000001 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292948+0000", 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020985099999999999 2024-04-26T07:49:31.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.293260+0000", 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031240100000000002 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.294440+0000", 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00117979 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295370+0000", 2024-04-26T07:49:31.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092946599999999999 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295460+0000", 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0529e-05 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295527+0000", 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6922999999999996e-05 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.183708377999999, 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029089200000000002, 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 852 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.568 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296550+0000", 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.39e-06 2024-04-26T07:49:31.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296563+0000", 2024-04-26T07:49:31.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2763e-05 2024-04-26T07:49:31.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296593+0000", 2024-04-26T07:49:31.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0929999999999997e-05 2024-04-26T07:49:31.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296611+0000", 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7453e-05 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296715+0000", 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000104522 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296846+0000", 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130066 2024-04-26T07:49:31.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.297118+0000", 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027257399999999998 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.298189+0000", 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001071242 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299293+0000", 2024-04-26T07:49:31.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001103845 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299388+0000", 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4462000000000005e-05 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299456+0000", 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8672999999999998e-05 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 58.136232937000003, 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003029908, 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 873 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.575 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344025+0000", 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6959999999999999e-06 2024-04-26T07:49:31.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344036+0000", 2024-04-26T07:49:31.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1226999999999999e-05 2024-04-26T07:49:31.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344061+0000", 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5309000000000001e-05 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344080+0000", 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8853000000000001e-05 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344227+0000", 2024-04-26T07:49:31.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014731600000000001 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344358+0000", 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013102900000000001 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344646+0000", 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000287965 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.345790+0000", 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001143926 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346903+0000", 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011127610000000001 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346987+0000", 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4350000000000004e-05 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.347053+0000", 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5475999999999994e-05 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.991467165000003, 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031214210000000001, 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.581 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 934 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:31.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488791+0000", 2024-04-26T07:49:31.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6199999999999999e-06 2024-04-26T07:49:31.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488806+0000", 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4963000000000001e-05 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488840+0000", 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3793e-05 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488862+0000", 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2325999999999999e-05 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488994+0000", 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013211899999999999 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489218+0000", 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223482 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489533+0000", 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031546100000000001 2024-04-26T07:49:31.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.490516+0000", 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00098278499999999991 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491625+0000", 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001108904 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491793+0000", 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167873 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491910+0000", 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117095 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:31.587 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.984313077000003, 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030389750000000002, 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 937 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.588 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495945+0000", 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.84e-06 2024-04-26T07:49:31.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495955+0000", 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0787e-05 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495986+0000", 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1093000000000002e-05 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496005+0000", 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8236e-05 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496127+0000", 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000122069 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496372+0000", 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024480200000000002 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496723+0000", 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000351357 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.497773+0000", 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001050411 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498698+0000", 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092447199999999997 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498861+0000", 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016297600000000001 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498982+0000", 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120932 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.593 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:1110 3.25 e53/17 3:a41b494f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_1:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.2345116699999998, 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097024650000000004, 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245746+0000", 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2989999999999999e-06 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248386+0000", 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002639742 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248416+0000", 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9512000000000001e-05 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248430+0000", 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4603999999999999e-05 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248517+0000", 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6917999999999997e-05 2024-04-26T07:49:31.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248544+0000", 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6625999999999999e-05 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255383+0000", 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068395399999999999 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255447+0000", 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3224000000000003e-05 2024-04-26T07:49:31.597 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.598 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.598 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.598 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:31.598 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:31.598 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:31.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:31.600 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_31 2024-04-26T07:49:31.600 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:31.599+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:31.700 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:31.699+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:31.714 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:31.714 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_26_07_49_31 max objects -1 2024-04-26T07:49:31.714 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:31.715 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:31.743 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:31.743 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:31.758 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:31.801 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:31.796+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:31.857 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_31 2024-04-26T07:49:31.901 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:31.899+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:31.924 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:31.924 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:31.925 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:31.925 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:31.925 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:31.939 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:32.002 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:32.000+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:32.030 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:32.031 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_26_07_49_31 with max size -1 2024-04-26T07:49:32.031 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:32.031 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:32.103 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:32.100+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:32.118 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:32.118 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:46 7.1f e26/25 7:f95f44c2:::notify.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 62.537621014999999, 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081628929999999992, 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578311+0000", 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2460000000000002e-06 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578328+0000", 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7090000000000001e-05 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578380+0000", 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.126e-05 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578417+0000", 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7008999999999998e-05 2024-04-26T07:49:32.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578579+0000", 2024-04-26T07:49:32.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016204899999999999 2024-04-26T07:49:32.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578632+0000", 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3103000000000003e-05 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586350+0000", 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007717944 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586472+0000", 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000122192 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.123 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1081 4.3d 4:bebb386e:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.2471835220000003, 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066071109999999997, 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.124 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1081 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868748+0000", 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.68e-06 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868758+0000", 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4900000000000006e-06 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868781+0000", 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2989999999999998e-05 2024-04-26T07:49:32.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868798+0000", 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7686999999999999e-05 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869173+0000", 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037481999999999999 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869499+0000", 2024-04-26T07:49:32.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032565200000000001 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869868+0000", 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036949800000000001 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872636+0000", 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002768005 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875065+0000", 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024284910000000001 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875199+0000", 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134599 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875354+0000", 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015419899999999999 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1082 4.22 4:47838f18:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.247037679, 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071607529999999997, 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1082 2024-04-26T07:49:32.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868894+0000", 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3999999999999999e-06 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868902+0000", 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.32e-06 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868922+0000", 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.978e-05 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868938+0000", 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.592e-05 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.870448+0000", 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001510646 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.870736+0000", 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028800800000000002 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871097+0000", 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036016800000000001 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875126+0000", 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040298039999999997 2024-04-26T07:49:32.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875884+0000", 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00075710800000000004 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875982+0000", 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8339999999999997e-05 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.876053+0000", 2024-04-26T07:49:32.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1259000000000003e-05 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1086 4.1 4:8294b3c5:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.2469387239999996, 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070958210000000004, 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.136 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1086 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868993+0000", 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6670000000000001e-06 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869002+0000", 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7399999999999993e-06 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869023+0000", 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.126e-05 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869038+0000", 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5113000000000001e-05 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871303+0000", 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022652420000000002 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871601+0000", 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029784800000000003 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872002+0000", 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040058800000000001 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875718+0000", 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037166320000000001 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875893+0000", 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017413899999999999 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875975+0000", 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2542999999999999e-05 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.876087+0000", 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112049 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1111 3.1d e53/17 3:b91fd52e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_2:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:32.142 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8636582290000003, 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010266506999999999, 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252274+0000", 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.08e-06 2024-04-26T07:49:32.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254939+0000", 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026646360000000002 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254973+0000", 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4029999999999998e-05 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254989+0000", 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5967000000000001e-05 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.255132+0000", 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014352500000000001 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.255177+0000", 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4916999999999997e-05 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262405+0000", 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007228473 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262538+0000", 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132879 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.9005255409999999, 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:49:32.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:49:32.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:49:32.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.154 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1621 4.18 4:1aea0c14:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.360856523, 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071314259999999997, 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1621 2024-04-26T07:49:32.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755076+0000", 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0559999999999999e-06 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755087+0000", 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.169e-05 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755120+0000", 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2305999999999999e-05 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755140+0000", 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0307000000000001e-05 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755341+0000", 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020068500000000001 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755661+0000", 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032058500000000002 2024-04-26T07:49:32.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756074+0000", 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041255699999999997 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758390+0000", 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023158620000000001 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.761950+0000", 2024-04-26T07:49:32.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0035604999999999999 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762099+0000", 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148939 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762205+0000", 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105939 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.160 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1622 4.13 4:c9d5fa89:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.360734154, 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070301269999999997, 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.161 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1622 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755197+0000", 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.513e-06 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755206+0000", 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6570000000000003e-06 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755242+0000", 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5689000000000003e-05 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755259+0000", 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7410000000000001e-05 2024-04-26T07:49:32.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755409+0000", 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014988299999999999 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755734+0000", 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032503099999999999 2024-04-26T07:49:32.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756113+0000", 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037915699999999997 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758805+0000", 2024-04-26T07:49:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026914959999999998 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.761996+0000", 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031908689999999998 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762120+0000", 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012476300000000001 2024-04-26T07:49:32.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762226+0000", 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105659 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1626 4.18 4:1a86fbd9:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.3605343190000001, 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079515620000000006, 2024-04-26T07:49:32.168 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1626 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755398+0000", 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0200000000000001e-06 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755408+0000", 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9729999999999992e-06 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755429+0000", 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0866999999999999e-05 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755443+0000", 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4809e-05 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756742+0000", 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001298766 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.757063+0000", 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032037400000000001 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.757510+0000", 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044743400000000003 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762284+0000", 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047744019999999996 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763067+0000", 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078240500000000001 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763221+0000", 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015389900000000001 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763347+0000", 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126613 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1629 4.22 4:46647a10:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.3604473160000001, 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068722949999999996, 2024-04-26T07:49:32.174 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1629 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:32.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755484+0000", 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.64e-06 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755493+0000", 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5129999999999996e-06 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755513+0000", 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9729999999999999e-05 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755526+0000", 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3487e-05 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755669+0000", 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014300900000000001 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755997+0000", 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000328041 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756420+0000", 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042322699999999998 2024-04-26T07:49:32.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758834+0000", 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024139370000000001 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762084+0000", 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032494030000000001 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762236+0000", 2024-04-26T07:49:32.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015231199999999999 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762355+0000", 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118996 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1719 4.18 4:1a86fbd9:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.1133074569999999, 2024-04-26T07:49:32.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073046129999999997, 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1719 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002624+0000", 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.37e-06 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002630+0000", 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7570000000000001e-06 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002649+0000", 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9476000000000001e-05 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002665+0000", 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5523999999999999e-05 2024-04-26T07:49:32.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.003982+0000", 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001317737 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004167+0000", 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018405900000000001 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004432+0000", 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026543200000000002 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.006970+0000", 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025381240000000001 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009785+0000", 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028153750000000002 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009865+0000", 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9809999999999997e-05 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009927+0000", 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1948999999999999e-05 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1844 4.18 4:1b7f0f9d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515508+0000", 2024-04-26T07:49:32.186 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.60042153799999998, 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060644080000000003, 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1844 2024-04-26T07:49:32.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515508+0000", 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515508+0000", 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515509+0000", 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8700000000000004e-07 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515516+0000", 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4330000000000001e-06 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515533+0000", 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6932999999999999e-05 2024-04-26T07:49:32.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515543+0000", 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9739999999999997e-06 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515673+0000", 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012985899999999999 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516014+0000", 2024-04-26T07:49:32.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00034150100000000002 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516468+0000", 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045336699999999998 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520833+0000", 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043652220000000002 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521283+0000", 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044981699999999998 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521478+0000", 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019492199999999999 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521573+0000", 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5393e-05 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.192 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1845 4.13 4:c82ab556:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.60036611799999995, 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067396230000000001, 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1845 2024-04-26T07:49:32.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515565+0000", 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1000000000000001e-06 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515571+0000", 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1800000000000001e-06 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515593+0000", 2024-04-26T07:49:32.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1526999999999999e-05 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515607+0000", 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4363e-05 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515758+0000", 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015042199999999999 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516096+0000", 2024-04-26T07:49:32.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033855099999999998 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516536+0000", 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043945399999999998 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520983+0000", 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044475579999999999 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522142+0000", 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011591450000000001 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522235+0000", 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2726999999999995e-05 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522304+0000", 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8596000000000005e-05 2024-04-26T07:49:32.198 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1848 4.1 4:80bca84c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.60022080899999997, 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065023809999999998, 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.199 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1848 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515710+0000", 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.203e-06 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515717+0000", 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7170000000000002e-06 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515735+0000", 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7652999999999999e-05 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515749+0000", 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4527e-05 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515893+0000", 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014347900000000001 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516200+0000", 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030680099999999999 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516615+0000", 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041556699999999999 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520878+0000", 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042629620000000003 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522058+0000", 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00118031 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522142+0000", 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3765999999999997e-05 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522212+0000", 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9395999999999998e-05 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.204 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1937 4.18 4:1b7f0f9d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.41226201899999998, 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062723520000000001, 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1937 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703669+0000", 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.483e-06 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703678+0000", 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.14e-06 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703700+0000", 2024-04-26T07:49:32.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2603e-05 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703716+0000", 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5855999999999999e-05 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703880+0000", 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000164353 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704084+0000", 2024-04-26T07:49:32.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000203215 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704309+0000", 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000225116 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.706571+0000", 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022619820000000001 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709718+0000", 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031474229999999999 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709832+0000", 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000114159 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108022 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.210 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1938 4.13 4:c82ab556:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.41218371700000001, 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006194059, 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.211 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1938 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703747+0000", 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.15e-06 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703754+0000", 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703773+0000", 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9029999999999999e-05 2024-04-26T07:49:32.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703787+0000", 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4080000000000001e-05 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703924+0000", 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013718199999999999 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704137+0000", 2024-04-26T07:49:32.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000212909 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704418+0000", 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028120800000000002 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707332+0000", 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002913831 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709747+0000", 2024-04-26T07:49:32.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024147119999999998 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709845+0000", 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8375999999999995e-05 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5476999999999994e-05 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1940 4.3a 4:5c1674d7:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.41210715999999997, 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061173099999999999, 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1940 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703824+0000", 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.147e-06 2024-04-26T07:49:32.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703830+0000", 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2759999999999997e-06 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703849+0000", 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8916e-05 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703863+0000", 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4147e-05 2024-04-26T07:49:32.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704250+0000", 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038648000000000003 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704325+0000", 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5204999999999996e-05 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:32.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704433+0000", 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010753500000000001 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.706587+0000", 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002154319 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709709+0000", 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031223000000000002 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709831+0000", 2024-04-26T07:49:32.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012155300000000001 2024-04-26T07:49:32.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:32.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010943200000000001 2024-04-26T07:49:32.222 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1941 4.1 4:80bca84c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.41203464400000001, 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006217513, 2024-04-26T07:49:32.223 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1941 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:32.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703897+0000", 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.263e-06 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703902+0000", 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.66e-06 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703920+0000", 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8179999999999999e-05 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703936+0000", 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5107e-05 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704064+0000", 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012880899999999999 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704269+0000", 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000204632 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704544+0000", 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027522799999999997 2024-04-26T07:49:32.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707930+0000", 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033854660000000002 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709974+0000", 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020446629999999999 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.710069+0000", 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4257000000000002e-05 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.710113+0000", 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4248000000000001e-05 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1954 4.18 4:1b53c819:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.8.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.27090990999999998, 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069431889999999998, 2024-04-26T07:49:32.229 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1954 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845021+0000", 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.37e-07 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845025+0000", 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6070000000000001e-06 2024-04-26T07:49:32.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845036+0000", 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0703999999999999e-05 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845043+0000", 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0659999999999998e-06 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846350+0000", 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00130725 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846508+0000", 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015776599999999999 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846717+0000", 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020922200000000001 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851822+0000", 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051043240000000004 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851889+0000", 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7199999999999994e-05 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851923+0000", 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3782000000000003e-05 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851963+0000", 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0630999999999998e-05 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.234 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2047 4.18 4:1b53c819:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.094825855000000001, 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072732830000000002, 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2047 2024-04-26T07:49:32.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021105+0000", 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4299999999999998e-07 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021107+0000", 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021115+0000", 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7559999999999999e-06 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021121+0000", 2024-04-26T07:49:32.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5040000000000002e-06 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022441+0000", 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00132037 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022550+0000", 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010914 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022714+0000", 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016400900000000001 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028191+0000", 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005477132 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028308+0000", 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011705999999999999 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028346+0000", 2024-04-26T07:49:32.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7867000000000002e-05 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028377+0000", 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1219e-05 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.240 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:32.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:32.242 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:32.239+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:32.343 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:32.339+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:32.412 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:32.412 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:32.412 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:32.412 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:32.426 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:32.444 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:32.440+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:32.546 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:32.540+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:32.589 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:32.589 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:32.589 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:32.589 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:32.589 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:32.603 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:32.646 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:32.644+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:32.726 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596391209088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.134118847000003, 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006394205, 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 49 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591754+0000", 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.103e-06 2024-04-26T07:49:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591762+0000", 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509999999999995e-06 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591791+0000", 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8668999999999999e-05 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591806+0000", 2024-04-26T07:49:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5051e-05 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591925+0000", 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119163 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592111+0000", 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000185694 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592438+0000", 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032695800000000002 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.593651+0000", 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012125320000000001 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.597931+0000", 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042799709999999996 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598007+0000", 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6389000000000003e-05 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598146+0000", 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013872400000000001 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:49:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.128337096999999, 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037973019999999998, 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 205 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597536+0000", 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3000000000000002e-06 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597551+0000", 2024-04-26T07:49:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4932999999999999e-05 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597589+0000", 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7137e-05 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597607+0000", 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8913e-05 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597788+0000", 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018071499999999999 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.598155+0000", 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036658699999999998 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.598898+0000", 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00074370700000000003 2024-04-26T07:49:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.600857+0000", 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001958441 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601163+0000", 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030609799999999998 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601253+0000", 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509e-05 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601330+0000", 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7961999999999997e-05 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:219 6.4 e29/23 6:227f63b5:gc::gc.14:head v 29'4, mlcod=26'2)", 2024-04-26T07:49:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.069499604999997, 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079552349999999997, 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656373+0000", 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0430000000000002e-06 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656384+0000", 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1214e-05 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656410+0000", 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6553000000000001e-05 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656424+0000", 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3057000000000001e-05 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656523+0000", 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9304999999999999e-05 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656559+0000", 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6170000000000001e-05 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664230+0000", 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076710540000000001 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664326+0000", 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5839000000000002e-05 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:425 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.944438611999999, 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040099369999999999, 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 425 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781435+0000", 2024-04-26T07:49:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8600000000000001e-06 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781449+0000", 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4107000000000001e-05 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781487+0000", 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8819000000000002e-05 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781509+0000", 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1526e-05 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781619+0000", 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110401 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781905+0000", 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028538499999999998 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782316+0000", 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041122499999999998 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.783564+0000", 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001248323 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785182+0000", 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016181259999999999 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785321+0000", 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013868600000000001 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785442+0000", 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120479 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:426 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.944315803000002, 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042315030000000002, 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 426 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781556+0000", 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5400000000000001e-06 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781567+0000", 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1177e-05 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781590+0000", 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2929e-05 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781606+0000", 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5670000000000001e-05 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781730+0000", 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012455800000000001 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782012+0000", 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028137700000000003 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782402+0000", 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039053999999999998 2024-04-26T07:49:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785218+0000", 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028154040000000001 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785561+0000", 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00034358199999999999 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785690+0000", 2024-04-26T07:49:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012918700000000001 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785786+0000", 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5538999999999994e-05 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:434 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.938954344000003, 2024-04-26T07:49:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040682310000000003, 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 434 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786918+0000", 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.95e-06 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786928+0000", 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8369999999999992e-06 2024-04-26T07:49:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786958+0000", 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0125999999999999e-05 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786970+0000", 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.206e-05 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787094+0000", 2024-04-26T07:49:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000124079 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787302+0000", 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208495 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787827+0000", 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00052492200000000004 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790649+0000", 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028216040000000001 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790750+0000", 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010141699999999999 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790885+0000", 2024-04-26T07:49:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013442799999999999 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790984+0000", 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9313000000000003e-05 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:954 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.192935743, 2024-04-26T07:49:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066500159999999999, 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 954 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532936+0000", 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3599999999999999e-06 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532943+0000", 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8369999999999999e-06 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532962+0000", 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.916e-05 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532976+0000", 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3703000000000001e-05 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533067+0000", 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1049000000000002e-05 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533213+0000", 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146236 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533543+0000", 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033018000000000001 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.534585+0000", 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010418879999999999 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539432+0000", 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048471809999999999 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539516+0000", 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4055999999999996e-05 2024-04-26T07:49:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539585+0000", 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8366000000000002e-05 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1111 3.1d 3:b91fd52e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.4777077309999997, 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014830878, 2024-04-26T07:49:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1111 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248165+0000", 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1840000000000002e-06 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251340+0000", 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031757589999999998 2024-04-26T07:49:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251374+0000", 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3680000000000003e-05 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251390+0000", 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5650000000000001e-05 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251571+0000", 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018103300000000001 2024-04-26T07:49:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251811+0000", 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023969099999999999 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252027+0000", 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021619900000000001 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.261108+0000", 2024-04-26T07:49:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090814740000000008 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262828+0000", 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001719363 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262916+0000", 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8916e-05 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262993+0000", 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6928999999999995e-05 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1197 4.3e 4:7df5f364:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.1944966790000002, 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059453709999999996, 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1197 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531376+0000", 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5739999999999998e-06 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531388+0000", 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.219e-05 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531432+0000", 2024-04-26T07:49:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4045999999999998e-05 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532959+0000", 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00152674 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533077+0000", 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011815300000000001 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533400+0000", 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000323021 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533667+0000", 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026668500000000001 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535048+0000", 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001380558 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537058+0000", 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020102700000000002 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537217+0000", 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015946499999999999 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537319+0000", 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010166900000000001 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1216 4.2 e53/19 4:4088b346:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.6:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.733423+0000", 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.9924470870000004, 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039186610000000004, 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733423+0000", 2024-04-26T07:49:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733423+0000", 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733424+0000", 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.201e-06 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733434+0000", 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4059999999999994e-06 2024-04-26T07:49:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733453+0000", 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9610999999999999e-05 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733463+0000", 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8069999999999994e-06 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733645+0000", 2024-04-26T07:49:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000181893 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733671+0000", 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6336999999999999e-05 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737270+0000", 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003598445 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737342+0000", 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1960999999999998e-05 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1246 3.2f 3:f6e96107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.4788267739999998, 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023540999999999999, 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1246 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247046+0000", 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9270000000000001e-06 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252338+0000", 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052911449999999997 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252378+0000", 2024-04-26T07:49:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0299999999999997e-05 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252396+0000", 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8600000000000001e-05 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252475+0000", 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8669000000000002e-05 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252592+0000", 2024-04-26T07:49:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011717 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252971+0000", 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037877499999999998 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.262239+0000", 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092677920000000004 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270496+0000", 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082573809999999994 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270545+0000", 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8627e-05 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270585+0000", 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9613999999999997e-05 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.5178.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.8700789950000001, 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070304649999999996, 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.5178", 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/2720801126", 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 4 2024-04-26T07:49:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855794+0000", 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5129999999999999e-06 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855803+0000", 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5470000000000002e-06 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855824+0000", 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0276999999999999e-05 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855839+0000", 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5673000000000001e-05 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855972+0000", 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013249600000000001 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855983+0000", 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862532+0000", 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065490410000000002 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862657+0000", 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012515900000000001 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862822+0000", 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000164819 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1723 4.38 4:1e5b5a54:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.723544403, 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054881019999999999, 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1723 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002328+0000", 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.21e-06 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002338+0000", 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.009e-05 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002368+0000", 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0236999999999999e-05 2024-04-26T07:49:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002384+0000", 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5333e-05 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002540+0000", 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015670899999999999 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002770+0000", 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000229562 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.003076+0000", 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030549400000000001 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004792+0000", 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001716429 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007664+0000", 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028718620000000002 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007750+0000", 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5796000000000003e-05 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007814+0000", 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4380000000000004e-05 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1734 4.32 4:4fe789d6:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.159275+0000", 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.5665957619999999, 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048089430000000004, 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1734 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159275+0000", 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159275+0000", 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159277+0000", 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3070000000000001e-06 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159289+0000", 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1827e-05 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159324+0000", 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5502e-05 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159346+0000", 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2019999999999999e-05 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159562+0000", 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021560199999999999 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159955+0000", 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039302100000000002 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.160333+0000", 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000378088 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.162018+0000", 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001685349 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.163833+0000", 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018150149999999999 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.163974+0000", 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014034200000000001 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.164083+0000", 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010987 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1737 4.38 4:1c5b1b5d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.5664762730000001, 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058270199999999996, 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1737 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159396+0000", 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0499999999999999e-06 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159410+0000", 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4124000000000001e-05 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159461+0000", 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0949000000000003e-05 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159530+0000", 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8780000000000002e-05 2024-04-26T07:49:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159716+0000", 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186295 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.161226+0000", 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00150935 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.162449+0000", 2024-04-26T07:49:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012232090000000001 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.164854+0000", 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024051279999999999 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165063+0000", 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020894899999999999 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165153+0000", 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9913000000000005e-05 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165221+0000", 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8273000000000002e-05 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1827 4.32 4:4fe789d6:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.362979+0000", 2024-04-26T07:49:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.362891045, 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040214780000000002, 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1827 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.362979+0000", 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.362979+0000", 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.362981+0000", 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2340000000000001e-06 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.362992+0000", 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0475999999999999e-05 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363024+0000", 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1897000000000003e-05 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363040+0000", 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5736e-05 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363188+0000", 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148369 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363406+0000", 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000218419 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363680+0000", 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027372399999999998 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.365579+0000", 2024-04-26T07:49:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018986280000000001 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.366762+0000", 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00118311 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.366897+0000", 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135442 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.367001+0000", 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010344300000000001 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1830 4.38 4:1c5b1b5d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.363084+0000", 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.3627866260000001, 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047607639999999998, 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1830 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363084+0000", 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363084+0000", 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363085+0000", 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.404e-06 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363092+0000", 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7730000000000002e-06 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363119+0000", 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6866999999999999e-05 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363135+0000", 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6730000000000001e-05 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363314+0000", 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178779 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363518+0000", 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020422100000000001 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363785+0000", 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026647200000000002 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.366818+0000", 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030328870000000002 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.367663+0000", 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00084532499999999996 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.367745+0000", 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2346000000000001e-05 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.367844+0000", 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8960000000000001e-05 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1846 4.3e 4:7c4ddb29:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515335+0000", 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.210535374, 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054364909999999999, 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1846 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515335+0000", 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515335+0000", 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515338+0000", 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.773e-06 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515360+0000", 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2682999999999999e-05 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515402+0000", 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1893e-05 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515428+0000", 2024-04-26T07:49:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5389999999999999e-05 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515648+0000", 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000220139 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516062+0000", 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041426400000000002 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516493+0000", 2024-04-26T07:49:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043141400000000003 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.518555+0000", 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020616160000000001 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520473+0000", 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019177109999999999 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520658+0000", 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018535599999999999 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520771+0000", 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011325200000000001 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1848 4.1 e55/19 4:80bca84c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.10:head v 55'7, mlcod=54'5)", 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.517782+0000", 2024-04-26T07:49:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.208087777, 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039586880000000001, 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517782+0000", 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517782+0000", 2024-04-26T07:49:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517785+0000", 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0700000000000001e-06 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517800+0000", 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5809999999999999e-05 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517840+0000", 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9326000000000003e-05 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517859+0000", 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9224000000000001e-05 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.518032+0000", 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017293199999999999 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.518086+0000", 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.384e-05 2024-04-26T07:49:32.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521626+0000", 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0035398869999999998 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521741+0000", 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115599 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1939 4.3e 4:7c4ddb29:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703506+0000", 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.0223639259999999, 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040443579999999996, 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1939 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:32.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703506+0000", 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703506+0000", 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703509+0000", 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1670000000000002e-06 2024-04-26T07:49:32.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703519+0000", 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0576e-05 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703555+0000", 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6213e-05 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703578+0000", 2024-04-26T07:49:32.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2200000000000001e-05 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703728+0000", 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015096599999999999 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703965+0000", 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236202 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:32.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704231+0000", 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026681799999999999 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.706759+0000", 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025276209999999999 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707457+0000", 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00069753000000000003 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707510+0000", 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3454e-05 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707551+0000", 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0611000000000001e-05 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:32.837 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:32.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:32.839 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:32.840 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:32.835+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:32.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:49:32.939 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:32.936+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:33.009 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:33.009 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:33.011 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:33.011 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:33.011 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:33.011 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:33.025 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:33.027 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:33.027 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:33.040 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:33.036+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:33.044 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:33.061 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:33.061 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:33.079 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:33.097 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:33.116 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:33.116 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:33.137 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:33.137 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:33.141 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:33.139+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:33.144 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:33.144 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:33.159 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:33.247 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:33.247+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:33.288 INFO:tasks.workunit.client.0.smithi053.stderr:200+0 records in 2024-04-26T07:49:33.288 INFO:tasks.workunit.client.0.smithi053.stderr:200+0 records out 2024-04-26T07:49:33.288 INFO:tasks.workunit.client.0.smithi053.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.2557 s, 1.7 GB/s 2024-04-26T07:49:33.322 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:33.322 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:33.337 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:33.379 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:33.379+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:33.420 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_49_33 2024-04-26T07:49:33.443 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:33.440+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:33.508 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:33.508 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:33.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:33.543 INFO:tasks.workunit.client.0.smithi053.stdout:quota set for the bucket: buck_2024_03_26_07_49_33 2024-04-26T07:49:33.571 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:33.571+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:33.644 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:33.640+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:33.644 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:33.644 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:33.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:33.745 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:33.740+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:33.824 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:33.824 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:33.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:33.846 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:33.843+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:33.857 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:49:33.947 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:33.944+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:33.964 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:33.965 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:33.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:34.048 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:34.047+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:34.146 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:34.146 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:34.149 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:34.144+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:34.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:34.249 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:34.248+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:34.321 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:34.322 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:34.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:34.379 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:34.376+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:34.466 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:34.464+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:34.493 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:34.493 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:34.506 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:34.552 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:34.548+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:34.653 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:34.651+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:34.673 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:34.673 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:34.686 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:34.754 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:34.751+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:34.799 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:34.800 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:34.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:34.858 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:34.856+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:34.934 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:34.934 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:34.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:34.955 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:34.955+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:35.056 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:35.052+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:35.109 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:35.109 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:35.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:35.156 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:35.155+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:35.158 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:35.257 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:35.255+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:35.279 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:35.279 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:35.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:35.308 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:35.308 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:35.325 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:35.326 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:35.342 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:35.342 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:35.357 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:35.352+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:35.358 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:35.359 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:35.379 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:35.379 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:35.399 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:35.399 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:35.411 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:35.411 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:35.411 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:35.412 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:35.420 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:35.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:35.442 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:35.442 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:35.459 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:35.456+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:35.558 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:35.558 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:35.558 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:35.558 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:35.559 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:35.559 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:35.556+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:35.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:35.660 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:35.656+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:35.738 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:35.738 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:35.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:35.738 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:35.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.739 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T07:49:35.739 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:35.739 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 68.163940068000002, 2024-04-26T07:49:35.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012204097000000001, 2024-04-26T07:49:35.739 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.740 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.740 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:35.740 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.740 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.740 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.740 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 44 2024-04-26T07:49:35.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.741 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:35.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:35.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571159+0000", 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7500000000000001e-06 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571176+0000", 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7359000000000001e-05 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571214+0000", 2024-04-26T07:49:35.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7942999999999999e-05 2024-04-26T07:49:35.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571240+0000", 2024-04-26T07:49:35.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6084e-05 2024-04-26T07:49:35.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571398+0000", 2024-04-26T07:49:35.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015818000000000001 2024-04-26T07:49:35.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:35.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571415+0000", 2024-04-26T07:49:35.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6739e-05 2024-04-26T07:49:35.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583000+0000", 2024-04-26T07:49:35.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011585332 2024-04-26T07:49:35.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583359+0000", 2024-04-26T07:49:35.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035870999999999999 2024-04-26T07:49:35.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.748 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.748 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.748 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:35.748 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:35.748 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.124794631, 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003073423, 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 56 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610304+0000", 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1540000000000002e-06 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610315+0000", 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1596e-05 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610348+0000", 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2379999999999998e-05 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610364+0000", 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6466000000000001e-05 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610544+0000", 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179963 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610849+0000", 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030534099999999999 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.611143+0000", 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029372300000000002 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.612446+0000", 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013032129999999999 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613250+0000", 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080378299999999997 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613319+0000", 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8774000000000003e-05 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613374+0000", 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.503e-05 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596391211392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:35.754 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.121550589999998, 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033841380000000001, 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 57 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613546+0000", 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7770000000000001e-06 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613554+0000", 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7789999999999996e-06 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613578+0000", 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4236999999999999e-05 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613592+0000", 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4106e-05 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613725+0000", 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013219999999999999 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613921+0000", 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019679800000000001 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.614275+0000", 2024-04-26T07:49:35.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035357100000000001 2024-04-26T07:49:35.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.615361+0000", 2024-04-26T07:49:35.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010861880000000001 2024-04-26T07:49:35.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616713+0000", 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013521900000000001 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616818+0000", 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010427 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616929+0000", 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111022 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 63.126913545000001, 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045711500000000004, 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.761 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 207 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608185+0000", 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2270000000000002e-06 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608199+0000", 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4049999999999999e-05 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608231+0000", 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608247+0000", 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6696000000000001e-05 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608402+0000", 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015428499999999999 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608762+0000", 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036012099999999998 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.609476+0000", 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071385399999999999 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612197+0000", 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027211480000000001 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612606+0000", 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040884 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612688+0000", 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1935999999999996e-05 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612753+0000", 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5075999999999998e-05 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.766 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 63.088879280999997, 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003481442, 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 216 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.767 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646219+0000", 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8430000000000001e-06 2024-04-26T07:49:35.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646232+0000", 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.358e-05 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646268+0000", 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5846999999999997e-05 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646295+0000", 2024-04-26T07:49:35.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6752999999999999e-05 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646431+0000", 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013639500000000001 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646656+0000", 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022519900000000001 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.647143+0000", 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487009 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649075+0000", 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019313640000000001 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649552+0000", 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000476959 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649634+0000", 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1877000000000002e-05 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649697+0000", 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3615999999999995e-05 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.772 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 63.040873808000001, 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036454130000000001, 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.773 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 227 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:35.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694224+0000", 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3099999999999999e-06 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694235+0000", 2024-04-26T07:49:35.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1559999999999999e-05 2024-04-26T07:49:35.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694267+0000", 2024-04-26T07:49:35.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:35.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694282+0000", 2024-04-26T07:49:35.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5150000000000001e-05 2024-04-26T07:49:35.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694426+0000", 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144058 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694676+0000", 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024983500000000001 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.695121+0000", 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00044507299999999999 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.696591+0000", 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001469878 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697715+0000", 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011244009999999999 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697800+0000", 2024-04-26T07:49:35.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4722000000000006e-05 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697867+0000", 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6508999999999996e-05 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.781 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 63.033437655999997, 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032415780000000002, 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 229 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701660+0000", 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.244e-06 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701671+0000", 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1326e-05 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701703+0000", 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2023999999999997e-05 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701718+0000", 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5133000000000001e-05 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701833+0000", 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114916 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702050+0000", 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216624 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702472+0000", 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042268699999999999 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.703941+0000", 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001468128 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704755+0000", 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000814637 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704833+0000", 2024-04-26T07:49:35.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8226000000000006e-05 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704899+0000", 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5633e-05 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.787 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 63.026438038000002, 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003426648, 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 231 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708659+0000", 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2630000000000002e-06 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708671+0000", 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1379999999999999e-05 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708702+0000", 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1761999999999998e-05 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708719+0000", 2024-04-26T07:49:35.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6954000000000001e-05 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708844+0000", 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012488199999999999 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709085+0000", 2024-04-26T07:49:35.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000240905 2024-04-26T07:49:35.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:35.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709507+0000", 2024-04-26T07:49:35.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042178700000000002 2024-04-26T07:49:35.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711076+0000", 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015689530000000001 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711928+0000", 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085241699999999995 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712016+0000", 2024-04-26T07:49:35.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7219000000000006e-05 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712084+0000", 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8126000000000005e-05 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.727948419999997, 2024-04-26T07:49:35.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029394930000000001, 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 730 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007149+0000", 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2500000000000001e-06 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007160+0000", 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1516e-05 2024-04-26T07:49:35.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007192+0000", 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1362999999999998e-05 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007207+0000", 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5114e-05 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007316+0000", 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109252 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007539+0000", 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022263200000000001 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007886+0000", 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034704000000000001 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009051+0000", 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001164881 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009882+0000", 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083153899999999995 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009971+0000", 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9183000000000003e-05 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.010086+0000", 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011472300000000001 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.710461045999999, 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051848809999999997, 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.800 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 738 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024636+0000", 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0999999999999998e-06 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024647+0000", 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1270000000000001e-05 2024-04-26T07:49:35.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024679+0000", 2024-04-26T07:49:35.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1069999999999999e-05 2024-04-26T07:49:35.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024698+0000", 2024-04-26T07:49:35.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9887000000000001e-05 2024-04-26T07:49:35.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024806+0000", 2024-04-26T07:49:35.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010731899999999999 2024-04-26T07:49:35.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024938+0000", 2024-04-26T07:49:35.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013236899999999999 2024-04-26T07:49:35.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:35.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.025208+0000", 2024-04-26T07:49:35.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027009700000000001 2024-04-26T07:49:35.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.026465+0000", 2024-04-26T07:49:35.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012567800000000001 2024-04-26T07:49:35.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029663+0000", 2024-04-26T07:49:35.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003197667 2024-04-26T07:49:35.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029751+0000", 2024-04-26T07:49:35.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8578999999999993e-05 2024-04-26T07:49:35.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029819+0000", 2024-04-26T07:49:35.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7743000000000005e-05 2024-04-26T07:49:35.810 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.810 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.810 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.811 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.811 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:35.811 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.614365970999998, 2024-04-26T07:49:35.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003055978, 2024-04-26T07:49:35.811 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.811 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.811 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.812 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 778 2024-04-26T07:49:35.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.812 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:35.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:35.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120731+0000", 2024-04-26T07:49:35.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2869999999999999e-06 2024-04-26T07:49:35.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120743+0000", 2024-04-26T07:49:35.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1656e-05 2024-04-26T07:49:35.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120774+0000", 2024-04-26T07:49:35.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1309999999999997e-05 2024-04-26T07:49:35.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120790+0000", 2024-04-26T07:49:35.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5187e-05 2024-04-26T07:49:35.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120910+0000", 2024-04-26T07:49:35.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119979 2024-04-26T07:49:35.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121125+0000", 2024-04-26T07:49:35.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000215324 2024-04-26T07:49:35.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:35.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121440+0000", 2024-04-26T07:49:35.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031488499999999999 2024-04-26T07:49:35.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.122682+0000", 2024-04-26T07:49:35.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001242033 2024-04-26T07:49:35.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123599+0000", 2024-04-26T07:49:35.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00091723900000000003 2024-04-26T07:49:35.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123718+0000", 2024-04-26T07:49:35.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119306 2024-04-26T07:49:35.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123785+0000", 2024-04-26T07:49:35.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6772000000000004e-05 2024-04-26T07:49:35.822 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.822 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.822 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.823 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.823 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:35.823 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.556769396, 2024-04-26T07:49:35.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030101080000000001, 2024-04-26T07:49:35.823 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.823 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.824 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.824 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 802 2024-04-26T07:49:35.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.824 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:35.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:35.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178328+0000", 2024-04-26T07:49:35.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5830000000000001e-06 2024-04-26T07:49:35.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178340+0000", 2024-04-26T07:49:35.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1347e-05 2024-04-26T07:49:35.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178371+0000", 2024-04-26T07:49:35.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1303000000000002e-05 2024-04-26T07:49:35.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178386+0000", 2024-04-26T07:49:35.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5043e-05 2024-04-26T07:49:35.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178500+0000", 2024-04-26T07:49:35.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114339 2024-04-26T07:49:35.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178722+0000", 2024-04-26T07:49:35.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022198199999999999 2024-04-26T07:49:35.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:35.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.179047+0000", 2024-04-26T07:49:35.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000324667 2024-04-26T07:49:35.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.180162+0000", 2024-04-26T07:49:35.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001114711 2024-04-26T07:49:35.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181123+0000", 2024-04-26T07:49:35.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00096165200000000001 2024-04-26T07:49:35.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181220+0000", 2024-04-26T07:49:35.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7139000000000006e-05 2024-04-26T07:49:35.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181336+0000", 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011534199999999999 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:35.835 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.442544329, 2024-04-26T07:49:35.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029764090000000002, 2024-04-26T07:49:35.836 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.836 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.836 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.836 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 850 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:35.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292553+0000", 2024-04-26T07:49:35.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4399999999999999e-06 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292565+0000", 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.154e-05 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292595+0000", 2024-04-26T07:49:35.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0433000000000002e-05 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292613+0000", 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7759999999999999e-05 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292738+0000", 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012527600000000001 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292948+0000", 2024-04-26T07:49:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020985099999999999 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.293260+0000", 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031240100000000002 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.294440+0000", 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00117979 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295370+0000", 2024-04-26T07:49:35.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092946599999999999 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295460+0000", 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0529e-05 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295527+0000", 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6922999999999996e-05 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.438547737999997, 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029089200000000002, 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 852 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296550+0000", 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.39e-06 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296563+0000", 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2763e-05 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296593+0000", 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0929999999999997e-05 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296611+0000", 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7453e-05 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296715+0000", 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000104522 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296846+0000", 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130066 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.297118+0000", 2024-04-26T07:49:35.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027257399999999998 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.298189+0000", 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001071242 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299293+0000", 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001103845 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299388+0000", 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4462000000000005e-05 2024-04-26T07:49:35.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299456+0000", 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8672999999999998e-05 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.391072297000001, 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003029908, 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.848 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 873 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344025+0000", 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6959999999999999e-06 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344036+0000", 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1226999999999999e-05 2024-04-26T07:49:35.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344061+0000", 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5309000000000001e-05 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344080+0000", 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8853000000000001e-05 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344227+0000", 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014731600000000001 2024-04-26T07:49:35.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344358+0000", 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013102900000000001 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344646+0000", 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000287965 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.345790+0000", 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001143926 2024-04-26T07:49:35.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346903+0000", 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011127610000000001 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346987+0000", 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4350000000000004e-05 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.347053+0000", 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5475999999999994e-05 2024-04-26T07:49:35.853 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.246306525000001, 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031214210000000001, 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.854 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 934 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:35.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488791+0000", 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6199999999999999e-06 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488806+0000", 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4963000000000001e-05 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488840+0000", 2024-04-26T07:49:35.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3793e-05 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488862+0000", 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2325999999999999e-05 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488994+0000", 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013211899999999999 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489218+0000", 2024-04-26T07:49:35.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223482 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489533+0000", 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031546100000000001 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.490516+0000", 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00098278499999999991 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491625+0000", 2024-04-26T07:49:35.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001108904 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491793+0000", 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167873 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491910+0000", 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117095 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.239152437000001, 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030389750000000002, 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 937 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495945+0000", 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.84e-06 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495955+0000", 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0787e-05 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495986+0000", 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1093000000000002e-05 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496005+0000", 2024-04-26T07:49:35.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8236e-05 2024-04-26T07:49:35.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496127+0000", 2024-04-26T07:49:35.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000122069 2024-04-26T07:49:35.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496372+0000", 2024-04-26T07:49:35.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024480200000000002 2024-04-26T07:49:35.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:35.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496723+0000", 2024-04-26T07:49:35.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000351357 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.497773+0000", 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001050411 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498698+0000", 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092447199999999997 2024-04-26T07:49:35.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498861+0000", 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016297600000000001 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498982+0000", 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120932 2024-04-26T07:49:35.866 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:1110 3.25 e53/17 3:a41b494f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_1:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.4893510299999999, 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097024650000000004, 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245746+0000", 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2989999999999999e-06 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248386+0000", 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002639742 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248416+0000", 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9512000000000001e-05 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248430+0000", 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4603999999999999e-05 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248517+0000", 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6917999999999997e-05 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248544+0000", 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6625999999999999e-05 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255383+0000", 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068395399999999999 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255447+0000", 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3224000000000003e-05 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1843 4.11 4:89fe48a8:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:31.515151+0000", 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.2199439959999996, 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0064329189999999996, 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.871 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1843 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515151+0000", 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515151+0000", 2024-04-26T07:49:35.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515152+0000", 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0900000000000002e-07 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515156+0000", 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2039999999999999e-06 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515165+0000", 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7770000000000008e-06 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515171+0000", 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7680000000000003e-06 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515307+0000", 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135351 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515432+0000", 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012479599999999999 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515588+0000", 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015624599999999999 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.516416+0000", 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00082798400000000003 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521531+0000", 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051152309999999996 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521560+0000", 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8867999999999999e-05 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521584+0000", 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4185e-05 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.876 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1936 4.11 4:89fe48a8:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:31.703357+0000", 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.0317378130000003, 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066242610000000002, 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1936 2024-04-26T07:49:35.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703357+0000", 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703357+0000", 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:35.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703358+0000", 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1399999999999997e-07 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703361+0000", 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.191e-06 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703369+0000", 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4810000000000006e-06 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703376+0000", 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2979999999999997e-06 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703420+0000", 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4149e-05 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703491+0000", 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1313e-05 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703581+0000", 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0073000000000003e-05 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.704149+0000", 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056793000000000002 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.709928+0000", 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057791930000000002 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.709961+0000", 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.239e-05 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.709982+0000", 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0729000000000001e-05 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:35.882 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:35.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:49:35.884 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:35.885 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:35.880+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:35.986 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:35.983+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:36.016 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:36.016 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:36.016 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:36.016 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:36.030 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:36.086 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:36.084+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:36.187 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:36.184+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:36.188 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:36.189 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:36.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:36.289 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:36.287+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:36.329 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:36.329 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:36.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:36.329 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:36.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.329 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:46 7.1f e26/25 7:f95f44c2:::notify.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 66.750565700999999, 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081628929999999992, 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578311+0000", 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2460000000000002e-06 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578328+0000", 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7090000000000001e-05 2024-04-26T07:49:36.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578380+0000", 2024-04-26T07:49:36.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.126e-05 2024-04-26T07:49:36.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578417+0000", 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7008999999999998e-05 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578579+0000", 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016204899999999999 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578632+0000", 2024-04-26T07:49:36.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3103000000000003e-05 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586350+0000", 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007717944 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586472+0000", 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000122192 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.334 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1081 4.3d 4:bebb386e:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4601282080000004, 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066071109999999997, 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.335 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1081 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868748+0000", 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.68e-06 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868758+0000", 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4900000000000006e-06 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868781+0000", 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2989999999999998e-05 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868798+0000", 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7686999999999999e-05 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869173+0000", 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037481999999999999 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869499+0000", 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032565200000000001 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869868+0000", 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036949800000000001 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872636+0000", 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002768005 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875065+0000", 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024284910000000001 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875199+0000", 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134599 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875354+0000", 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015419899999999999 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1082 4.22 4:47838f18:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4599823650000001, 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071607529999999997, 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1082 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868894+0000", 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3999999999999999e-06 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868902+0000", 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.32e-06 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868922+0000", 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.978e-05 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868938+0000", 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.592e-05 2024-04-26T07:49:36.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.870448+0000", 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001510646 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.870736+0000", 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028800800000000002 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871097+0000", 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036016800000000001 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875126+0000", 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040298039999999997 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875884+0000", 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00075710800000000004 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875982+0000", 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8339999999999997e-05 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.876053+0000", 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1259000000000003e-05 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1086 4.1 4:8294b3c5:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4598834099999998, 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070958210000000004, 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1086 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868993+0000", 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6670000000000001e-06 2024-04-26T07:49:36.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869002+0000", 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7399999999999993e-06 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869023+0000", 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.126e-05 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869038+0000", 2024-04-26T07:49:36.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5113000000000001e-05 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871303+0000", 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022652420000000002 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871601+0000", 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029784800000000003 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:36.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872002+0000", 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040058800000000001 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875718+0000", 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037166320000000001 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875893+0000", 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017413899999999999 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875975+0000", 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2542999999999999e-05 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.876087+0000", 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112049 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1111 3.1d e53/17 3:b91fd52e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_2:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.0766029150000005, 2024-04-26T07:49:36.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010266506999999999, 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252274+0000", 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.08e-06 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254939+0000", 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026646360000000002 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254973+0000", 2024-04-26T07:49:36.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4029999999999998e-05 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254989+0000", 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5967000000000001e-05 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.255132+0000", 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014352500000000001 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.255177+0000", 2024-04-26T07:49:36.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4916999999999997e-05 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262405+0000", 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007228473 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262538+0000", 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132879 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.1134702270000005, 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:49:36.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1621 4.18 4:1aea0c14:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.573801209, 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071314259999999997, 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1621 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755076+0000", 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0559999999999999e-06 2024-04-26T07:49:36.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755087+0000", 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.169e-05 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755120+0000", 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2305999999999999e-05 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755140+0000", 2024-04-26T07:49:36.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0307000000000001e-05 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755341+0000", 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020068500000000001 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755661+0000", 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032058500000000002 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756074+0000", 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041255699999999997 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758390+0000", 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023158620000000001 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.761950+0000", 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0035604999999999999 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762099+0000", 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148939 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762205+0000", 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105939 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1622 4.13 4:c9d5fa89:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.5736788400000004, 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070301269999999997, 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1622 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755197+0000", 2024-04-26T07:49:36.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.513e-06 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755206+0000", 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6570000000000003e-06 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755242+0000", 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5689000000000003e-05 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755259+0000", 2024-04-26T07:49:36.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7410000000000001e-05 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755409+0000", 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014988299999999999 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755734+0000", 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032503099999999999 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756113+0000", 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037915699999999997 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758805+0000", 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026914959999999998 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.761996+0000", 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031908689999999998 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762120+0000", 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012476300000000001 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762226+0000", 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105659 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1626 4.18 4:1a86fbd9:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.5734790050000003, 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079515620000000006, 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1626 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.375 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755398+0000", 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0200000000000001e-06 2024-04-26T07:49:36.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755408+0000", 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9729999999999992e-06 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755429+0000", 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0866999999999999e-05 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755443+0000", 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4809e-05 2024-04-26T07:49:36.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756742+0000", 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001298766 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.757063+0000", 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032037400000000001 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.757510+0000", 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044743400000000003 2024-04-26T07:49:36.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762284+0000", 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047744019999999996 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763067+0000", 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078240500000000001 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763221+0000", 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015389900000000001 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763347+0000", 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126613 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1629 4.22 4:46647a10:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.5733920020000003, 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068722949999999996, 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1629 2024-04-26T07:49:36.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755484+0000", 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.64e-06 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755493+0000", 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5129999999999996e-06 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755513+0000", 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9729999999999999e-05 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755526+0000", 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3487e-05 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755669+0000", 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014300900000000001 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755997+0000", 2024-04-26T07:49:36.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000328041 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756420+0000", 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042322699999999998 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758834+0000", 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024139370000000001 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762084+0000", 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032494030000000001 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762236+0000", 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015231199999999999 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762355+0000", 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118996 2024-04-26T07:49:36.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1719 4.18 4:1a86fbd9:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.3262521429999996, 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073046129999999997, 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.387 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1719 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002624+0000", 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.37e-06 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002630+0000", 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7570000000000001e-06 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002649+0000", 2024-04-26T07:49:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9476000000000001e-05 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002665+0000", 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5523999999999999e-05 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.003982+0000", 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001317737 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004167+0000", 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018405900000000001 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004432+0000", 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026543200000000002 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.006970+0000", 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025381240000000001 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009785+0000", 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028153750000000002 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009865+0000", 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9809999999999997e-05 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009927+0000", 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1948999999999999e-05 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.392 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1844 4.18 4:1b7f0f9d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515508+0000", 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8133662240000001, 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060644080000000003, 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1844 2024-04-26T07:49:36.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515508+0000", 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515508+0000", 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515509+0000", 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8700000000000004e-07 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515516+0000", 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4330000000000001e-06 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515533+0000", 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6932999999999999e-05 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515543+0000", 2024-04-26T07:49:36.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9739999999999997e-06 2024-04-26T07:49:36.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515673+0000", 2024-04-26T07:49:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012985899999999999 2024-04-26T07:49:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516014+0000", 2024-04-26T07:49:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00034150100000000002 2024-04-26T07:49:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516468+0000", 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045336699999999998 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520833+0000", 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043652220000000002 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521283+0000", 2024-04-26T07:49:36.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044981699999999998 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521478+0000", 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019492199999999999 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521573+0000", 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5393e-05 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1845 4.13 4:c82ab556:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8133108040000003, 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067396230000000001, 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1845 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.400 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515565+0000", 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1000000000000001e-06 2024-04-26T07:49:36.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515571+0000", 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1800000000000001e-06 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515593+0000", 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1526999999999999e-05 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515607+0000", 2024-04-26T07:49:36.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4363e-05 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515758+0000", 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015042199999999999 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516096+0000", 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033855099999999998 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516536+0000", 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043945399999999998 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520983+0000", 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044475579999999999 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522142+0000", 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011591450000000001 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522235+0000", 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2726999999999995e-05 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522304+0000", 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8596000000000005e-05 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.405 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1848 4.1 4:80bca84c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8131654949999998, 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065023809999999998, 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1848 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515710+0000", 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.203e-06 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515717+0000", 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7170000000000002e-06 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515735+0000", 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7652999999999999e-05 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515749+0000", 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4527e-05 2024-04-26T07:49:36.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515893+0000", 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014347900000000001 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516200+0000", 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030680099999999999 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:36.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516615+0000", 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041556699999999999 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520878+0000", 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042629620000000003 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522058+0000", 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00118031 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522142+0000", 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3765999999999997e-05 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522212+0000", 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9395999999999998e-05 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1937 4.18 4:1b7f0f9d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.6252067050000001, 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062723520000000001, 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1937 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703669+0000", 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.483e-06 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703678+0000", 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.14e-06 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703700+0000", 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2603e-05 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703716+0000", 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5855999999999999e-05 2024-04-26T07:49:36.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703880+0000", 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000164353 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704084+0000", 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000203215 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704309+0000", 2024-04-26T07:49:36.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000225116 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.706571+0000", 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022619820000000001 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709718+0000", 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031474229999999999 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709832+0000", 2024-04-26T07:49:36.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000114159 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108022 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1938 4.13 4:c82ab556:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.6251284029999997, 2024-04-26T07:49:36.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006194059, 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1938 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703747+0000", 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.15e-06 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703754+0000", 2024-04-26T07:49:36.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703773+0000", 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9029999999999999e-05 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703787+0000", 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4080000000000001e-05 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703924+0000", 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013718199999999999 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704137+0000", 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000212909 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704418+0000", 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028120800000000002 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707332+0000", 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002913831 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709747+0000", 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024147119999999998 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709845+0000", 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8375999999999995e-05 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5476999999999994e-05 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1940 4.3a 4:5c1674d7:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.6250518459999999, 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061173099999999999, 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.423 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1940 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703824+0000", 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.147e-06 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703830+0000", 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2759999999999997e-06 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703849+0000", 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8916e-05 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703863+0000", 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4147e-05 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704250+0000", 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038648000000000003 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704325+0000", 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5204999999999996e-05 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704433+0000", 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010753500000000001 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.706587+0000", 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002154319 2024-04-26T07:49:36.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709709+0000", 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031223000000000002 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709831+0000", 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012155300000000001 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:36.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010943200000000001 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1941 4.1 4:80bca84c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.6249793300000004, 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006217513, 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.429 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1941 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703897+0000", 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.263e-06 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703902+0000", 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.66e-06 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703920+0000", 2024-04-26T07:49:36.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8179999999999999e-05 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703936+0000", 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5107e-05 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704064+0000", 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012880899999999999 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704269+0000", 2024-04-26T07:49:36.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000204632 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704544+0000", 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027522799999999997 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707930+0000", 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033854660000000002 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709974+0000", 2024-04-26T07:49:36.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020446629999999999 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.710069+0000", 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4257000000000002e-05 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.710113+0000", 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4248000000000001e-05 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1954 4.18 4:1b53c819:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.8.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.4838545960000005, 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069431889999999998, 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1954 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845021+0000", 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.37e-07 2024-04-26T07:49:36.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845025+0000", 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6070000000000001e-06 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845036+0000", 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0703999999999999e-05 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845043+0000", 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0659999999999998e-06 2024-04-26T07:49:36.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846350+0000", 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00130725 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846508+0000", 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015776599999999999 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846717+0000", 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020922200000000001 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851822+0000", 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051043240000000004 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851889+0000", 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7199999999999994e-05 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851923+0000", 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3782000000000003e-05 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851963+0000", 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0630999999999998e-05 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2047 4.18 4:1b53c819:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.307770541, 2024-04-26T07:49:36.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072732830000000002, 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2047 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021105+0000", 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4299999999999998e-07 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021107+0000", 2024-04-26T07:49:36.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021115+0000", 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7559999999999999e-06 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021121+0000", 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5040000000000002e-06 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022441+0000", 2024-04-26T07:49:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00132037 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022550+0000", 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010914 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022714+0000", 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016400900000000001 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028191+0000", 2024-04-26T07:49:36.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005477132 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028308+0000", 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011705999999999999 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028346+0000", 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7867000000000002e-05 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028377+0000", 2024-04-26T07:49:36.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1219e-05 2024-04-26T07:49:36.446 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.446 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.446 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.446 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.446 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.446 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:36.447 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:36.448 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:36.444+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:36.549 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:36.547+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:36.618 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:36.618 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:36.618 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:36.618 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:36.632 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:36.680 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:36.679+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:36.750 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:36.747+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:36.800 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:36.800 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:36.800 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:36.800 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:36.800 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:36.814 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:36.851 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:36.848+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:36.863 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:49:36.952 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:36.948+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:36.986 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:36.986 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:36.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:36.986 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596391209088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.392529124000006, 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006394205, 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.987 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 49 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591754+0000", 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.103e-06 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591762+0000", 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509999999999995e-06 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591791+0000", 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8668999999999999e-05 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591806+0000", 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5051e-05 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591925+0000", 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119163 2024-04-26T07:49:36.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592111+0000", 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000185694 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592438+0000", 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032695800000000002 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.593651+0000", 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012125320000000001 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.597931+0000", 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042799709999999996 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598007+0000", 2024-04-26T07:49:36.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6389000000000003e-05 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598146+0000", 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013872400000000001 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T07:49:36.993 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.386747373999995, 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037973019999999998, 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 205 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597533+0000", 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597536+0000", 2024-04-26T07:49:36.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3000000000000002e-06 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597551+0000", 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4932999999999999e-05 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597589+0000", 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7137e-05 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597607+0000", 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8913e-05 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.597788+0000", 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018071499999999999 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.598155+0000", 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036658699999999998 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.598898+0000", 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00074370700000000003 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.600857+0000", 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001958441 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601163+0000", 2024-04-26T07:49:36.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030609799999999998 2024-04-26T07:49:36.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:36.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:36.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601253+0000", 2024-04-26T07:49:36.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509e-05 2024-04-26T07:49:36.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:36.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.601330+0000", 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7961999999999997e-05 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:219 6.4 e29/23 6:227f63b5:gc::gc.14:head v 29'4, mlcod=26'2)", 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.327909882, 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079552349999999997, 2024-04-26T07:49:37.000 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656373+0000", 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0430000000000002e-06 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656384+0000", 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1214e-05 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656410+0000", 2024-04-26T07:49:37.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6553000000000001e-05 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656424+0000", 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3057000000000001e-05 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656523+0000", 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9304999999999999e-05 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656559+0000", 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6170000000000001e-05 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664230+0000", 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076710540000000001 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664326+0000", 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5839000000000002e-05 2024-04-26T07:49:37.004 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:425 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.202848888999995, 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040099369999999999, 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.005 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 425 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781432+0000", 2024-04-26T07:49:37.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781435+0000", 2024-04-26T07:49:37.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8600000000000001e-06 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781449+0000", 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4107000000000001e-05 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781487+0000", 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8819000000000002e-05 2024-04-26T07:49:37.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781509+0000", 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1526e-05 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781619+0000", 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110401 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781905+0000", 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028538499999999998 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782316+0000", 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041122499999999998 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.783564+0000", 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001248323 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785182+0000", 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016181259999999999 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785321+0000", 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013868600000000001 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785442+0000", 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120479 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:426 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.202726080000005, 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042315030000000002, 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 426 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781554+0000", 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781556+0000", 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5400000000000001e-06 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781567+0000", 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1177e-05 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781590+0000", 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2929e-05 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781606+0000", 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5670000000000001e-05 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.781730+0000", 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012455800000000001 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782012+0000", 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028137700000000003 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.782402+0000", 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039053999999999998 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785218+0000", 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028154040000000001 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785561+0000", 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00034358199999999999 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785690+0000", 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012918700000000001 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.785786+0000", 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5538999999999994e-05 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:434 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:49:37.018 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.197364621000006, 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040682310000000003, 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 434 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:49:37.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786916+0000", 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786918+0000", 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.95e-06 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786928+0000", 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8369999999999992e-06 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786958+0000", 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0125999999999999e-05 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.786970+0000", 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.206e-05 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787094+0000", 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000124079 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787302+0000", 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208495 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.787827+0000", 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00052492200000000004 2024-04-26T07:49:37.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790649+0000", 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028216040000000001 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790750+0000", 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010141699999999999 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790885+0000", 2024-04-26T07:49:37.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013442799999999999 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.790984+0000", 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9313000000000003e-05 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:954 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:37.024 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.451346020000003, 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066500159999999999, 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 954 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532936+0000", 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3599999999999999e-06 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532943+0000", 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8369999999999999e-06 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532962+0000", 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.916e-05 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532976+0000", 2024-04-26T07:49:37.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3703000000000001e-05 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533067+0000", 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1049000000000002e-05 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533213+0000", 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146236 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:37.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533543+0000", 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033018000000000001 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.534585+0000", 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010418879999999999 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539432+0000", 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048471809999999999 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539516+0000", 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4055999999999996e-05 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539585+0000", 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8366000000000002e-05 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1111 3.1d 3:b91fd52e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.030 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.736118008, 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014830878, 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1111 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248165+0000", 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1840000000000002e-06 2024-04-26T07:49:37.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251340+0000", 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031757589999999998 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251374+0000", 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3680000000000003e-05 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251390+0000", 2024-04-26T07:49:37.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5650000000000001e-05 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251571+0000", 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018103300000000001 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251811+0000", 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023969099999999999 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252027+0000", 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021619900000000001 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.261108+0000", 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090814740000000008 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262828+0000", 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001719363 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262916+0000", 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8916e-05 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262993+0000", 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6928999999999995e-05 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1197 4.3e 4:7df5f364:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.036 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4529069559999996, 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059453709999999996, 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1197 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:37.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531376+0000", 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5739999999999998e-06 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531388+0000", 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.219e-05 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531432+0000", 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4045999999999998e-05 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532959+0000", 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00152674 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533077+0000", 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011815300000000001 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533400+0000", 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000323021 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533667+0000", 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026668500000000001 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535048+0000", 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001380558 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537058+0000", 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020102700000000002 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537217+0000", 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015946499999999999 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537319+0000", 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010166900000000001 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1216 4.2 e53/19 4:4088b346:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.6:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.733423+0000", 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.2508573639999998, 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039186610000000004, 2024-04-26T07:49:37.042 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733423+0000", 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733423+0000", 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733424+0000", 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.201e-06 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733434+0000", 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4059999999999994e-06 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733453+0000", 2024-04-26T07:49:37.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9610999999999999e-05 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733463+0000", 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8069999999999994e-06 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733645+0000", 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000181893 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733671+0000", 2024-04-26T07:49:37.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6336999999999999e-05 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737270+0000", 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003598445 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737342+0000", 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1960999999999998e-05 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.046 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1246 3.2f 3:f6e96107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.7372370509999993, 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023540999999999999, 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1246 2024-04-26T07:49:37.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247046+0000", 2024-04-26T07:49:37.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9270000000000001e-06 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252338+0000", 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052911449999999997 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252378+0000", 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0299999999999997e-05 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252396+0000", 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8600000000000001e-05 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252475+0000", 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8669000000000002e-05 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252592+0000", 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011717 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:37.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252971+0000", 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037877499999999998 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.262239+0000", 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092677920000000004 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270496+0000", 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082573809999999994 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270545+0000", 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8627e-05 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270585+0000", 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9613999999999997e-05 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.5178.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:37.052 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.1284892720000004, 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070304649999999996, 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.5178", 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/2720801126", 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 4 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:37.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855794+0000", 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5129999999999999e-06 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855803+0000", 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5470000000000002e-06 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855824+0000", 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0276999999999999e-05 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855839+0000", 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5673000000000001e-05 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855972+0000", 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013249600000000001 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855983+0000", 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862532+0000", 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065490410000000002 2024-04-26T07:49:37.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862657+0000", 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012515900000000001 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862822+0000", 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000164819 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1723 4.38 4:1e5b5a54:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.9819546800000003, 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054881019999999999, 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.058 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1723 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002328+0000", 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.21e-06 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002338+0000", 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.009e-05 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002368+0000", 2024-04-26T07:49:37.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0236999999999999e-05 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002384+0000", 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5333e-05 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002540+0000", 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015670899999999999 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002770+0000", 2024-04-26T07:49:37.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000229562 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.003076+0000", 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030549400000000001 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004792+0000", 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001716429 2024-04-26T07:49:37.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007664+0000", 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028718620000000002 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007750+0000", 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5796000000000003e-05 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007814+0000", 2024-04-26T07:49:37.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4380000000000004e-05 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1734 4.32 4:4fe789d6:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.159275+0000", 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.8250060389999998, 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048089430000000004, 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.064 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1734 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159275+0000", 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159275+0000", 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159277+0000", 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3070000000000001e-06 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159289+0000", 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1827e-05 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159324+0000", 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5502e-05 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159346+0000", 2024-04-26T07:49:37.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2019999999999999e-05 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159562+0000", 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021560199999999999 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159955+0000", 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039302100000000002 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.160333+0000", 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000378088 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.162018+0000", 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001685349 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.163833+0000", 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018150149999999999 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.163974+0000", 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014034200000000001 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.164083+0000", 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010987 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1737 4.38 4:1c5b1b5d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.8248865500000004, 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058270199999999996, 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1737 2024-04-26T07:49:37.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159396+0000", 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0499999999999999e-06 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159410+0000", 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4124000000000001e-05 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159461+0000", 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0949000000000003e-05 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159530+0000", 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8780000000000002e-05 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159716+0000", 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186295 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.161226+0000", 2024-04-26T07:49:37.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00150935 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.162449+0000", 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012232090000000001 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.164854+0000", 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024051279999999999 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165063+0000", 2024-04-26T07:49:37.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020894899999999999 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165153+0000", 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9913000000000005e-05 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165221+0000", 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8273000000000002e-05 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1827 4.32 4:4fe789d6:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.362979+0000", 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.6213013219999999, 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040214780000000002, 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1827 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.077 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.362979+0000", 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.362979+0000", 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.362981+0000", 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2340000000000001e-06 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.362992+0000", 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0475999999999999e-05 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363024+0000", 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1897000000000003e-05 2024-04-26T07:49:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363040+0000", 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5736e-05 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363188+0000", 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148369 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363406+0000", 2024-04-26T07:49:37.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000218419 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363680+0000", 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027372399999999998 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.365579+0000", 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018986280000000001 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.366762+0000", 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00118311 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.366897+0000", 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135442 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.367001+0000", 2024-04-26T07:49:37.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010344300000000001 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1830 4.38 4:1c5b1b5d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.363084+0000", 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.6211969029999995, 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047607639999999998, 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.083 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1830 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363084+0000", 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363084+0000", 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363085+0000", 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.404e-06 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363092+0000", 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7730000000000002e-06 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363119+0000", 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6866999999999999e-05 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363135+0000", 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6730000000000001e-05 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363314+0000", 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178779 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363518+0000", 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020422100000000001 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.363785+0000", 2024-04-26T07:49:37.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026647200000000002 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.366818+0000", 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0030328870000000002 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.367663+0000", 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00084532499999999996 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.367745+0000", 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2346000000000001e-05 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.367844+0000", 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8960000000000001e-05 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1846 4.3e 4:7c4ddb29:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515335+0000", 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.4689456510000003, 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054364909999999999, 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.090 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1846 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515335+0000", 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515335+0000", 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515338+0000", 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.773e-06 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515360+0000", 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2682999999999999e-05 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515402+0000", 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1893e-05 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515428+0000", 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5389999999999999e-05 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515648+0000", 2024-04-26T07:49:37.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000220139 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516062+0000", 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041426400000000002 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516493+0000", 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043141400000000003 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.518555+0000", 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020616160000000001 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520473+0000", 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019177109999999999 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520658+0000", 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018535599999999999 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520771+0000", 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011325200000000001 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1848 4.1 e55/19 4:80bca84c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.10:head v 55'7, mlcod=54'5)", 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.517782+0000", 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.4664980539999997, 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039586880000000001, 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.096 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517782+0000", 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517782+0000", 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517785+0000", 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0700000000000001e-06 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517800+0000", 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5809999999999999e-05 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517840+0000", 2024-04-26T07:49:37.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9326000000000003e-05 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517859+0000", 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9224000000000001e-05 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.518032+0000", 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017293199999999999 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.518086+0000", 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.384e-05 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521626+0000", 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0035398869999999998 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521741+0000", 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115599 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.100 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1939 4.3e 4:7c4ddb29:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703506+0000", 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.280774203, 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040443579999999996, 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1939 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703506+0000", 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703506+0000", 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703509+0000", 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1670000000000002e-06 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703519+0000", 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0576e-05 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703555+0000", 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6213e-05 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703578+0000", 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2200000000000001e-05 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703728+0000", 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015096599999999999 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703965+0000", 2024-04-26T07:49:37.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236202 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704231+0000", 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026681799999999999 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.706759+0000", 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025276209999999999 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707457+0000", 2024-04-26T07:49:37.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00069753000000000003 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707510+0000", 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3454e-05 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707551+0000", 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0611000000000001e-05 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.106 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.107 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.107 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.107 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:37.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:37.109 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:37.107+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:37.209 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:37.204+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:37.277 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:37.277 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:37.291 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:37.335 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:37.335+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:37.411 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:37.407+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:37.412 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:37.412 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:37.412 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:37.412 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:37.412 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:37.426 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:37.460 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:37.511 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:37.511+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:37.595 INFO:tasks.workunit.client.0.smithi053.stdout:quota enabled for the bucket: buck_2024_03_26_07_49_33 2024-04-26T07:49:37.595 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 2Gb. 2024-04-26T07:49:37.595 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:37.595 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-04-26T07:49:37.595 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:37.595 INFO:tasks.workunit.client.0.smithi053.stdout:delete objects successful 2024-04-26T07:49:37.596 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:37.596 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:37.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:37.596 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.038532207000003, 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.597 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:49:37.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:49:37.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:49:37.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:726 6.1e e29/23 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head v 29'4, mlcod=29'2)", 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.602570697000004, 2024-04-26T07:49:37.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037299329999999999, 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993706+0000", 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993708+0000", 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6869999999999999e-06 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993719+0000", 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0526000000000001e-05 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993742+0000", 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.376e-05 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993762+0000", 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9706000000000001e-05 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993891+0000", 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012897900000000001 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.993951+0000", 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9633999999999999e-05 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997363+0000", 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118550000000001 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.997436+0000", 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3786000000000001e-05 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:954 6.a e29/23 6:541d369a:::obj_delete_at_hint.0000000125:head v 29'19, mlcod=29'17)", 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.062586132999996, 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054590150000000002, 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533691+0000", 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533693+0000", 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.623e-06 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533703+0000", 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0307e-05 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533730+0000", 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6686000000000002e-05 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533743+0000", 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3746e-05 2024-04-26T07:49:37.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533875+0000", 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013116899999999999 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533929+0000", 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4617000000000002e-05 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539030+0000", 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051009879999999999 2024-04-26T07:49:37.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539150+0000", 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119879 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1076 4.3c 4:3e9728ad:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868583+0000", 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.727694638999999, 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052534490000000003, 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.613 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1076 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868583+0000", 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868583+0000", 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868585+0000", 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8760000000000001e-06 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868600+0000", 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4867e-05 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868633+0000", 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2920000000000003e-05 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868656+0000", 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2489000000000001e-05 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868852+0000", 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000196376 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869175+0000", 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032306400000000002 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869628+0000", 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045245399999999997 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872743+0000", 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031159130000000001 2024-04-26T07:49:37.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873619+0000", 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00087540800000000005 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873739+0000", 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120442 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873836+0000", 2024-04-26T07:49:37.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6639999999999996e-05 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1080 4.a 4:53cd8e39:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868719+0000", 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.727558027000001, 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004535814, 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.619 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1080 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868719+0000", 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868719+0000", 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868721+0000", 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.483e-06 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868730+0000", 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3570000000000004e-06 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868762+0000", 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2122999999999997e-05 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868779+0000", 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.702e-05 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868893+0000", 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011401899999999999 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869172+0000", 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027872200000000002 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869628+0000", 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045571700000000001 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872456+0000", 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002828175 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873009+0000", 2024-04-26T07:49:37.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000553069 2024-04-26T07:49:37.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873148+0000", 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139159 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873255+0000", 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010697 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1085 4.1f 4:fad8ea77:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.626 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868833+0000", 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.727444265000001, 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005253583, 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1085 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868833+0000", 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868833+0000", 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868834+0000", 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.344e-06 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868843+0000", 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3629999999999994e-06 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868862+0000", 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9792999999999998e-05 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868877+0000", 2024-04-26T07:49:37.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5107e-05 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869013+0000", 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013552900000000001 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869318+0000", 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030495799999999998 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869714+0000", 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000396215 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872512+0000", 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027974240000000002 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.873949+0000", 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001436898 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.874027+0000", 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8949000000000006e-05 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.874086+0000", 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9002999999999997e-05 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1082 4.22 e53/19 4:47838f18:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.6:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:37.632 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.871837+0000", 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.7244397, 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0036765259999999998, 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871837+0000", 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871837+0000", 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871839+0000", 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9860000000000001e-06 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871853+0000", 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3797e-05 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871885+0000", 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1516000000000001e-05 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871904+0000", 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9352999999999999e-05 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872039+0000", 2024-04-26T07:49:37.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013453 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872089+0000", 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0166e-05 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875392+0000", 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033035719999999998 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875514+0000", 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121606 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1118 4.3c 4:3e9728ad:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.0:head [stat,call rgw.guard_bucket_resharding in=26b,call rgw.bucket_complete_op in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.491871+0000", 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.104405818, 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040418060000000002, 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.637 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1118 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.491871+0000", 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.491871+0000", 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.491873+0000", 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0600000000000002e-06 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.491885+0000", 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1177e-05 2024-04-26T07:49:37.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.491917+0000", 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2252999999999998e-05 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.491938+0000", 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1123000000000001e-05 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.492030+0000", 2024-04-26T07:49:37.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1748000000000003e-05 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.492148+0000", 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117809 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.492549+0000", 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040164999999999998 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.493327+0000", 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00077755999999999995 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.495826+0000", 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024994829999999998 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.495872+0000", 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5537000000000001e-05 2024-04-26T07:49:37.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.495913+0000", 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1406000000000003e-05 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1194 4.3c 4:3e9728ad:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531266+0000", 2024-04-26T07:49:37.643 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.065011525999999, 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046654929999999997, 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1194 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531266+0000", 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531266+0000", 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531266+0000", 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0399999999999995e-07 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531271+0000", 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3800000000000004e-06 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531295+0000", 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4714000000000001e-05 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531301+0000", 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4960000000000004e-06 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531445+0000", 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014426799999999999 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532113+0000", 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00066816900000000003 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532364+0000", 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025054899999999998 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.534117+0000", 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017528050000000001 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535649+0000", 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001532587 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535793+0000", 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000143392 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535931+0000", 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000138429 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1198 4.a 4:53cd8e39:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531343+0000", 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.064934571, 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046693209999999997, 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.649 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1198 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531343+0000", 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531343+0000", 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531343+0000", 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6700000000000003e-07 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531346+0000", 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2009999999999999e-06 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531358+0000", 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.201e-05 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531367+0000", 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1429999999999998e-06 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531810+0000", 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044388099999999997 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533483+0000", 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0016724730000000001 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533585+0000", 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102525 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.534662+0000", 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010762300000000001 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535791+0000", 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011292019999999999 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535921+0000", 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013041600000000001 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.536012+0000", 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0573000000000002e-05 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.654 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1203 4.1f 4:fad8ea77:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531394+0000", 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.064883439999999, 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043064729999999999, 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.655 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1203 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531394+0000", 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531394+0000", 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531394+0000", 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4600000000000004e-07 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531398+0000", 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531408+0000", 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0264e-05 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531416+0000", 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8339999999999999e-06 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531546+0000", 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012985899999999999 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531811+0000", 2024-04-26T07:49:37.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000265624 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532593+0000", 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078146400000000005 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.534913+0000", 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023205650000000001 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535607+0000", 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00069396400000000004 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535661+0000", 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3594999999999998e-05 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535700+0000", 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9137999999999997e-05 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.660 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1219 4.1f 4:facee9bc:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.732588+0000", 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.8636895609999993, 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051621430000000001, 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:37.661 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1219 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732588+0000", 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732588+0000", 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732589+0000", 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2219999999999999e-06 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732595+0000", 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6969999999999998e-06 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732609+0000", 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4678000000000001e-05 2024-04-26T07:49:37.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732617+0000", 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8669999999999994e-06 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732711+0000", 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3574999999999998e-05 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.732876+0000", 2024-04-26T07:49:37.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016505 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733084+0000", 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020797599999999999 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737636+0000", 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045520919999999998 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737666+0000", 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0374000000000001e-05 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737708+0000", 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1714000000000001e-05 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737750+0000", 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1897999999999998e-05 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.666 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1214 4.18 e53/19 4:19ac740b:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2.4:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.733803+0000", 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.8624740410000005, 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041136009999999997, 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733803+0000", 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733803+0000", 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733804+0000", 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1260000000000001e-06 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733811+0000", 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7059999999999998e-06 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733826+0000", 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5270000000000001e-05 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733836+0000", 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0241000000000001e-05 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733907+0000", 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0155999999999997e-05 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.733931+0000", 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4766999999999999e-05 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737878+0000", 2024-04-26T07:49:37.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039467829999999997 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.737917+0000", 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8552e-05 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4775.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.835860+0000", 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.7604169370000005, 2024-04-26T07:49:37.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005138615, 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4775", 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/4266234575", 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 44 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835860+0000", 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835860+0000", 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835863+0000", 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3070000000000001e-06 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835872+0000", 2024-04-26T07:49:37.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4010000000000003e-06 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835893+0000", 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1447999999999999e-05 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835902+0000", 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1459999999999996e-06 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835982+0000", 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0646e-05 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.835990+0000", 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3180000000000007e-06 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.839702+0000", 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037119919999999999 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.839818+0000", 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115569 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.839986+0000", 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000167586 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.840688+0000", 2024-04-26T07:49:37.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00070204900000000005 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.840920+0000", 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023274600000000001 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.840954+0000", 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3321999999999997e-05 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.840999+0000", 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5084999999999999e-05 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1243 3.34 e54/17 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head v 54'1, mlcod=0'0)", 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.3721359750000008, 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018677787000000001, 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.678 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224143+0000", 2024-04-26T07:49:37.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7850000000000001e-06 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227226+0000", 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003083293 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227258+0000", 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2237999999999999e-05 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227273+0000", 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4312e-05 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227395+0000", 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012202200000000001 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227461+0000", 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6217000000000007e-05 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242732+0000", 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015270974 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242819+0000", 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6946000000000004e-05 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.5178.0:14 5.2 5:40000000::::head [pgnls start_epoch 55] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.875744+0000", 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.7205333429999996, 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057523610000000001, 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.5178", 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/2720801126", 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 14 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.875744+0000", 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.875744+0000", 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.875746+0000", 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:49:37.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.875756+0000", 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4830000000000005e-06 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.875776+0000", 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9809999999999998e-05 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.875820+0000", 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4137000000000001e-05 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.875961+0000", 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000140972 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.875971+0000", 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0064000000000001e-05 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.881231+0000", 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052601790000000002 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.881286+0000", 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.482e-05 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.881496+0000", 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021028900000000001 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.687 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1719 4.18 e55/19 4:1a86fbd9:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.6:head v 55'8, mlcod=54'5)", 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.005442+0000", 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.5908347369999998, 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040982470000000002, 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.005442+0000", 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.005442+0000", 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.005444+0000", 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9530000000000002e-06 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.005460+0000", 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5153999999999999e-05 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.005489+0000", 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9036000000000001e-05 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.005508+0000", 2024-04-26T07:49:37.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.967e-05 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.005637+0000", 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129202 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.005691+0000", 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3149999999999998e-05 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009454+0000", 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037630960000000001 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009541+0000", 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6985999999999997e-05 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1845 4.13 e55/19 4:c82ab556:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.7:head v 55'5, mlcod=55'3)", 2024-04-26T07:49:37.692 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.517520+0000", 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.0787568429999999, 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043816020000000001, 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517520+0000", 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517520+0000", 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517521+0000", 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0729999999999999e-06 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517539+0000", 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7819999999999999e-05 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517561+0000", 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1336999999999999e-05 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.517575+0000", 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4617000000000001e-05 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.518013+0000", 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043737300000000002 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.518068+0000", 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5887000000000002e-05 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521817+0000", 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037485719999999999 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.521902+0000", 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4923e-05 2024-04-26T07:49:37.696 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1954 4.18 e55/19 4:1b53c819:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.8.7:head v 55'12, mlcod=55'9)", 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.846824+0000", 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.7494532190000003, 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049481880000000001, 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846824+0000", 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846824+0000", 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846825+0000", 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.037e-06 2024-04-26T07:49:37.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846849+0000", 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3720999999999999e-05 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846863+0000", 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4701e-05 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846873+0000", 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8139999999999995e-06 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846969+0000", 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5956000000000001e-05 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846990+0000", 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1308e-05 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851722+0000", 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047310360000000001 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851772+0000", 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0615000000000002e-05 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2047 4.18 e55/19 4:1b53c819:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.8.7:head v 55'14, mlcod=55'11)", 2024-04-26T07:49:37.701 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:32.023137+0000", 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.5731406320000003, 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050460419999999997, 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.023137+0000", 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:37.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.023137+0000", 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.023137+0000", 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9800000000000003e-07 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.023143+0000", 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7950000000000004e-06 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:37.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.023161+0000", 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7932999999999999e-05 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.023171+0000", 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7699999999999996e-06 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.023238+0000", 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6937e-05 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.023265+0000", 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7824e-05 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028132+0000", 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048660689999999998 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028183+0000", 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1016000000000001e-05 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:37.706 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:37.706 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:37.707 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:37.707 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:37.708 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:37.708 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:37.708 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:37.709 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:37.709 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:37.710 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:37.710 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:37.710 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:37.710 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:37.711 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:37.711 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:37.711 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:37.704+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:37.716 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:37.716 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:37.737 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:37.737 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:37.808 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:37.807+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:37.881 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:37.882 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:37.896 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:37.940 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:37.939+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:38.011 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:38.007+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:38.063 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:38.063 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:38.078 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:38.112 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:38.108+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:38.212 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:38.208+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:38.228 INFO:tasks.workunit.client.0.smithi053.stderr:100+0 records in 2024-04-26T07:49:38.228 INFO:tasks.workunit.client.0.smithi053.stderr:100+0 records out 2024-04-26T07:49:38.228 INFO:tasks.workunit.client.0.smithi053.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.631995 s, 1.7 GB/s 2024-04-26T07:49:38.244 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:38.244 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:38.258 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:38.313 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:38.308+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:38.379 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:38.379 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:38.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:38.414 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:38.411+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:38.515 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:38.511+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:38.547 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:38.547 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:38.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:38.616 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:38.612+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:38.679 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:38.679 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:38.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:38.735 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:38.732+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:38.818 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:38.815+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:38.857 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:38.857 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:38.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:38.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:49:38.918 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:38.916+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:38.985 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:38.985 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:38.999 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:39.019 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:39.019+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:39.121 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:39.119+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:39.131 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:39.132 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:39.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:39.222 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:39.220+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:39.258 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:39.258 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:39.271 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:39.277 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:49:39.346 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:39.344+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:39.394 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:39.394 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:39.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:39.423 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:39.423+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:39.525 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:39.523+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:39.561 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:39.561 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:39.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:39.626 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:39.623+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:39.703 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:39.703 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:39.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:39.727 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:39.727+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:39.758 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:39.828 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:39.824+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:39.837 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:39.837 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:39.851 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:39.894 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:39.911 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:39.928 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:39.929 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:39.924+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:39.945 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:39.966 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:39.966 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:39.986 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:39.987 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:40.007 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:40.007 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:40.010 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.010 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 72.438628879000007, 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012204097000000001, 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "reached pg", 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 44 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571155+0000", 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571159+0000", 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7500000000000001e-06 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571176+0000", 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7359000000000001e-05 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571214+0000", 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7942999999999999e-05 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571240+0000", 2024-04-26T07:49:40.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6084e-05 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571398+0000", 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015818000000000001 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for peered", 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.571415+0000", 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6739e-05 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583000+0000", 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011585332 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:27.583359+0000", 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035870999999999999 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:40.015 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 70.399483442000005, 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003073423, 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 56 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610300+0000", 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610304+0000", 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1540000000000002e-06 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610315+0000", 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1596e-05 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610348+0000", 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2379999999999998e-05 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610364+0000", 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6466000000000001e-05 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610544+0000", 2024-04-26T07:49:40.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179963 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.610849+0000", 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030534099999999999 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.611143+0000", 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029372300000000002 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.612446+0000", 2024-04-26T07:49:40.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013032129999999999 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613250+0000", 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080378299999999997 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613319+0000", 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8774000000000003e-05 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613374+0000", 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.503e-05 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596391211392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 70.396239401000003, 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033841380000000001, 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 57 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613545+0000", 2024-04-26T07:49:40.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613546+0000", 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7770000000000001e-06 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613554+0000", 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7789999999999996e-06 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613578+0000", 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4236999999999999e-05 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613592+0000", 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4106e-05 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613725+0000", 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013219999999999999 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.613921+0000", 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019679800000000001 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.614275+0000", 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035357100000000001 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.615361+0000", 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010861880000000001 2024-04-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616713+0000", 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013521900000000001 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616818+0000", 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010427 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:29.616929+0000", 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111022 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 67.401602355999998, 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045711500000000004, 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.027 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 207 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608182+0000", 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608185+0000", 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2270000000000002e-06 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608199+0000", 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4049999999999999e-05 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608231+0000", 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608247+0000", 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6696000000000001e-05 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608402+0000", 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015428499999999999 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.608762+0000", 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036012099999999998 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.609476+0000", 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00071385399999999999 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612197+0000", 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027211480000000001 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612606+0000", 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040884 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612688+0000", 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1935999999999996e-05 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.612753+0000", 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5075999999999998e-05 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.032 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 67.363568091999994, 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003481442, 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.033 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 216 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646216+0000", 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646219+0000", 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8430000000000001e-06 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646232+0000", 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.358e-05 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646268+0000", 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5846999999999997e-05 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646295+0000", 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6752999999999999e-05 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646431+0000", 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013639500000000001 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.646656+0000", 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022519900000000001 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.647143+0000", 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000487009 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649075+0000", 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019313640000000001 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649552+0000", 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000476959 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649634+0000", 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1877000000000002e-05 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.649697+0000", 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3615999999999995e-05 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 67.315562619000005, 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036454130000000001, 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 227 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694221+0000", 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694224+0000", 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3099999999999999e-06 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694235+0000", 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1559999999999999e-05 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694267+0000", 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1917e-05 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694282+0000", 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5150000000000001e-05 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694426+0000", 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144058 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.694676+0000", 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024983500000000001 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.695121+0000", 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00044507299999999999 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.696591+0000", 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001469878 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697715+0000", 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011244009999999999 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697800+0000", 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4722000000000006e-05 2024-04-26T07:49:40.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.697867+0000", 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6508999999999996e-05 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 67.308126466999994, 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032415780000000002, 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.044 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 229 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701657+0000", 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701660+0000", 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.244e-06 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701671+0000", 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1326e-05 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701703+0000", 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2023999999999997e-05 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701718+0000", 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5133000000000001e-05 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.701833+0000", 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114916 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702050+0000", 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000216624 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.702472+0000", 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042268699999999999 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.703941+0000", 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001468128 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704755+0000", 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000814637 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704833+0000", 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8226000000000006e-05 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.704899+0000", 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5633e-05 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 67.301126848999999, 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003426648, 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 231 2024-04-26T07:49:40.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708657+0000", 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708659+0000", 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2630000000000002e-06 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708671+0000", 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1379999999999999e-05 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708702+0000", 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1761999999999998e-05 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708719+0000", 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6954000000000001e-05 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.708844+0000", 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012488199999999999 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709085+0000", 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000240905 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.709507+0000", 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042178700000000002 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711076+0000", 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015689530000000001 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.711928+0000", 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00085241699999999995 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712016+0000", 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7219000000000006e-05 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.712084+0000", 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8126000000000005e-05 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.055 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 67.002637230999994, 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029394930000000001, 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 730 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007147+0000", 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007149+0000", 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2500000000000001e-06 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007160+0000", 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1516e-05 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007192+0000", 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1362999999999998e-05 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007207+0000", 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5114e-05 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007316+0000", 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109252 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007539+0000", 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022263200000000001 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.007886+0000", 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034704000000000001 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009051+0000", 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001164881 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009882+0000", 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083153899999999995 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.009971+0000", 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9183000000000003e-05 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.010086+0000", 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011472300000000001 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.985149856999996, 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051848809999999997, 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.061 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 738 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024634+0000", 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024636+0000", 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0999999999999998e-06 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024647+0000", 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1270000000000001e-05 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024679+0000", 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1069999999999999e-05 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024698+0000", 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9887000000000001e-05 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024806+0000", 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010731899999999999 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.024938+0000", 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013236899999999999 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.025208+0000", 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027009700000000001 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.026465+0000", 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0012567800000000001 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029663+0000", 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003197667 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029751+0000", 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8578999999999993e-05 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.029819+0000", 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7743000000000005e-05 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.066 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.889054782000002, 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003055978, 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.067 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 778 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120729+0000", 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120731+0000", 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2869999999999999e-06 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120743+0000", 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1656e-05 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120774+0000", 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1309999999999997e-05 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120790+0000", 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5187e-05 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.120910+0000", 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119979 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121125+0000", 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000215324 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.121440+0000", 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031488499999999999 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.122682+0000", 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001242033 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123599+0000", 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00091723900000000003 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123718+0000", 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000119306 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.123785+0000", 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6772000000000004e-05 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:40.072 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.831458206999997, 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030101080000000001, 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 802 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178326+0000", 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178328+0000", 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5830000000000001e-06 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178340+0000", 2024-04-26T07:49:40.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1347e-05 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178371+0000", 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1303000000000002e-05 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178386+0000", 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5043e-05 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178500+0000", 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114339 2024-04-26T07:49:40.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.178722+0000", 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022198199999999999 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.179047+0000", 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000324667 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.180162+0000", 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001114711 2024-04-26T07:49:40.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181123+0000", 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00096165200000000001 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181220+0000", 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7139000000000006e-05 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.181336+0000", 2024-04-26T07:49:40.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011534199999999999 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.717233140000005, 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029764090000000002, 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.078 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 850 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292551+0000", 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292553+0000", 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4399999999999999e-06 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292565+0000", 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.154e-05 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292595+0000", 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0433000000000002e-05 2024-04-26T07:49:40.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292613+0000", 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7759999999999999e-05 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292738+0000", 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012527600000000001 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.292948+0000", 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020985099999999999 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.293260+0000", 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031240100000000002 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.294440+0000", 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00117979 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295370+0000", 2024-04-26T07:49:40.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092946599999999999 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295460+0000", 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0529e-05 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.295527+0000", 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6922999999999996e-05 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.713236549000001, 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029089200000000002, 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 852 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296547+0000", 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296550+0000", 2024-04-26T07:49:40.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.39e-06 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296563+0000", 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2763e-05 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296593+0000", 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0929999999999997e-05 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296611+0000", 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7453e-05 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296715+0000", 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000104522 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.296846+0000", 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000130066 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:40.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.297118+0000", 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027257399999999998 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.298189+0000", 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001071242 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299293+0000", 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001103845 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299388+0000", 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4462000000000005e-05 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.299456+0000", 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8672999999999998e-05 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.089 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.665761107999998, 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003029908, 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 873 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344023+0000", 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344025+0000", 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6959999999999999e-06 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344036+0000", 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1226999999999999e-05 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344061+0000", 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5309000000000001e-05 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344080+0000", 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8853000000000001e-05 2024-04-26T07:49:40.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344227+0000", 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014731600000000001 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344358+0000", 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013102900000000001 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.344646+0000", 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000287965 2024-04-26T07:49:40.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.345790+0000", 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001143926 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346903+0000", 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011127610000000001 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.346987+0000", 2024-04-26T07:49:40.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4350000000000004e-05 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.347053+0000", 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5475999999999994e-05 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.520995335999999, 2024-04-26T07:49:40.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031214210000000001, 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 934 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488789+0000", 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488791+0000", 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6199999999999999e-06 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488806+0000", 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4963000000000001e-05 2024-04-26T07:49:40.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488840+0000", 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3793e-05 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488862+0000", 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2325999999999999e-05 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.488994+0000", 2024-04-26T07:49:40.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013211899999999999 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489218+0000", 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000223482 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.489533+0000", 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031546100000000001 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.490516+0000", 2024-04-26T07:49:40.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00098278499999999991 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491625+0000", 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001108904 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491793+0000", 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167873 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.491910+0000", 2024-04-26T07:49:40.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117095 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.513841248000006, 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030389750000000002, 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.101 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 937 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495943+0000", 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495945+0000", 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.84e-06 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495955+0000", 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0787e-05 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.495986+0000", 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1093000000000002e-05 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496005+0000", 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8236e-05 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496127+0000", 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000122069 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496372+0000", 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024480200000000002 2024-04-26T07:49:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.496723+0000", 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000351357 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.497773+0000", 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001050411 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498698+0000", 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00092447199999999997 2024-04-26T07:49:40.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498861+0000", 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016297600000000001 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:33.498982+0000", 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120932 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:1110 3.25 e53/17 3:a41b494f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_1:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.764039841000001, 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097024650000000004, 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245744+0000", 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245746+0000", 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2989999999999999e-06 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248386+0000", 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002639742 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248416+0000", 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9512000000000001e-05 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248430+0000", 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4603999999999999e-05 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248517+0000", 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6917999999999997e-05 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.248544+0000", 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6625999999999999e-05 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255383+0000", 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068395399999999999 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255447+0000", 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3224000000000003e-05 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.110 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1843 4.11 4:89fe48a8:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:31.515151+0000", 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.4946328070000003, 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0064329189999999996, 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1843 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.111 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515151+0000", 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515151+0000", 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515152+0000", 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0900000000000002e-07 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515156+0000", 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2039999999999999e-06 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515165+0000", 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7770000000000008e-06 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515171+0000", 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7680000000000003e-06 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515307+0000", 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135351 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515432+0000", 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012479599999999999 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515588+0000", 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015624599999999999 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.516416+0000", 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00082798400000000003 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521531+0000", 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051152309999999996 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521560+0000", 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8867999999999999e-05 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521584+0000", 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4185e-05 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1936 4.11 4:89fe48a8:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.116 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:31.703357+0000", 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.3064266240000002, 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066242610000000002, 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1936 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703357+0000", 2024-04-26T07:49:40.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703357+0000", 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703358+0000", 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1399999999999997e-07 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:40.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703361+0000", 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.191e-06 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703369+0000", 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4810000000000006e-06 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703376+0000", 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.2979999999999997e-06 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:40.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703420+0000", 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4149e-05 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703491+0000", 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1313e-05 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.703581+0000", 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0073000000000003e-05 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:40.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.704149+0000", 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056793000000000002 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.709928+0000", 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057791930000000002 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.709961+0000", 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.239e-05 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:40.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.709982+0000", 2024-04-26T07:49:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0729000000000001e-05 2024-04-26T07:49:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:40.122 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:40.122 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:40.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:40.124 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:40.125 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:40.125 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:40.120+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:40.225 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:40.223+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:40.256 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:40.256 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:40.256 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:40.257 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:40.276 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:40.325 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:40.320+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:40.426 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:40.423+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:40.456 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:40.457 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:40.473 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:40.527 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:40.524+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:40.628 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:40.624+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:46 7.1f e26/25 7:f95f44c2:::notify.0:head v 26'1, mlcod=0'0)", 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 71.080999668000004, 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081628929999999992, 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578309+0000", 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578311+0000", 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2460000000000002e-06 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578328+0000", 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7090000000000001e-05 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578380+0000", 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.126e-05 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578417+0000", 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7008999999999998e-05 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578579+0000", 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016204899999999999 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.578632+0000", 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3103000000000003e-05 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586350+0000", 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007717944 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.586472+0000", 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000122192 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1081 4.3d 4:bebb386e:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:40.664 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.790562175, 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066071109999999997, 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1081 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868747+0000", 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868748+0000", 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.68e-06 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868758+0000", 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4900000000000006e-06 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868781+0000", 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2989999999999998e-05 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868798+0000", 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7686999999999999e-05 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869173+0000", 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037481999999999999 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869499+0000", 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032565200000000001 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869868+0000", 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036949800000000001 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872636+0000", 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002768005 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875065+0000", 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024284910000000001 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875199+0000", 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134599 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875354+0000", 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015419899999999999 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1082 4.22 4:47838f18:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:40.670 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.790416331999999, 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071607529999999997, 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1082 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:40.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868892+0000", 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868894+0000", 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3999999999999999e-06 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868902+0000", 2024-04-26T07:49:40.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.32e-06 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868922+0000", 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.978e-05 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868938+0000", 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.592e-05 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.870448+0000", 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001510646 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.870736+0000", 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028800800000000002 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871097+0000", 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036016800000000001 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875126+0000", 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040298039999999997 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875884+0000", 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00075710800000000004 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875982+0000", 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8339999999999997e-05 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.876053+0000", 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1259000000000003e-05 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1086 4.1 4:8294b3c5:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.790317377000001, 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070958210000000004, 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.676 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1086 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868991+0000", 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.868993+0000", 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6670000000000001e-06 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869002+0000", 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7399999999999993e-06 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869023+0000", 2024-04-26T07:49:40.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.126e-05 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.869038+0000", 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5113000000000001e-05 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871303+0000", 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022652420000000002 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.871601+0000", 2024-04-26T07:49:40.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029784800000000003 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.872002+0000", 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040058800000000001 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875718+0000", 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037166320000000001 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875893+0000", 2024-04-26T07:49:40.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017413899999999999 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.875975+0000", 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2542999999999999e-05 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:26.876087+0000", 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112049 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1111 3.1d e53/17 3:b91fd52e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_2:head v 53'1, mlcod=0'0)", 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.407036882, 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010266506999999999, 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252272+0000", 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252274+0000", 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.08e-06 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254939+0000", 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026646360000000002 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254973+0000", 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4029999999999998e-05 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.254989+0000", 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5967000000000001e-05 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.255132+0000", 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014352500000000001 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.255177+0000", 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4916999999999997e-05 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262405+0000", 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007228473 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262538+0000", 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132879 2024-04-26T07:49:40.685 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.443904194, 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:49:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1621 4.18 4:1aea0c14:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.9042351760000003, 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071314259999999997, 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1621 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755074+0000", 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755076+0000", 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0559999999999999e-06 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755087+0000", 2024-04-26T07:49:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.169e-05 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755120+0000", 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2305999999999999e-05 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755140+0000", 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0307000000000001e-05 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755341+0000", 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020068500000000001 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755661+0000", 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032058500000000002 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756074+0000", 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041255699999999997 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758390+0000", 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023158620000000001 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.761950+0000", 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0035604999999999999 2024-04-26T07:49:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762099+0000", 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148939 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762205+0000", 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105939 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1622 4.13 4:c9d5fa89:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.9041128070000006, 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070301269999999997, 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1622 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755196+0000", 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755197+0000", 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.513e-06 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755206+0000", 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6570000000000003e-06 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755242+0000", 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5689000000000003e-05 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755259+0000", 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7410000000000001e-05 2024-04-26T07:49:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755409+0000", 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014988299999999999 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755734+0000", 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032503099999999999 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756113+0000", 2024-04-26T07:49:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037915699999999997 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758805+0000", 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026914959999999998 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.761996+0000", 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031908689999999998 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762120+0000", 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012476300000000001 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762226+0000", 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105659 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1626 4.18 4:1a86fbd9:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.9039129720000005, 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079515620000000006, 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1626 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755396+0000", 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755398+0000", 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0200000000000001e-06 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755408+0000", 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9729999999999992e-06 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755429+0000", 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0866999999999999e-05 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755443+0000", 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4809e-05 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756742+0000", 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001298766 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.757063+0000", 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032037400000000001 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.757510+0000", 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044743400000000003 2024-04-26T07:49:40.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762284+0000", 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047744019999999996 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763067+0000", 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078240500000000001 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763221+0000", 2024-04-26T07:49:40.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015389900000000001 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.763347+0000", 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126613 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1629 4.22 4:46647a10:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.9038259689999997, 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068722949999999996, 2024-04-26T07:49:40.711 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1629 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755483+0000", 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755484+0000", 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.64e-06 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755493+0000", 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5129999999999996e-06 2024-04-26T07:49:40.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755513+0000", 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9729999999999999e-05 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755526+0000", 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3487e-05 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755669+0000", 2024-04-26T07:49:40.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014300900000000001 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.755997+0000", 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000328041 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.756420+0000", 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042322699999999998 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.758834+0000", 2024-04-26T07:49:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024139370000000001 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762084+0000", 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032494030000000001 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762236+0000", 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015231199999999999 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.762355+0000", 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118996 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1719 4.18 4:1a86fbd9:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.6566861100000008, 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073046129999999997, 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.717 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1719 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002623+0000", 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002624+0000", 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.37e-06 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002630+0000", 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7570000000000001e-06 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002649+0000", 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9476000000000001e-05 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002665+0000", 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5523999999999999e-05 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.003982+0000", 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001317737 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004167+0000", 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018405900000000001 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004432+0000", 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026543200000000002 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.006970+0000", 2024-04-26T07:49:40.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025381240000000001 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009785+0000", 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028153750000000002 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009865+0000", 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9809999999999997e-05 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.009927+0000", 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1948999999999999e-05 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1845 4.13 4:c82ab556:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.1437447709999997, 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067396230000000001, 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.723 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1845 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515564+0000", 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515565+0000", 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1000000000000001e-06 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515571+0000", 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1800000000000001e-06 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515593+0000", 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1526999999999999e-05 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515607+0000", 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4363e-05 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515758+0000", 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015042199999999999 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516096+0000", 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033855099999999998 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516536+0000", 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043945399999999998 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520983+0000", 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044475579999999999 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522142+0000", 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011591450000000001 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522235+0000", 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2726999999999995e-05 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522304+0000", 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8596000000000005e-05 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.728 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1848 4.1 4:80bca84c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.1435994619999992, 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065023809999999998, 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.729 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1848 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515709+0000", 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515710+0000", 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.203e-06 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515717+0000", 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7170000000000002e-06 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515735+0000", 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7652999999999999e-05 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515749+0000", 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4527e-05 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.515893+0000", 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014347900000000001 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516200+0000", 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030680099999999999 2024-04-26T07:49:40.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.516615+0000", 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041556699999999999 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.520878+0000", 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042629620000000003 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522058+0000", 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00118031 2024-04-26T07:49:40.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522142+0000", 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3765999999999997e-05 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.522212+0000", 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9395999999999998e-05 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1937 4.18 4:1b7f0f9d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.9556406719999995, 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062723520000000001, 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1937 2024-04-26T07:49:40.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703668+0000", 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703669+0000", 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.483e-06 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703678+0000", 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.14e-06 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703700+0000", 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2603e-05 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703716+0000", 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5855999999999999e-05 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703880+0000", 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000164353 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704084+0000", 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000203215 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704309+0000", 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000225116 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.706571+0000", 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022619820000000001 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709718+0000", 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031474229999999999 2024-04-26T07:49:40.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709832+0000", 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000114159 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108022 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1938 4.13 4:c82ab556:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.9555623699999991, 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006194059, 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1938 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703746+0000", 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703747+0000", 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.15e-06 2024-04-26T07:49:40.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703754+0000", 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703773+0000", 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9029999999999999e-05 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703787+0000", 2024-04-26T07:49:40.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4080000000000001e-05 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703924+0000", 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013718199999999999 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704137+0000", 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000212909 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704418+0000", 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028120800000000002 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707332+0000", 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002913831 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709747+0000", 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024147119999999998 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709845+0000", 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8375999999999995e-05 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5476999999999994e-05 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1940 4.3a 4:5c1674d7:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.746 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.9554858129999992, 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061173099999999999, 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1940 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703823+0000", 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703824+0000", 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.147e-06 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703830+0000", 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2759999999999997e-06 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703849+0000", 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8916e-05 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703863+0000", 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4147e-05 2024-04-26T07:49:40.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704250+0000", 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038648000000000003 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704325+0000", 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5204999999999996e-05 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704433+0000", 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010753500000000001 2024-04-26T07:49:40.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.706587+0000", 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002154319 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709709+0000", 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031223000000000002 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709831+0000", 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012155300000000001 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709940+0000", 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010943200000000001 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1941 4.1 4:80bca84c:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:40.752 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.9554132969999998, 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006217513, 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1941 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703895+0000", 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703897+0000", 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.263e-06 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703902+0000", 2024-04-26T07:49:40.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.66e-06 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703920+0000", 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8179999999999999e-05 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.703936+0000", 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5107e-05 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704064+0000", 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012880899999999999 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704269+0000", 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000204632 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.704544+0000", 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027522799999999997 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.707930+0000", 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033854660000000002 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.709974+0000", 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020446629999999999 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.710069+0000", 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4257000000000002e-05 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.710113+0000", 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4248000000000001e-05 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1954 4.18 4:1b53c819:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.8.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.8142885629999999, 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069431889999999998, 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1954 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845020+0000", 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845021+0000", 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.37e-07 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845025+0000", 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6070000000000001e-06 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845036+0000", 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0703999999999999e-05 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.845043+0000", 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0659999999999998e-06 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846350+0000", 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00130725 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846508+0000", 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015776599999999999 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.846717+0000", 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020922200000000001 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851822+0000", 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051043240000000004 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851889+0000", 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7199999999999994e-05 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851923+0000", 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3782000000000003e-05 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.851963+0000", 2024-04-26T07:49:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0630999999999998e-05 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2047 4.18 4:1b53c819:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.6382045079999994, 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072732830000000002, 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2047 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021104+0000", 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021105+0000", 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4299999999999998e-07 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021107+0000", 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021115+0000", 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7559999999999999e-06 2024-04-26T07:49:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.021121+0000", 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5040000000000002e-06 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022441+0000", 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00132037 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022550+0000", 2024-04-26T07:49:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010914 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.022714+0000", 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016400900000000001 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028191+0000", 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005477132 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028308+0000", 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011705999999999999 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028346+0000", 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7867000000000002e-05 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:32.028377+0000", 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1219e-05 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2108 3.f e58/17 3:f0ee051f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_7:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.358601+0000", 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.30070760800000002, 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012232994000000001, 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358601+0000", 2024-04-26T07:49:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358601+0000", 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358602+0000", 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2500000000000001e-07 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.361514+0000", 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029125959999999999 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.361539+0000", 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4828999999999999e-05 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.361550+0000", 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1440000000000001e-05 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.361648+0000", 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7983e-05 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.361691+0000", 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2639000000000003e-05 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.370755+0000", 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090641599999999999 2024-04-26T07:49:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.370834+0000", 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8922000000000001e-05 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:40.774 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:40.776 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:40.776 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:40.775+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:40.877 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:40.872+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:40.963 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:40.964 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:40.964 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:40.964 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:40.977 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:40.972+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:40.978 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:41.078 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:41.075+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:41.106 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:41.106 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:41.107 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:41.107 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:41.107 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:41.121 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:41.178 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:41.176+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:41.279 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:41.279+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596391209088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 71.702165257999994, 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006394205, 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.296 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 49 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591751+0000", 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591754+0000", 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.103e-06 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591762+0000", 2024-04-26T07:49:41.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9509999999999995e-06 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591791+0000", 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8668999999999999e-05 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591806+0000", 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5051e-05 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.591925+0000", 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119163 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592111+0000", 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000185694 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:41.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.592438+0000", 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032695800000000002 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.593651+0000", 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012125320000000001 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.597931+0000", 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042799709999999996 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598007+0000", 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6389000000000003e-05 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.598146+0000", 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013872400000000001 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:219 6.4 e29/23 6:227f63b5:gc::gc.14:head v 29'4, mlcod=26'2)", 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.637546016000002, 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079552349999999997, 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:41.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656371+0000", 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656373+0000", 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0430000000000002e-06 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656384+0000", 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1214e-05 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656410+0000", 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6553000000000001e-05 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656424+0000", 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3057000000000001e-05 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656523+0000", 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9304999999999999e-05 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.656559+0000", 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6170000000000001e-05 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664230+0000", 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076710540000000001 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:32.664326+0000", 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5839000000000002e-05 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:954 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.760982154000004, 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066500159999999999, 2024-04-26T07:49:41.307 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 954 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532935+0000", 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532936+0000", 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3599999999999999e-06 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532943+0000", 2024-04-26T07:49:41.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8369999999999999e-06 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532962+0000", 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.916e-05 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.532976+0000", 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3703000000000001e-05 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533067+0000", 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1049000000000002e-05 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533213+0000", 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146236 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.533543+0000", 2024-04-26T07:49:41.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033018000000000001 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.534585+0000", 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010418879999999999 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539432+0000", 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048471809999999999 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539516+0000", 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4055999999999996e-05 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:33.539585+0000", 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8366000000000002e-05 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.313 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1111 3.1d 3:b91fd52e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.045754142, 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014830878, 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1111 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248163+0000", 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.248165+0000", 2024-04-26T07:49:41.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1840000000000002e-06 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251340+0000", 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031757589999999998 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251374+0000", 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3680000000000003e-05 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251390+0000", 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5650000000000001e-05 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251571+0000", 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018103300000000001 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.251811+0000", 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023969099999999999 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.252027+0000", 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021619900000000001 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.261108+0000", 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090814740000000008 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262828+0000", 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001719363 2024-04-26T07:49:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262916+0000", 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8916e-05 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.262993+0000", 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6928999999999995e-05 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1197 4.3e 4:7df5f364:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:41.319 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.762543089999999, 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059453709999999996, 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1197 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531374+0000", 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531376+0000", 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5739999999999998e-06 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531388+0000", 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.219e-05 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.531432+0000", 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4045999999999998e-05 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.532959+0000", 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00152674 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533077+0000", 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011815300000000001 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533400+0000", 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000323021 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.533667+0000", 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026668500000000001 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.535048+0000", 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001380558 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537058+0000", 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020102700000000002 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537217+0000", 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015946499999999999 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:27.537319+0000", 2024-04-26T07:49:41.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010166900000000001 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1246 3.2f 3:f6e96107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.046873185000001, 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023540999999999999, 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.325 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1246 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:41.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247046+0000", 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9270000000000001e-06 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252338+0000", 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052911449999999997 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252378+0000", 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0299999999999997e-05 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252396+0000", 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8600000000000001e-05 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252475+0000", 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8669000000000002e-05 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252592+0000", 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011717 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252971+0000", 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037877499999999998 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.262239+0000", 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092677920000000004 2024-04-26T07:49:41.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270496+0000", 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082573809999999994 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270545+0000", 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8627e-05 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270585+0000", 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9613999999999997e-05 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.5178.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.438125405999999, 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070304649999999996, 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-26T07:49:41.331 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.5178", 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/2720801126", 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 4 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855791+0000", 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855794+0000", 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5129999999999999e-06 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855803+0000", 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5470000000000002e-06 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855824+0000", 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0276999999999999e-05 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855839+0000", 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5673000000000001e-05 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855972+0000", 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013249600000000001 2024-04-26T07:49:41.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.855983+0000", 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862532+0000", 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065490410000000002 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862657+0000", 2024-04-26T07:49:41.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012515900000000001 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:30.862822+0000", 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000164819 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1723 4.38 4:1e5b5a54:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:41.336 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.291590813999999, 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054881019999999999, 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1723 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:41.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002326+0000", 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002328+0000", 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.21e-06 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002338+0000", 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.009e-05 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002368+0000", 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0236999999999999e-05 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002384+0000", 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5333e-05 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002540+0000", 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015670899999999999 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.002770+0000", 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000229562 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.003076+0000", 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00030549400000000001 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.004792+0000", 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001716429 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007664+0000", 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028718620000000002 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007750+0000", 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5796000000000003e-05 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.007814+0000", 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4380000000000004e-05 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1737 4.38 4:1c5b1b5d:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.6.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.134522684, 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058270199999999996, 2024-04-26T07:49:41.342 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1737 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159394+0000", 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159396+0000", 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0499999999999999e-06 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159410+0000", 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4124000000000001e-05 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159461+0000", 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0949000000000003e-05 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159530+0000", 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8780000000000002e-05 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.159716+0000", 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186295 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.161226+0000", 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00150935 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.162449+0000", 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012232090000000001 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.164854+0000", 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0024051279999999999 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165063+0000", 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020894899999999999 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165153+0000", 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9913000000000005e-05 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:31.165221+0000", 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8273000000000002e-05 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.347 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2102 3.35 e58/17 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.040393125, 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017395158000000001, 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253526+0000", 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.903e-06 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258558+0000", 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050312769999999998 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258594+0000", 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6353999999999998e-05 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258617+0000", 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2785999999999998e-05 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258737+0000", 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011977999999999999 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258763+0000", 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6088000000000002e-05 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.270840+0000", 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012077277000000001 2024-04-26T07:49:41.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.270919+0000", 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8693e-05 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2105 3.37 e58/17 3:ec248c41:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_4:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.301291+0000", 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.99262577799999996, 2024-04-26T07:49:41.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013032781, 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.301291+0000", 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.301291+0000", 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.301292+0000", 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.304793+0000", 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0035013169999999999 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.304828+0000", 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5283000000000001e-05 2024-04-26T07:49:41.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.304846+0000", 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7329999999999998e-05 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.304967+0000", 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121166 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.305001+0000", 2024-04-26T07:49:41.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4548999999999997e-05 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.314224+0000", 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092225769999999992 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.314324+0000", 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9716000000000005e-05 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2111 3.30 3:0ee8838f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.90006596699999997, 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021248963999999999, 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2111 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393853+0000", 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3640000000000002e-06 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399704+0000", 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058506870000000002 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399732+0000", 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8309e-05 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399747+0000", 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5356999999999999e-05 2024-04-26T07:49:41.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399899+0000", 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015193300000000001 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.400153+0000", 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025378500000000002 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.400381+0000", 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022828200000000001 2024-04-26T07:49:41.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.413732+0000", 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013351059 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.414922+0000", 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001189322 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.415012+0000", 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0210000000000005e-05 2024-04-26T07:49:41.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.415100+0000", 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7656000000000002e-05 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2122 3.c 3:33f873c3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.68816912500000005, 2024-04-26T07:49:41.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022871248, 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2122 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605750+0000", 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6129999999999998e-06 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611353+0000", 2024-04-26T07:49:41.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0056032139999999996 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611382+0000", 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8583000000000001e-05 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611396+0000", 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4517e-05 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611510+0000", 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011364199999999999 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611637+0000", 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012689799999999999 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611750+0000", 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011253500000000001 2024-04-26T07:49:41.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.617831+0000", 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006081319 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628524+0000", 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010693513 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628578+0000", 2024-04-26T07:49:41.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3980999999999997e-05 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628619+0000", 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0432999999999997e-05 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2125 3.17 e58/17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.63349155700000004, 2024-04-26T07:49:41.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017323336000000002, 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660428+0000", 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666876+0000", 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064477750000000002 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666918+0000", 2024-04-26T07:49:41.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2512999999999998e-05 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666940+0000", 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2223000000000001e-05 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.667111+0000", 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170509 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.667173+0000", 2024-04-26T07:49:41.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2266000000000003e-05 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.677671+0000", 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010497833999999999 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.677748+0000", 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7405999999999997e-05 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2127 3.36 e58/17 3:6f5c66f9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_26:head v 58'3, mlcod=54'1)", 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.709082+0000", 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.58483480200000004, 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0095141789999999993, 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.709082+0000", 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.709082+0000", 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.709084+0000", 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7370000000000001e-06 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.710801+0000", 2024-04-26T07:49:41.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001717339 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.710833+0000", 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2063000000000001e-05 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.710853+0000", 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0276e-05 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.710955+0000", 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010139700000000001 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.710979+0000", 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4431999999999999e-05 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.718549+0000", 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00756977 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.718596+0000", 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7165e-05 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2140 3.c 3:30bbfb90:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.51838630100000005, 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018799924999999999, 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.377 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2140 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:41.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775533+0000", 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780479+0000", 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049457379999999999 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780517+0000", 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8046999999999997e-05 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780535+0000", 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8332999999999999e-05 2024-04-26T07:49:41.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780700+0000", 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016463599999999999 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780955+0000", 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025536800000000001 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.781190+0000", 2024-04-26T07:49:41.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023499099999999999 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.791429+0000", 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010238466999999999 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794125+0000", 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026960090000000001 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794221+0000", 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6099000000000003e-05 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794330+0000", 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109347 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2145 3.37 e58/17 3:ec3e84b5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_34:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.895636+0000", 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.39828031800000002, 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011769093, 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.895636+0000", 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.895636+0000", 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.895638+0000", 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0509999999999999e-06 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.899033+0000", 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033944240000000001 2024-04-26T07:49:41.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.899062+0000", 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9382000000000001e-05 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.899077+0000", 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5162e-05 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.899172+0000", 2024-04-26T07:49:41.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4739000000000002e-05 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.899204+0000", 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2187999999999997e-05 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.907344+0000", 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081396439999999997 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.907405+0000", 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1502999999999997e-05 2024-04-26T07:49:41.387 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2146 3.38 e58/17 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.37307502799999998, 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015464832, 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920844+0000", 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927172+0000", 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063278589999999999 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927209+0000", 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6912999999999997e-05 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927226+0000", 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7479e-05 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927361+0000", 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013498300000000001 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927423+0000", 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2076000000000007e-05 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.936218+0000", 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087948760000000001 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.936306+0000", 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8152999999999994e-05 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2147 3.38 e58/17 3:1e705a67:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_36:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.945299+0000", 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.34861791199999997, 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013850105999999999, 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.945299+0000", 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.945299+0000", 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.945301+0000", 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6369999999999999e-06 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.951998+0000", 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066966359999999997 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.952034+0000", 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6337000000000001e-05 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.952051+0000", 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6192999999999999e-05 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.952174+0000", 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000123156 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.952214+0000", 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0095999999999997e-05 2024-04-26T07:49:41.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.959069+0000", 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068552550000000002 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.959149+0000", 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9796000000000006e-05 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.396 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2152 3.21 e58/17 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.221463195, 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015640588, 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072456+0000", 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1629999999999999e-06 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080207+0000", 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007750903 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080238+0000", 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1207000000000001e-05 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080254+0000", 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6283e-05 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080379+0000", 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125341 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080410+0000", 2024-04-26T07:49:41.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0861000000000001e-05 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.087981+0000", 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007570327 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.088094+0000", 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113503 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.400 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.401 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.401 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:41.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:49:41.403 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:41.403 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:41.400+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:41.504 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:41.500+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:41.588 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:41.588 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:41.589 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:41.589 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:41.603 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:41.604 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:41.603+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:41.705 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:41.700+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:41.736 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:41.737 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:41.756 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:41.806 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:41.804+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:41.857 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:49:41.902 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:41.902 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:41.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:41.902 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:41.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.902 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:41.902 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:41.902 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.337037116999994, 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:41.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:49:41.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:49:41.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:49:41.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1243 3.34 e54/17 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head v 54'1, mlcod=0'0)", 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.670640884999999, 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018677787000000001, 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224143+0000", 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7850000000000001e-06 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227226+0000", 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003083293 2024-04-26T07:49:41.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227258+0000", 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2237999999999999e-05 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227273+0000", 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4312e-05 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227395+0000", 2024-04-26T07:49:41.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012202200000000001 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227461+0000", 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6217000000000007e-05 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242732+0000", 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015270974 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242819+0000", 2024-04-26T07:49:41.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6946000000000004e-05 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2102 3.35 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.64832234, 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025241564000000001, 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.914 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2102 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:41.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:41.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246463+0000", 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.106e-06 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252299+0000", 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058363080000000001 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252331+0000", 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1914e-05 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252346+0000", 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4829e-05 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252506+0000", 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015995500000000001 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252872+0000", 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000365817 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253249+0000", 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037744100000000001 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271215+0000", 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017965979 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271568+0000", 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035317600000000002 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271630+0000", 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1853000000000006e-05 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271701+0000", 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1186000000000006e-05 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2109 3.26 3:64cb7bc7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.922 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.52330481, 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017368982000000002, 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2109 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371480+0000", 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6800000000000002e-06 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375488+0000", 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040076979999999996 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375515+0000", 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7790999999999999e-05 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375527+0000", 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1705000000000001e-05 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375609+0000", 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1929999999999997e-05 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375757+0000", 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014830400000000001 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375879+0000", 2024-04-26T07:49:41.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121169 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.385948+0000", 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010069567999999999 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388730+0000", 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002781684 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388782+0000", 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1894000000000002e-05 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388846+0000", 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4559000000000003e-05 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2112 3.26 3:658014ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.928 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.478021721, 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022887174, 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2112 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416763+0000", 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9469999999999999e-06 2024-04-26T07:49:41.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422174+0000", 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005410687 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422216+0000", 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1807000000000001e-05 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422234+0000", 2024-04-26T07:49:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8706e-05 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422410+0000", 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017526900000000001 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422831+0000", 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042124399999999998 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.423250+0000", 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041928100000000003 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.438715+0000", 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015465202000000001 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439443+0000", 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00072764499999999996 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439539+0000", 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6173000000000002e-05 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439648+0000", 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108213 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2114 3.10 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.934 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.445740952, 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021514529000000001, 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2114 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449044+0000", 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6369999999999999e-06 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454276+0000", 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052320489999999999 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454310+0000", 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4186000000000001e-05 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454328+0000", 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7977000000000001e-05 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454461+0000", 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013284899999999999 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454722+0000", 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026144500000000002 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454976+0000", 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025349200000000002 2024-04-26T07:49:41.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.463666+0000", 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086904649999999996 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470375+0000", 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067091629999999998 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470477+0000", 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101433 2024-04-26T07:49:41.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470556+0000", 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8832999999999996e-05 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2120 3.3f e58/17 3:fce5b488:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_19:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.569393+0000", 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.3253893670000001, 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012101583000000001, 2024-04-26T07:49:41.940 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.569393+0000", 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.569393+0000", 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.569394+0000", 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7179999999999999e-06 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.571276+0000", 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018818909999999999 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.571302+0000", 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5374000000000001e-05 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.571314+0000", 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1939999999999999e-05 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.571412+0000", 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8240999999999997e-05 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.571445+0000", 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3541000000000003e-05 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.581422+0000", 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099761810000000006 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.581494+0000", 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2696999999999999e-05 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2127 3.36 3:6f5c66f9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.703978+0000", 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.1908041680000001, 2024-04-26T07:49:41.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015493231999999999, 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2127 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.703978+0000", 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.703978+0000", 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.703980+0000", 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.419e-06 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.708133+0000", 2024-04-26T07:49:41.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041522369999999996 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.708157+0000", 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4396000000000002e-05 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.708169+0000", 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2327000000000001e-05 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.708250+0000", 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0352000000000006e-05 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.708448+0000", 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019867299999999999 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.708702+0000", 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025352799999999999 2024-04-26T07:49:41.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.719001+0000", 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010299050000000001 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.719060+0000", 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8866000000000002e-05 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.719252+0000", 2024-04-26T07:49:41.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000191805 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.719471+0000", 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021957899999999999 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2144 3.26 3:66326b37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.0283731190000001, 2024-04-26T07:49:41.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016531011000000002, 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2144 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866411+0000", 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.198e-06 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871082+0000", 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046708499999999998 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871112+0000", 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9558000000000001e-05 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871127+0000", 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5084e-05 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871236+0000", 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109786 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871500+0000", 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000263248 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871737+0000", 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023734900000000001 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882248+0000", 2024-04-26T07:49:41.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010511453 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882850+0000", 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00060166699999999996 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882899+0000", 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9144000000000002e-05 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882940+0000", 2024-04-26T07:49:41.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0673999999999997e-05 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2148 3.1e e58/46 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head v 58'3, mlcod=54'1)", 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.92250848500000004, 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018285590000000001, 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972276+0000", 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7930000000000002e-06 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980745+0000", 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084683919999999999 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980771+0000", 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5911e-05 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980784+0000", 2024-04-26T07:49:41.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3241000000000001e-05 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980866+0000", 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2348999999999994e-05 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980891+0000", 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5097e-05 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990494+0000", 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0096024130000000006 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990559+0000", 2024-04-26T07:49:41.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5394000000000004e-05 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2149 3.2e e58/17 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.997107+0000", 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.89767544099999996, 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010682577, 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.961 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.997107+0000", 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.997107+0000", 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.997108+0000", 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6500000000000001e-06 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.001026+0000", 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039175929999999996 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.001055+0000", 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9306e-05 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.001069+0000", 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4217e-05 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.001149+0000", 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9975999999999995e-05 2024-04-26T07:49:41.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.001170+0000", 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1072000000000001e-05 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.007725+0000", 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065540809999999998 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.007789+0000", 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4682000000000002e-05 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2157 3.a 3:522571bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:41.966 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.69712302699999995, 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018495228999999998, 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2157 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197662+0000", 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2440000000000002e-06 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201962+0000", 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042994369999999997 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201994+0000", 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1850999999999997e-05 2024-04-26T07:49:41.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202009+0000", 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5251e-05 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202109+0000", 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100318 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202250+0000", 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014054700000000001 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202371+0000", 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012143500000000001 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.207294+0000", 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049230929999999999 2024-04-26T07:49:41.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216058+0000", 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087642239999999993 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216112+0000", 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3897000000000003e-05 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216154+0000", 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1931999999999998e-05 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2162 3.35 3:ad57cd5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.57369046199999996, 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016822856000000001, 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.973 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2162 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:41.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321094+0000", 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.43e-06 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327241+0000", 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061465360000000002 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327266+0000", 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5922e-05 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327282+0000", 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5603e-05 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327396+0000", 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113418 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327544+0000", 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014825 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327679+0000", 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134905 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337198+0000", 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0095190269999999993 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337818+0000", 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000620737 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337869+0000", 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0893000000000002e-05 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337914+0000", 2024-04-26T07:49:41.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5135000000000001e-05 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2164 3.2e e58/17 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.374296+0000", 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.52048633899999996, 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013848742000000001, 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.980 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.374296+0000", 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.374296+0000", 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.374298+0000", 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.413e-06 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.378820+0000", 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045216090000000002 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.378838+0000", 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8332e-05 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.378848+0000", 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0196e-05 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.378920+0000", 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1613999999999996e-05 2024-04-26T07:49:41.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.378942+0000", 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2464999999999999e-05 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.388015+0000", 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090722170000000005 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.388144+0000", 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129896 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2171 3.26 3:655b4449:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.39054230600000001, 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016538298, 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.985 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2171 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504243+0000", 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509432+0000", 2024-04-26T07:49:41.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051888860000000002 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509451+0000", 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9241000000000001e-05 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509464+0000", 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2510999999999999e-05 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509514+0000", 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0083999999999997e-05 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509623+0000", 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109768 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:41.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509721+0000", 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7182000000000006e-05 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520340+0000", 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010619358000000001 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520698+0000", 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035771499999999999 2024-04-26T07:49:41.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520738+0000", 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0623000000000001e-05 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520778+0000", 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9817000000000002e-05 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.991 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2172 3.36 3:6e55231b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.37079258399999998, 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016132018000000001, 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:41.992 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:41.993 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2172 2024-04-26T07:49:41.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.993 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:41.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:41.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:41.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523993+0000", 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4070000000000002e-06 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528585+0000", 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00459225 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528620+0000", 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5073000000000001e-05 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528640+0000", 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9913000000000001e-05 2024-04-26T07:49:41.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528743+0000", 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010309100000000001 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528918+0000", 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175203 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.529094+0000", 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175928 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.539613+0000", 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010518675999999999 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:41.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540039+0000", 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042617600000000001 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540085+0000", 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5367000000000001e-05 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540122+0000", 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6934000000000002e-05 2024-04-26T07:49:41.998 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2179 3.a 3:50808692:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.28786136299999998, 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018371393999999999, 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:41.999 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2179 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:42.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606923+0000", 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9879999999999999e-06 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612730+0000", 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058072059999999997 2024-04-26T07:49:42.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612765+0000", 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5187e-05 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612784+0000", 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8536e-05 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:42.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612865+0000", 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1522999999999999e-05 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612994+0000", 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012873499999999999 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.613100+0000", 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105647 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.618956+0000", 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058564849999999998 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625161+0000", 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062052549999999998 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:42.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625237+0000", 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5364000000000006e-05 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625292+0000", 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5467999999999998e-05 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.005 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2186 3.35 3:ae727a92:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.678835+0000", 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.21594706599999999, 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01449254, 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2186 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.006 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.678835+0000", 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.678835+0000", 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.678838+0000", 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.757e-06 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.682702+0000", 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038645379999999998 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.682724+0000", 2024-04-26T07:49:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2135999999999999e-05 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.682735+0000", 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0553e-05 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.682811+0000", 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6020999999999996e-05 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.682957+0000", 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014553400000000001 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.683088+0000", 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013175400000000001 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:42.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.692881+0000", 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097931689999999991 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.693234+0000", 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000352097 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.693276+0000", 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2079000000000001e-05 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.693328+0000", 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1901999999999999e-05 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2189 3.20 3:05abebd8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.18332442700000001, 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016416799999999999, 2024-04-26T07:49:42.012 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2189 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:42.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711460+0000", 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1390000000000002e-06 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715243+0000", 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00378364 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715266+0000", 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2521e-05 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715276+0000", 2024-04-26T07:49:42.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8630000000000003e-06 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715358+0000", 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2520000000000003e-05 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715520+0000", 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161237 2024-04-26T07:49:42.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715666+0000", 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014621100000000001 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.721893+0000", 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062276730000000004 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727800+0000", 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059063750000000002 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727841+0000", 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1247e-05 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727874+0000", 2024-04-26T07:49:42.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3374000000000003e-05 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2194 3.1e e58/46 3:79c69c28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_83:head v 58'4, mlcod=54'2)", 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.770753+0000", 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.124029261, 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010707550999999999, 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:42.019 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.770753+0000", 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.770753+0000", 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:42.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.770755+0000", 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.747e-06 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.775075+0000", 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004320806 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:42.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.775106+0000", 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0666000000000001e-05 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.775121+0000", 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4679e-05 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.775192+0000", 2024-04-26T07:49:42.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1440999999999996e-05 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.775221+0000", 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8986999999999999e-05 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.781417+0000", 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061959390000000001 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:42.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.781460+0000", 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3285999999999999e-05 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:42.024 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:42.026 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:42.027 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:42.024+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:42.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:42.127 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:42.127+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:42.172 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:42.172 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:42.172 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:42.172 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:42.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:42.228 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:42.224+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:42.329 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:42.327+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:42.334 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:42.356 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:42.356 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:42.377 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:42.377 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:42.378 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:42.378 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:42.378 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:42.378 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:42.378 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:42.398 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:42.400 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:42.423 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:42.423 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:42.430 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:42.428+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:42.444 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:42.444 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:42.464 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:42.465 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:42.487 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:42.531 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:42.531+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:42.589 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:42.589 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:42.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:42.655 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:42.655+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:42.732 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:42.728+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:42.750 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:42.750 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:42.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:42.834 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:42.831+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:42.935 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:42.931+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:42.954 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:42.954 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:42.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:43.035 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:43.032+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:43.119 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:43.120 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:43.136 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:43.132+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:43.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:43.237 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:43.232+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:43.325 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:43.326 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:43.338 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:43.336+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:43.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:43.439 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:43.435+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:43.529 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:43.529 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:43.540 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:43.539+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:43.542 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:43.622 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 1Gb. 2024-04-26T07:49:43.622 INFO:tasks.workunit.client.0.smithi053.stdout:upload file successful 2024-04-26T07:49:43.623 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:43.623 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-04-26T07:49:43.623 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:49:43.641 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:43.636+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:43.655 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:43.656 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:43.677 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:43.742 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:43.739+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:43.837 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:43.838 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:43.843 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:43.840+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:43.851 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:43.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:49:43.904 INFO:tasks.workunit.client.0.smithi053.stdout:user qa_user deleted 2024-04-26T07:49:43.904 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:49:43.944 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:43.943+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:44.005 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:44.005 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:44.021 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:44.045 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:44.047+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:44.129 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:44.129 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:44.142 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:44.145 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:44.147+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:44.246 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:44.244+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:44.257 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:44.257 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:44.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:44.362 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:44.360+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:44.431 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:44.432 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:44.448 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:44.448 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:44.447+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:44.515 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:44.548 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:44.547+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:44.623 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:44.624 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:44.642 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:44.676 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:44.676 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:44.691 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:44.691+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:44.692 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:44.709 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:44.726 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:44.727 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:44.747 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:44.747 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:44.750 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:44.748+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:44.768 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:44.777 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:44.777 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:44.777 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:44.777 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:44.788 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:44.788 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:44.794 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:44.807 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:44.808 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:44.870 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:49:44.880 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:44.879+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:44.952 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:44.950+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:44.961 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:44.961 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:44.961 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:44.961 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:44.961 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:44.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:45.063 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:45.062+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:45.147 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:45.147 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:45.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:45.147 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.929007717000001, 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.148 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.149 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.149 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:49:45.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.149 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:45.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:45.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:49:45.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:49:45.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:49:45.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:49:45.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:49:45.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:49:45.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:49:45.157 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.157 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.157 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.158 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2119 3.14 3:288a1f0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.158 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.540968+0000", 2024-04-26T07:49:45.158 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.6034441069999996, 2024-04-26T07:49:45.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018508938999999999, 2024-04-26T07:49:45.158 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.158 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.158 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.159 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.159 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.159 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.159 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2119 2024-04-26T07:49:45.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.159 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.540968+0000", 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.540968+0000", 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.540970+0000", 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9910000000000001e-06 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547683+0000", 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067131609999999996 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547706+0000", 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2818000000000001e-05 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547720+0000", 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3817e-05 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547795+0000", 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4920999999999996e-05 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547925+0000", 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129896 2024-04-26T07:49:45.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.548043+0000", 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011779500000000001 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.558708+0000", 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010665480999999999 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.559377+0000", 2024-04-26T07:49:45.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00066852000000000003 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.559427+0000", 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0556000000000002e-05 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.559477+0000", 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9982999999999999e-05 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2143 3.3 3:c0b0b164:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.839704+0000", 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.3047086569999999, 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017690615999999999, 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2143 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839704+0000", 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839704+0000", 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839706+0000", 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2979999999999999e-06 2024-04-26T07:49:45.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844009+0000", 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004302948 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844038+0000", 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9626999999999999e-05 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844054+0000", 2024-04-26T07:49:45.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5607000000000002e-05 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844167+0000", 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011302399999999999 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844405+0000", 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000237867 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:45.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844620+0000", 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021521299999999999 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.852674+0000", 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0080538729999999996 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.857176+0000", 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045023579999999997 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.857283+0000", 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106912 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.857394+0000", 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110889 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:49:45.170 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.1015793809999996, 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2153 3.1a 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.095067+0000", 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.0493447180000004, 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018316490000000001, 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.176 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2153 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.095067+0000", 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.095067+0000", 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.095070+0000", 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9909999999999998e-06 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.098779+0000", 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037086110000000001 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.098807+0000", 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7752000000000001e-05 2024-04-26T07:49:45.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.098819+0000", 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1824000000000001e-05 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.098896+0000", 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7532000000000002e-05 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.099025+0000", 2024-04-26T07:49:45.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129264 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.099143+0000", 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011773 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.103713+0000", 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045698040000000002 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.113231+0000", 2024-04-26T07:49:45.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0095184529999999996 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.113313+0000", 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1310999999999995e-05 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.113384+0000", 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1217999999999995e-05 2024-04-26T07:49:45.181 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2159 3.14 3:29380a3b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.8974874540000002, 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019870071, 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.182 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2159 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246928+0000", 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7719999999999999e-06 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250722+0000", 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003794791 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250751+0000", 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.887e-05 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250763+0000", 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2167999999999999e-05 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250866+0000", 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102704 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.251140+0000", 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027415300000000002 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.251537+0000", 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039718099999999998 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266022+0000", 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014485071 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266638+0000", 2024-04-26T07:49:45.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00061538200000000004 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266729+0000", 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1434000000000006e-05 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266795+0000", 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5544999999999997e-05 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2192 3.1a 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.746458+0000", 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.3979544160000001, 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018031636, 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2192 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.746458+0000", 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.746458+0000", 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.746461+0000", 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7669999999999999e-06 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750580+0000", 2024-04-26T07:49:45.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041195219999999996 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750637+0000", 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7059999999999999e-05 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750664+0000", 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7206999999999999e-05 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750758+0000", 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3344000000000006e-05 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750900+0000", 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014204300000000001 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.751021+0000", 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121129 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.757792+0000", 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067716290000000004 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.764340+0000", 2024-04-26T07:49:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065478050000000003 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.764424+0000", 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3780000000000001e-05 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.764489+0000", 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5350000000000003e-05 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.2509974719999999, 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:49:45.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:49:45.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2213 3.f e59/17 3:f1254826:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_102:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.983943+0000", 2024-04-26T07:49:45.199 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.1604693990000001, 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015548381, 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983943+0000", 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983943+0000", 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983946+0000", 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7360000000000001e-06 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990336+0000", 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063905849999999998 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990382+0000", 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6072999999999997e-05 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990407+0000", 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5199999999999999e-05 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990510+0000", 2024-04-26T07:49:45.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010243600000000001 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990537+0000", 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7529999999999999e-05 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999381+0000", 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0088440849999999998 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999491+0000", 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010973599999999999 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2216 3.1a 3:5801baf3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.010946+0000", 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.1334666360000001, 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016423601999999999, 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.204 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2216 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.010946+0000", 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.010946+0000", 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.010949+0000", 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0759999999999999e-06 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.014968+0000", 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040192880000000002 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015003+0000", 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4802999999999999e-05 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015019+0000", 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6497000000000001e-05 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015094+0000", 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5103000000000002e-05 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015209+0000", 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000114208 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015311+0000", 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102533 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.021592+0000", 2024-04-26T07:49:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062810119999999999 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.027189+0000", 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0055965800000000003 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.027294+0000", 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105269 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.027369+0000", 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5233000000000003e-05 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.1144248980000002, 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:49:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:49:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:49:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:49:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:49:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2220 3.24 e59/17 3:2595c82c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_109:head v 59'6, mlcod=58'4)", 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.051143+0000", 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.0932688079999999, 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015681265999999999, 2024-04-26T07:49:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.051143+0000", 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.051143+0000", 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.051146+0000", 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5170000000000002e-06 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055451+0000", 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043053179999999998 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055481+0000", 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9505e-05 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055495+0000", 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4654999999999999e-05 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055600+0000", 2024-04-26T07:49:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105067 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055641+0000", 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0707999999999997e-05 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066772+0000", 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011130697 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066825+0000", 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2799000000000001e-05 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2226 3.24 e59/17 3:259572e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_115:head v 59'8, mlcod=59'6)", 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.122343+0000", 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.0220690979999998, 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014858873999999999, 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.122343+0000", 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.122343+0000", 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.122345+0000", 2024-04-26T07:49:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0219999999999999e-06 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.127761+0000", 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005415474 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.127797+0000", 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6426e-05 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.127821+0000", 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3683e-05 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.128018+0000", 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019710499999999999 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.128062+0000", 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.384e-05 2024-04-26T07:49:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.137084+0000", 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.009022291 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.137202+0000", 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118033 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2231 3.9 3:90514a14:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.179934+0000", 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 2.9644778650000001, 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016904933, 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2231 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.179934+0000", 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.179934+0000", 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.179962+0000", 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8126000000000001e-05 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184436+0000", 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044731379999999998 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184489+0000", 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3183000000000002e-05 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184518+0000", 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8923000000000001e-05 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184707+0000", 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000188906 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185043+0000", 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033642699999999998 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185282+0000", 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023896200000000001 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.193876+0000", 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0085939420000000002 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.196742+0000", 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028657629999999999 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.196796+0000", 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3885000000000003e-05 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.196839+0000", 2024-04-26T07:49:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3677999999999998e-05 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2237 3.14 3:2a3bf868:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 2.8832260600000001, 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021268025999999999, 2024-04-26T07:49:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2237 2024-04-26T07:49:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:49:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:49:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261188+0000", 2024-04-26T07:49:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.748e-06 2024-04-26T07:49:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264952+0000", 2024-04-26T07:49:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037645809999999999 2024-04-26T07:49:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264975+0000", 2024-04-26T07:49:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2918999999999999e-05 2024-04-26T07:49:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264986+0000", 2024-04-26T07:49:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0373e-05 2024-04-26T07:49:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265083+0000", 2024-04-26T07:49:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7298000000000003e-05 2024-04-26T07:49:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265313+0000", 2024-04-26T07:49:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022968700000000001 2024-04-26T07:49:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265529+0000", 2024-04-26T07:49:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021579800000000001 2024-04-26T07:49:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.279284+0000", 2024-04-26T07:49:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013755276 2024-04-26T07:49:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282361+0000", 2024-04-26T07:49:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003077144 2024-04-26T07:49:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282413+0000", 2024-04-26T07:49:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2447000000000001e-05 2024-04-26T07:49:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282454+0000", 2024-04-26T07:49:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0754999999999999e-05 2024-04-26T07:49:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2239 3.3 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:49:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 2.8578370890000002, 2024-04-26T07:49:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020185307, 2024-04-26T07:49:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2239 2024-04-26T07:49:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:49:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:49:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286577+0000", 2024-04-26T07:49:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7579999999999999e-06 2024-04-26T07:49:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290701+0000", 2024-04-26T07:49:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041239379999999997 2024-04-26T07:49:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290726+0000", 2024-04-26T07:49:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5312000000000001e-05 2024-04-26T07:49:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290737+0000", 2024-04-26T07:49:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1129e-05 2024-04-26T07:49:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290809+0000", 2024-04-26T07:49:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1500000000000003e-05 2024-04-26T07:49:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290943+0000", 2024-04-26T07:49:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013438999999999999 2024-04-26T07:49:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.291063+0000", 2024-04-26T07:49:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119926 2024-04-26T07:49:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.297286+0000", 2024-04-26T07:49:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062232440000000002 2024-04-26T07:49:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306608+0000", 2024-04-26T07:49:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093216859999999992 2024-04-26T07:49:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306693+0000", 2024-04-26T07:49:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5278000000000006e-05 2024-04-26T07:49:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306760+0000", 2024-04-26T07:49:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7145999999999997e-05 2024-04-26T07:49:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2242 3.2c e59/17 3:3494587f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_131:head v 59'1, mlcod=0'0)", 2024-04-26T07:49:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.326624+0000", 2024-04-26T07:49:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 2.8177881170000001, 2024-04-26T07:49:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017302700000000001, 2024-04-26T07:49:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326624+0000", 2024-04-26T07:49:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326624+0000", 2024-04-26T07:49:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326627+0000", 2024-04-26T07:49:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5600000000000001e-06 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329380+0000", 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027533449999999999 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329424+0000", 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3747e-05 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329448+0000", 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4413000000000002e-05 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329603+0000", 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015526900000000001 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329657+0000", 2024-04-26T07:49:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3689e-05 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.343798+0000", 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014140648 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.343927+0000", 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012902899999999999 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2243 3.1b e59/17 3:db991f00:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_132:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.333426+0000", 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 2.8109861270000001, 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016361652000000001, 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.333426+0000", 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.333426+0000", 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.333428+0000", 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4099999999999998e-06 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338635+0000", 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005206062 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338671+0000", 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6569000000000002e-05 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338689+0000", 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7376000000000001e-05 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338808+0000", 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011959999999999999 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338866+0000", 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7822999999999998e-05 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.349642+0000", 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01077582 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.349788+0000", 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014599200000000001 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2245 3.9 3:91913af5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.351383+0000", 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 2.7930293129999999, 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017499292999999999, 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2245 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.351383+0000", 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.351383+0000", 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.351386+0000", 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.807e-06 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357260+0000", 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005874598 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357313+0000", 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2283000000000001e-05 2024-04-26T07:49:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357356+0000", 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3826999999999999e-05 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357499+0000", 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014246199999999999 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357742+0000", 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024279099999999999 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357971+0000", 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000229349 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.366228+0000", 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082572730000000007 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.368754+0000", 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002525228 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.368824+0000", 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0528e-05 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.368882+0000", 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8146999999999997e-05 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 2.7709598099999999, 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:49:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.276 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:45.277 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:45.277 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:45.274+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:45.377 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:45.372+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:45.447 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:45.447 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:45.448 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:45.448 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:45.461 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:45.479 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:45.476+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:45.580 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:45.578+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:45.586 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:45.586 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:45.586 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:45.586 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:45.586 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:45.600 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:45.691 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:45.690+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:45.773 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1246 3.2f 3:f6e96107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.523687475999999, 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023540999999999999, 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.774 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1246 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247046+0000", 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9270000000000001e-06 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252338+0000", 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052911449999999997 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252378+0000", 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0299999999999997e-05 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252396+0000", 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8600000000000001e-05 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252475+0000", 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8669000000000002e-05 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252592+0000", 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011717 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252971+0000", 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037877499999999998 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.262239+0000", 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092677920000000004 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270496+0000", 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082573809999999994 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270545+0000", 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8627e-05 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270585+0000", 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9613999999999997e-05 2024-04-26T07:49:45.779 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2102 3.35 e58/17 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.5172074159999998, 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017395158000000001, 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253526+0000", 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.903e-06 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258558+0000", 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050312769999999998 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258594+0000", 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6353999999999998e-05 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258617+0000", 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2785999999999998e-05 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258737+0000", 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011977999999999999 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258763+0000", 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6088000000000002e-05 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.270840+0000", 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012077277000000001 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.270919+0000", 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8693e-05 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2111 3.30 3:0ee8838f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.3768802579999999, 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021248963999999999, 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.784 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2111 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393853+0000", 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3640000000000002e-06 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399704+0000", 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058506870000000002 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399732+0000", 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8309e-05 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399747+0000", 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5356999999999999e-05 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399899+0000", 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015193300000000001 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.400153+0000", 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025378500000000002 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.400381+0000", 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022828200000000001 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.413732+0000", 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013351059 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.414922+0000", 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001189322 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.415012+0000", 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0210000000000005e-05 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.415100+0000", 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7656000000000002e-05 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2122 3.c 3:33f873c3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.789 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.1649834160000001, 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022871248, 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2122 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605750+0000", 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6129999999999998e-06 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611353+0000", 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0056032139999999996 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611382+0000", 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8583000000000001e-05 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611396+0000", 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4517e-05 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611510+0000", 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011364199999999999 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611637+0000", 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012689799999999999 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611750+0000", 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011253500000000001 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.617831+0000", 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006081319 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628524+0000", 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010693513 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628578+0000", 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3980999999999997e-05 2024-04-26T07:49:45.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628619+0000", 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0432999999999997e-05 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2125 3.17 e58/17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.1103058480000003, 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017323336000000002, 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.795 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660428+0000", 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666876+0000", 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064477750000000002 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666918+0000", 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2512999999999998e-05 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666940+0000", 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2223000000000001e-05 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.667111+0000", 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170509 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.667173+0000", 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2266000000000003e-05 2024-04-26T07:49:45.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.677671+0000", 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010497833999999999 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.677748+0000", 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7405999999999997e-05 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.799 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2140 3.c 3:30bbfb90:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.9952005919999998, 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018799924999999999, 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2140 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775533+0000", 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780479+0000", 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049457379999999999 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780517+0000", 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8046999999999997e-05 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780535+0000", 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8332999999999999e-05 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780700+0000", 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016463599999999999 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780955+0000", 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025536800000000001 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.781190+0000", 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023499099999999999 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.791429+0000", 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010238466999999999 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794125+0000", 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026960090000000001 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794221+0000", 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6099000000000003e-05 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794330+0000", 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109347 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2146 3.38 e58/17 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8498893189999999, 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015464832, 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920844+0000", 2024-04-26T07:49:45.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927172+0000", 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063278589999999999 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927209+0000", 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6912999999999997e-05 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927226+0000", 2024-04-26T07:49:45.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7479e-05 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927361+0000", 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013498300000000001 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927423+0000", 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2076000000000007e-05 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.936218+0000", 2024-04-26T07:49:45.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087948760000000001 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.936306+0000", 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8152999999999994e-05 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2152 3.21 e58/17 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.6982774860000003, 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015640588, 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.809 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072456+0000", 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1629999999999999e-06 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080207+0000", 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007750903 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080238+0000", 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1207000000000001e-05 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080254+0000", 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6283e-05 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080379+0000", 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125341 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080410+0000", 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0861000000000001e-05 2024-04-26T07:49:45.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.087981+0000", 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007570327 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.088094+0000", 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113503 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.813 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2163 3.2f 3:f4a8dc53:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.4258055379999997, 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017273949, 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2163 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344927+0000", 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6419999999999999e-06 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349163+0000", 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042360430000000001 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349182+0000", 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8966000000000001e-05 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349192+0000", 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8800000000000003e-06 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349266+0000", 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4085000000000006e-05 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349448+0000", 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018166999999999999 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349615+0000", 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016686000000000001 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.359728+0000", 2024-04-26T07:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010113837000000001 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362078+0000", 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002349851 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362133+0000", 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4255000000000001e-05 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362199+0000", 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6859999999999993e-05 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2166 3.c 3:3335ddb9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.3474118649999998, 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021989392, 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.819 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2166 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423323+0000", 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.456e-06 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427512+0000", 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004189033 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427550+0000", 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427570+0000", 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9397000000000001e-05 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427705+0000", 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013559600000000001 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427969+0000", 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026350100000000002 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.428208+0000", 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023929499999999999 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.436946+0000", 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087374299999999992 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445128+0000", 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081818789999999995 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445231+0000", 2024-04-26T07:49:45.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000103393 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445309+0000", 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7539000000000004e-05 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2175 3.5 3:a0e00f63:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.2093154000000004, 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016086005, 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.824 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2175 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561419+0000", 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7969999999999998e-06 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565707+0000", 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042876809999999998 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565748+0000", 2024-04-26T07:49:45.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1117e-05 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565768+0000", 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9432999999999998e-05 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565883+0000", 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011505099999999999 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.566079+0000", 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019624 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.566256+0000", 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000177539 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.575155+0000", 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0088989489999999997 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577394+0000", 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002238589 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577449+0000", 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5090999999999998e-05 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577502+0000", 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2518000000000001e-05 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2191 3.16 3:6a379d34:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.0337465479999999, 2024-04-26T07:49:45.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018754256, 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2191 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:45.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736987+0000", 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0280000000000001e-06 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740891+0000", 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039036959999999999 2024-04-26T07:49:45.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740913+0000", 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1472999999999999e-05 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740924+0000", 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1041e-05 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740993+0000", 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8868999999999994e-05 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.741106+0000", 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113235 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.741201+0000", 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4956000000000004e-05 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750323+0000", 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0091222409999999997 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755659+0000", 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053355579999999998 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755703+0000", 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4836000000000002e-05 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755739+0000", 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5323e-05 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.834 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2198 3.2f 3:f6b82421:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.9566556139999998, 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017684153000000001, 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2198 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814078+0000", 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0750000000000002e-06 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817877+0000", 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003798624 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817907+0000", 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0369e-05 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817921+0000", 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3284e-05 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818041+0000", 2024-04-26T07:49:45.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119912 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818263+0000", 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022216299999999999 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818466+0000", 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000203069 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.823916+0000", 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054501910000000001 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831677+0000", 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077611299999999998 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831722+0000", 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4496000000000002e-05 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831760+0000", 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7839999999999997e-05 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2201 3.30 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.9262239920000002, 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683907000000001, 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2201 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844511+0000", 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1400000000000002e-06 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848873+0000", 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043614509999999997 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848913+0000", 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9969999999999998e-05 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848930+0000", 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7935999999999999e-05 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849037+0000", 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106019 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849178+0000", 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014120699999999999 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849294+0000", 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000116239 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.855959+0000", 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066650490000000001 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865098+0000", 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0091388460000000008 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865150+0000", 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1993000000000002e-05 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865191+0000", 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1056999999999997e-05 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2204 3.5 3:a294f995:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.8887408150000002, 2024-04-26T07:49:45.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.03032317, 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2204 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881994+0000", 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6330000000000002e-06 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888238+0000", 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062439069999999999 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888280+0000", 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2231999999999998e-05 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888305+0000", 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5060000000000001e-05 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888469+0000", 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016422499999999999 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888479+0000", 2024-04-26T07:49:45.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.008e-05 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.894701+0000", 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062219969999999999 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895063+0000", 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036214800000000002 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:45.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895429+0000", 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036549400000000001 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.909795+0000", 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014366191 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912173+0000", 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023778330000000002 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912250+0000", 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6736000000000005e-05 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912313+0000", 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633999999999994e-05 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2206 3.16 3:6a8f0fb0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.8648319830000002, 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028443779999999998, 2024-04-26T07:49:45.851 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2206 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905902+0000", 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9059999999999998e-06 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910333+0000", 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044310299999999999 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910358+0000", 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4683000000000001e-05 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910373+0000", 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5003e-05 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910466+0000", 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3051000000000001e-05 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910844+0000", 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037795800000000002 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.911110+0000", 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000266681 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.924934+0000", 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013823287 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.933975+0000", 2024-04-26T07:49:45.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090409510000000002 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934161+0000", 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186276 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934343+0000", 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018195400000000001 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2219 3.d e59/17 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.7237278059999999, 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021609369999999999, 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047006+0000", 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7389999999999999e-06 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049788+0000", 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027819839999999999 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049813+0000", 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5315000000000001e-05 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049826+0000", 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3098999999999999e-05 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049911+0000", 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5129000000000004e-05 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049936+0000", 2024-04-26T07:49:45.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4689999999999999e-05 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068538+0000", 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018601592 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068613+0000", 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4821999999999996e-05 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.860 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2222 3.22 3:453f4002:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.6929399480000002, 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018726578000000001, 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2222 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:45.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077794+0000", 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5009999999999999e-06 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081660+0000", 2024-04-26T07:49:45.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038662480000000001 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081685+0000", 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5273e-05 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081696+0000", 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1294000000000001e-05 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081793+0000", 2024-04-26T07:49:45.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6775999999999996e-05 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081939+0000", 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014589099999999999 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.082072+0000", 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013268700000000001 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.089206+0000", 2024-04-26T07:49:45.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071342580000000001 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096386+0000", 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071801590000000002 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096457+0000", 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1143999999999995e-05 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096518+0000", 2024-04-26T07:49:45.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0346999999999997e-05 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2227 3.3c 3:3cb193a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.6408445469999999, 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016049378999999999, 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:45.866 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2227 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129892+0000", 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4399999999999996e-06 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134148+0000", 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042560890000000002 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134185+0000", 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7437000000000001e-05 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134212+0000", 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6503e-05 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134357+0000", 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014499900000000001 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134591+0000", 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023411100000000001 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134802+0000", 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021088899999999999 2024-04-26T07:49:45.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.143136+0000", 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008334335 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145778+0000", 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026417200000000002 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145860+0000", 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2539000000000004e-05 2024-04-26T07:49:45.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145936+0000", 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5316999999999997e-05 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2240 3.2 e59/17 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head v 59'1, mlcod=0'0)", 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.4658856600000001, 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016976453999999998, 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:45.871 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:45.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304847+0000", 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8300000000000001e-06 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309042+0000", 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004194634 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309063+0000", 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1067999999999999e-05 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309073+0000", 2024-04-26T07:49:45.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9310000000000003e-06 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309178+0000", 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010556399999999999 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309218+0000", 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9693000000000001e-05 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.321671+0000", 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012453379000000001 2024-04-26T07:49:45.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.321822+0000", 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015035499999999999 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:45.875 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:45.876 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:45.877 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:45.872+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:45.978 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:45.974+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:46.051 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:46.051 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:46.051 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:46.051 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:46.067 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:46.115 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:46.114+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:46.179 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:46.174+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:46.240 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:46.240 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:46.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:46.280 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:46.280+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:46.380 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:46.378+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.861060629999997, 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.421 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:49:46.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:49:46.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1243 3.34 e54/17 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head v 54'1, mlcod=0'0)", 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.194664398, 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018677787000000001, 2024-04-26T07:49:46.428 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224143+0000", 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7850000000000001e-06 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227226+0000", 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003083293 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227258+0000", 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2237999999999999e-05 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227273+0000", 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4312e-05 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227395+0000", 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012202200000000001 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227461+0000", 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6217000000000007e-05 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242732+0000", 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015270974 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242819+0000", 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6946000000000004e-05 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2102 3.35 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.432 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.1723458530000004, 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025241564000000001, 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2102 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:46.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246463+0000", 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.106e-06 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252299+0000", 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058363080000000001 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252331+0000", 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1914e-05 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252346+0000", 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4829e-05 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252506+0000", 2024-04-26T07:49:46.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015995500000000001 2024-04-26T07:49:46.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252872+0000", 2024-04-26T07:49:46.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000365817 2024-04-26T07:49:46.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:46.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253249+0000", 2024-04-26T07:49:46.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037744100000000001 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271215+0000", 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017965979 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271568+0000", 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035317600000000002 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271630+0000", 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1853000000000006e-05 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271701+0000", 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1186000000000006e-05 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2109 3.26 3:64cb7bc7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:46.439 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.0473283230000003, 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017368982000000002, 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2109 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371480+0000", 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6800000000000002e-06 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375488+0000", 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040076979999999996 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375515+0000", 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7790999999999999e-05 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375527+0000", 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1705000000000001e-05 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375609+0000", 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1929999999999997e-05 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375757+0000", 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014830400000000001 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375879+0000", 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121169 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.385948+0000", 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010069567999999999 2024-04-26T07:49:46.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388730+0000", 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002781684 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388782+0000", 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1894000000000002e-05 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388846+0000", 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4559000000000003e-05 2024-04-26T07:49:46.444 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2112 3.26 3:658014ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.0020452339999997, 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022887174, 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.445 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2112 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416763+0000", 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9469999999999999e-06 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422174+0000", 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005410687 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422216+0000", 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1807000000000001e-05 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422234+0000", 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8706e-05 2024-04-26T07:49:46.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422410+0000", 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017526900000000001 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422831+0000", 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042124399999999998 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:46.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.423250+0000", 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041928100000000003 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.438715+0000", 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015465202000000001 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439443+0000", 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00072764499999999996 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439539+0000", 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6173000000000002e-05 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439648+0000", 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108213 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2114 3.10 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:46.450 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.9697644649999999, 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021514529000000001, 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2114 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449044+0000", 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6369999999999999e-06 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454276+0000", 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052320489999999999 2024-04-26T07:49:46.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454310+0000", 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4186000000000001e-05 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454328+0000", 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7977000000000001e-05 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454461+0000", 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013284899999999999 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454722+0000", 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026144500000000002 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454976+0000", 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025349200000000002 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.463666+0000", 2024-04-26T07:49:46.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086904649999999996 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470375+0000", 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067091629999999998 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470477+0000", 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101433 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470556+0000", 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8832999999999996e-05 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2144 3.26 3:66326b37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.5523966319999998, 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016531011000000002, 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.456 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2144 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866411+0000", 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.198e-06 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871082+0000", 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046708499999999998 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871112+0000", 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9558000000000001e-05 2024-04-26T07:49:46.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871127+0000", 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5084e-05 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871236+0000", 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109786 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871500+0000", 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000263248 2024-04-26T07:49:46.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871737+0000", 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023734900000000001 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882248+0000", 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010511453 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882850+0000", 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00060166699999999996 2024-04-26T07:49:46.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882899+0000", 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9144000000000002e-05 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882940+0000", 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0673999999999997e-05 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.461 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2148 3.1e e58/46 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head v 58'3, mlcod=54'1)", 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.4465319980000002, 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018285590000000001, 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972276+0000", 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7930000000000002e-06 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980745+0000", 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084683919999999999 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980771+0000", 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5911e-05 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980784+0000", 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3241000000000001e-05 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980866+0000", 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2348999999999994e-05 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980891+0000", 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5097e-05 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990494+0000", 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0096024130000000006 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990559+0000", 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5394000000000004e-05 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.465 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2157 3.a 3:522571bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.2211465400000003, 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018495228999999998, 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2157 2024-04-26T07:49:46.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197662+0000", 2024-04-26T07:49:46.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2440000000000002e-06 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201962+0000", 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042994369999999997 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201994+0000", 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1850999999999997e-05 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202009+0000", 2024-04-26T07:49:46.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5251e-05 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202109+0000", 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100318 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202250+0000", 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014054700000000001 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:46.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202371+0000", 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012143500000000001 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.207294+0000", 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049230929999999999 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216058+0000", 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087642239999999993 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216112+0000", 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3897000000000003e-05 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216154+0000", 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1931999999999998e-05 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2162 3.35 3:ad57cd5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:46.471 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.0977139749999996, 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016822856000000001, 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2162 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:46.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321094+0000", 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.43e-06 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327241+0000", 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061465360000000002 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327266+0000", 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5922e-05 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327282+0000", 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5603e-05 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327396+0000", 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113418 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327544+0000", 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014825 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327679+0000", 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134905 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337198+0000", 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0095190269999999993 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337818+0000", 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000620737 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337869+0000", 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0893000000000002e-05 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337914+0000", 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5135000000000001e-05 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2171 3.26 3:655b4449:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.9145658189999999, 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016538298, 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.477 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2171 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504243+0000", 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509432+0000", 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051888860000000002 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509451+0000", 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9241000000000001e-05 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509464+0000", 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2510999999999999e-05 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509514+0000", 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0083999999999997e-05 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509623+0000", 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109768 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509721+0000", 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7182000000000006e-05 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520340+0000", 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010619358000000001 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520698+0000", 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035771499999999999 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520738+0000", 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0623000000000001e-05 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520778+0000", 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9817000000000002e-05 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.482 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2172 3.36 3:6e55231b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8948160969999996, 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016132018000000001, 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2172 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.483 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523993+0000", 2024-04-26T07:49:46.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4070000000000002e-06 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528585+0000", 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00459225 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528620+0000", 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5073000000000001e-05 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528640+0000", 2024-04-26T07:49:46.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9913000000000001e-05 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528743+0000", 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010309100000000001 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528918+0000", 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175203 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.529094+0000", 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175928 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.539613+0000", 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010518675999999999 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540039+0000", 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042617600000000001 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540085+0000", 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5367000000000001e-05 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540122+0000", 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6934000000000002e-05 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2179 3.a 3:50808692:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:46.488 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8118848759999997, 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018371393999999999, 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2179 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:46.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606923+0000", 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9879999999999999e-06 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612730+0000", 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058072059999999997 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612765+0000", 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5187e-05 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612784+0000", 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8536e-05 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612865+0000", 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1522999999999999e-05 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612994+0000", 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012873499999999999 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.613100+0000", 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105647 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.618956+0000", 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058564849999999998 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625161+0000", 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062052549999999998 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625237+0000", 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5364000000000006e-05 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625292+0000", 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5467999999999998e-05 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2189 3.20 3:05abebd8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.70734794, 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016416799999999999, 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.494 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2189 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711460+0000", 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1390000000000002e-06 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715243+0000", 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00378364 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715266+0000", 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2521e-05 2024-04-26T07:49:46.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715276+0000", 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8630000000000003e-06 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715358+0000", 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2520000000000003e-05 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715520+0000", 2024-04-26T07:49:46.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161237 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715666+0000", 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014621100000000001 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.721893+0000", 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062276730000000004 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727800+0000", 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059063750000000002 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727841+0000", 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1247e-05 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727874+0000", 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3374000000000003e-05 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.499 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2218 3.34 e59/17 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.3830701210000003, 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030663971000000002, 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035737+0000", 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0869999999999999e-06 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039593+0000", 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038566609999999999 2024-04-26T07:49:46.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039642+0000", 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8699999999999998e-05 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7350000000000001e-05 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039870+0000", 2024-04-26T07:49:46.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020093199999999999 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039931+0000", 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1294e-05 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066342+0000", 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026410869 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066399+0000", 2024-04-26T07:49:46.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7077999999999998e-05 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2228 3.26 3:64fe9f73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.2777819150000003, 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022971215999999999, 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.504 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2228 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141027+0000", 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1470000000000001e-06 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145123+0000", 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040963650000000002 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145151+0000", 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7591999999999999e-05 2024-04-26T07:49:46.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145165+0000", 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4381e-05 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145290+0000", 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012445699999999999 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145588+0000", 2024-04-26T07:49:46.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029875499999999999 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145898+0000", 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031002800000000001 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163197+0000", 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017298396000000001 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163680+0000", 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048320699999999998 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163856+0000", 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017556200000000001 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163995+0000", 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139326 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2230 3.a 3:53d9bc93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.252984841, 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019702107, 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2230 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165823+0000", 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2069999999999998e-06 2024-04-26T07:49:46.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169605+0000", 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037818980000000001 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169633+0000", 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7906999999999999e-05 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169646+0000", 2024-04-26T07:49:46.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3132000000000001e-05 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169796+0000", 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015037699999999999 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.170035+0000", 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238905 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.170260+0000", 2024-04-26T07:49:46.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000224551 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184639+0000", 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01437922 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185356+0000", 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000716575 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185453+0000", 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7188999999999994e-05 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185523+0000", 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0146000000000002e-05 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2242 3.2c 3:3494587f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.0979466230000003, 2024-04-26T07:49:46.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023803956000000001, 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2242 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320862+0000", 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326077+0000", 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052153720000000002 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326119+0000", 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1112999999999998e-05 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326139+0000", 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9962999999999998e-05 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326237+0000", 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8110999999999996e-05 2024-04-26T07:49:46.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326355+0000", 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011791200000000001 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326459+0000", 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010489600000000001 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338991+0000", 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012531967 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344349+0000", 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053576589999999999 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344529+0000", 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179958 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344663+0000", 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013385 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.520 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2246 3.1e e59/46 3:7a597943:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_135:head v 59'5, mlcod=58'3)", 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.0532244349999997, 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021214457999999999, 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:46.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365584+0000", 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.554e-06 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370384+0000", 2024-04-26T07:49:46.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048000589999999997 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370416+0000", 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370432+0000", 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5553000000000002e-05 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370552+0000", 2024-04-26T07:49:46.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119836 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370593+0000", 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1295999999999999e-05 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.386730+0000", 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016136833999999999 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.386796+0000", 2024-04-26T07:49:46.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5747000000000006e-05 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2248 3.36 3:6c58e6b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.0354290820000003, 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017638042, 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.525 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2248 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383381+0000", 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0999999999999997e-06 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387813+0000", 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004432638 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387857+0000", 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3773000000000003e-05 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387886+0000", 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8569999999999999e-05 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387994+0000", 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108705 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.388184+0000", 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000189268 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.388342+0000", 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015877900000000001 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398071+0000", 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097290190000000002 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.400936+0000", 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028646679999999999 2024-04-26T07:49:46.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.400980+0000", 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3733000000000003e-05 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.401015+0000", 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4789000000000002e-05 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.530 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.531 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:46.532 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:46.532 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:46.528+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:46.633 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:46.628+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:46.702 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:46.703 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:46.703 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:46.703 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:46.717 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:46.734 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:46.732+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:46.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:46.835 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:46.835 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:46.836 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:46.836 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:46.836 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:46.850 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:46.874 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:46.872+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:46.904 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:49:46.936 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:46.934+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.521258517999996, 2024-04-26T07:49:46.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:49:46.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:49:46.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:49:46.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:49:46.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:49:46.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:49:46.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:46.987 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.236224806999999, 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:49:46.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:49:46.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.236185973999994, 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.993 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:49:46.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:46.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.236147943999995, 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:46.999 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:49:47.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:49:47.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.236026390999996, 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:47.005 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:49:47.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.010 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.235986421999996, 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:47.011 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:49:47.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:49:47.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:49:47.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:49:47.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:49:47.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:49:47.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.017 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.018 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2103 3.3b 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:47.018 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:47.018 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.7183347629999997, 2024-04-26T07:49:47.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025234304999999999, 2024-04-26T07:49:47.018 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2103 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:47.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259416+0000", 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6260000000000001e-06 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.265987+0000", 2024-04-26T07:49:47.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00657108 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266029+0000", 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1155999999999997e-05 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266055+0000", 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6597e-05 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266194+0000", 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013830200000000001 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266432+0000", 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023884199999999999 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266641+0000", 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020863199999999999 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.279877+0000", 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013236346 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284529+0000", 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046518210000000004 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284593+0000", 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3723e-05 2024-04-26T07:49:47.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284647+0000", 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.418e-05 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2108 3.f 3:f0ee051f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.6272291000000001, 2024-04-26T07:49:47.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020717233000000002, 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2108 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350520+0000", 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7269999999999999e-06 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358048+0000", 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075278059999999997 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358071+0000", 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3523000000000002e-05 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358083+0000", 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1265e-05 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358172+0000", 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9582999999999999e-05 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358326+0000", 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015335899999999999 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358454+0000", 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0001282 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.364823+0000", 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063690309999999998 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371105+0000", 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062825310000000001 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371167+0000", 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1532999999999995e-05 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371236+0000", 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8675000000000002e-05 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2139 3.e 3:7390af0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.2264867840000004, 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024095845000000001, 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.030 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2139 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751265+0000", 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2729999999999996e-06 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.758971+0000", 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077062930000000003 2024-04-26T07:49:47.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759009+0000", 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7429999999999999e-05 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759027+0000", 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8323000000000001e-05 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759223+0000", 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000196386 2024-04-26T07:49:47.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759474+0000", 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250175 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759705+0000", 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000230998 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.774391+0000", 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014686296999999999 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775046+0000", 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065485499999999998 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775220+0000", 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017439899999999999 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775357+0000", 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013641599999999999 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2141 3.e 3:73fc2b27:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.1784636649999998, 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683983999999999, 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.036 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2141 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:47.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799288+0000", 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-06 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803704+0000", 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044163680000000004 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803745+0000", 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0836e-05 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803764+0000", 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8743e-05 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803912+0000", 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014867299999999999 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804192+0000", 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027982799999999998 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804430+0000", 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238435 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816451+0000", 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012020507 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819796+0000", 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033448689999999999 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819890+0000", 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3795999999999994e-05 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819968+0000", 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8208999999999996e-05 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2142 3.15 3:a87525cc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.1613645869999996, 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022647812, 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2142 2024-04-26T07:49:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816387+0000", 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2560000000000004e-06 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822782+0000", 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063953079999999997 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822812+0000", 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9876999999999999e-05 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822833+0000", 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1013e-05 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823017+0000", 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018354499999999999 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823252+0000", 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234832 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823515+0000", 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026311800000000001 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.836859+0000", 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01334453 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838722+0000", 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018625650000000001 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838882+0000", 2024-04-26T07:49:47.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015986200000000001 2024-04-26T07:49:47.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839031+0000", 2024-04-26T07:49:47.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148906 2024-04-26T07:49:47.049 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.049 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.049 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2150 3.39 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.9586609169999996, 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025377047, 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.050 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2150 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019089+0000", 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3590000000000002e-06 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023640+0000", 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045514700000000002 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023666+0000", 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5384e-05 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023680+0000", 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3981999999999999e-05 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023757+0000", 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7249999999999994e-05 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023912+0000", 2024-04-26T07:49:47.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015499900000000001 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.024032+0000", 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119628 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.034967+0000", 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010935823000000001 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044357+0000", 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093895449999999991 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044412+0000", 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5359999999999999e-05 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044464+0000", 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1246999999999999e-05 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2168 3.2d 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.5231290529999999, 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026862164000000001, 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2168 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.056 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454622+0000", 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:49:47.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459549+0000", 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049275710000000004 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459589+0000", 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9387000000000001e-05 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459609+0000", 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0392999999999999e-05 2024-04-26T07:49:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459751+0000", 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014207900000000001 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459996+0000", 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024460500000000001 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.460226+0000", 2024-04-26T07:49:47.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023053200000000001 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.469147+0000", 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089203549999999996 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481152+0000", 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012005386999999999 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481352+0000", 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020005199999999999 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481481+0000", 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012850900000000001 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2183 3.37 3:ef675d97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:47.061 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.3285648590000001, 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019732288000000001, 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2183 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:47.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649185+0000", 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8200000000000001e-06 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655471+0000", 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062857750000000004 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655498+0000", 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7029000000000002e-05 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655509+0000", 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0813e-05 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655609+0000", 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9953999999999999e-05 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655801+0000", 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000192189 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655983+0000", 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018226200000000001 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668782+0000", 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012798886000000001 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668801+0000", 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377999999999999e-05 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668856+0000", 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5265e-05 2024-04-26T07:49:47.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668915+0000", 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8916999999999999e-05 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2205 3.14 e59/17 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head v 59'3, mlcod=58'1)", 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.0794274870000002, 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020789596, 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.067 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898321+0000", 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6400000000000001e-07 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902172+0000", 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003850787 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902208+0000", 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5952999999999999e-05 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902230+0000", 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1987000000000001e-05 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902392+0000", 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162344 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902418+0000", 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5953e-05 2024-04-26T07:49:47.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919038+0000", 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016620234000000001 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919110+0000", 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1474e-05 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2207 3.3f 3:fe080a1d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.062202149, 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021701979999999999, 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2207 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915549+0000", 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1200000000000004e-06 2024-04-26T07:49:47.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921046+0000", 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054969049999999998 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921067+0000", 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0724e-05 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921079+0000", 2024-04-26T07:49:47.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1533e-05 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921145+0000", 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6662000000000007e-05 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921267+0000", 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121889 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921388+0000", 2024-04-26T07:49:47.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120449 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934035+0000", 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012647818 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937179+0000", 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003143065 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937218+0000", 2024-04-26T07:49:47.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9662000000000001e-05 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937247+0000", 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9153e-05 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2213 3.f 3:f1254826:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.9990389539999995, 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021396413, 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.077 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2213 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978713+0000", 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982948+0000", 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042354690000000004 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982982+0000", 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3683000000000003e-05 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983002+0000", 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9599999999999999e-05 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983200+0000", 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000198715 2024-04-26T07:49:47.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983466+0000", 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026605500000000001 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983722+0000", 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025512499999999998 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.994151+0000", 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010429528 2024-04-26T07:49:47.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999893+0000", 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057413860000000002 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999992+0000", 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9689e-05 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.000105+0000", 2024-04-26T07:49:47.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112766 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2217 3.2b e59/17 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.9542897239999997, 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044994659999999999, 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6300000000000005e-07 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032526+0000", 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090671680000000004 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032570+0000", 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4039000000000003e-05 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032593+0000", 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3873e-05 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032774+0000", 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018014300000000001 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032819+0000", 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5713000000000001e-05 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068399+0000", 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.035580053 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068452+0000", 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3108e-05 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2219 3.d 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.938081543, 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029242280999999998, 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.087 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2219 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4999999999999999e-06 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046427+0000", 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067579299999999997 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046452+0000", 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4341999999999998e-05 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046465+0000", 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3434999999999999e-05 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046565+0000", 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9584000000000001e-05 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046729+0000", 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016413300000000001 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046851+0000", 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012242199999999999 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068781+0000", 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021930021000000001 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068797+0000", 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6123000000000001e-05 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068862+0000", 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.457e-05 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068908+0000", 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6220999999999997e-05 2024-04-26T07:49:47.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2247 3.14 e59/17 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head v 59'5, mlcod=59'3)", 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.5995419440000003, 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019349376000000001, 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:47.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378209+0000", 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0929999999999999e-06 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:47.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381273+0000", 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00306456 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381314+0000", 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0519000000000003e-05 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381331+0000", 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7547e-05 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381492+0000", 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000160979 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381553+0000", 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0962999999999999e-05 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397406+0000", 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015853145999999999 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:47.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:47.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397555+0000", 2024-04-26T07:49:47.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014856900000000001 2024-04-26T07:49:47.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.097 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:47.097 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:47.097 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:47.098 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:47.099 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:47.100 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:47.094+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:47.100 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:47.101 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:47.101 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:47.102 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:47.102 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:47.102 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:47.120 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:47.142 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:47.142 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:47.199 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:47.198+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:47.220 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:47.220 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:47.234 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:47.300 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:47.296+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:47.354 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:47.354 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:47.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:47.410 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:47.408+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:47.502 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:47.500+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:47.537 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:47.537 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:47.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:47.603 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:47.598+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:47.704 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:47.702+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:47.717 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:47.717 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:47.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:47.805 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:47.802+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:47.857 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:47.857 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:47.872 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:47.918 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:47.916+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:47.999 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:47.999 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:48.007 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:48.004+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:48.014 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:48.026 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:49:48.107 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:48.104+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:48.149 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:48.149 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:48.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:48.208 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:48.206+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:48.309 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:48.310+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:48.335 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:48.335 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:48.350 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:48.410 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:48.410+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:48.477 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:48.477 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:48.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:48.542 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:48.540+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:48.612 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:48.610+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:48.620 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:48.620 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:48.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:48.726 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:48.724+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:48.799 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:48.799 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:48.813 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:48.810+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:48.814 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:48.914 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:48.912+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:48.985 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:48.986 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:49.001 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:49.042 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:49.040+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:49.116 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:49.116+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:49.132 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:49.133 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:49.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:49.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:49.216 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:49.214+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:49.268 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:49.269 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:49.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:49.318 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:49.319 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:49.327 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:49.326+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:49.335 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:49.352 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:49.353 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:49.369 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:49.370 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:49.389 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:49.389 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:49.409 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:49.418 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:49.416+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:49.429 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:49.450 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:49.450 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:49.455 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:49.455 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:49.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.239825545999999, 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:49:49.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:49:49.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:49:49.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2119 3.14 3:288a1f0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.540968+0000", 2024-04-26T07:49:49.461 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.9142619360000008, 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018508938999999999, 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2119 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.540968+0000", 2024-04-26T07:49:49.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.540968+0000", 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.540970+0000", 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9910000000000001e-06 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547683+0000", 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067131609999999996 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547706+0000", 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2818000000000001e-05 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547720+0000", 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3817e-05 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547795+0000", 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4920999999999996e-05 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.547925+0000", 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129896 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.548043+0000", 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011779500000000001 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.558708+0000", 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010665480999999999 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.559377+0000", 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00066852000000000003 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.559427+0000", 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0556000000000002e-05 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.559477+0000", 2024-04-26T07:49:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9982999999999999e-05 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2143 3.3 3:c0b0b164:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.839704+0000", 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.6155264860000003, 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017690615999999999, 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.467 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2143 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839704+0000", 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839704+0000", 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839706+0000", 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2979999999999999e-06 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844009+0000", 2024-04-26T07:49:49.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004302948 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844038+0000", 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9626999999999999e-05 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844054+0000", 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5607000000000002e-05 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844167+0000", 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011302399999999999 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844405+0000", 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000237867 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.844620+0000", 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021521299999999999 2024-04-26T07:49:49.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.852674+0000", 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0080538729999999996 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.857176+0000", 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045023579999999997 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.857283+0000", 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106912 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.857394+0000", 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110889 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.41239721, 2024-04-26T07:49:49.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:49:49.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2153 3.1a 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.095067+0000", 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.3601625469999998, 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018316490000000001, 2024-04-26T07:49:49.479 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2153 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.095067+0000", 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.095067+0000", 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.095070+0000", 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9909999999999998e-06 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.098779+0000", 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037086110000000001 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.098807+0000", 2024-04-26T07:49:49.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7752000000000001e-05 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.098819+0000", 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1824000000000001e-05 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.098896+0000", 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7532000000000002e-05 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.099025+0000", 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129264 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.099143+0000", 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011773 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.103713+0000", 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045698040000000002 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.113231+0000", 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0095184529999999996 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.113313+0000", 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1310999999999995e-05 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.113384+0000", 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1217999999999995e-05 2024-04-26T07:49:49.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2159 3.14 3:29380a3b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.2083052829999996, 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019870071, 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2159 2024-04-26T07:49:49.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246928+0000", 2024-04-26T07:49:49.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7719999999999999e-06 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250722+0000", 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003794791 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250751+0000", 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.887e-05 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250763+0000", 2024-04-26T07:49:49.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2167999999999999e-05 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250866+0000", 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102704 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.251140+0000", 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027415300000000002 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:49.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.251537+0000", 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039718099999999998 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266022+0000", 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014485071 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266638+0000", 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00061538200000000004 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266729+0000", 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1434000000000006e-05 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266795+0000", 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5544999999999997e-05 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.490 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2192 3.1a 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.746458+0000", 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.7087722450000005, 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018031636, 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2192 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.746458+0000", 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.746458+0000", 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.746461+0000", 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7669999999999999e-06 2024-04-26T07:49:49.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750580+0000", 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041195219999999996 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750637+0000", 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7059999999999999e-05 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750664+0000", 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7206999999999999e-05 2024-04-26T07:49:49.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750758+0000", 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3344000000000006e-05 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750900+0000", 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014204300000000001 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.751021+0000", 2024-04-26T07:49:49.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121129 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.757792+0000", 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067716290000000004 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.764340+0000", 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065478050000000003 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.764424+0000", 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3780000000000001e-05 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.764489+0000", 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5350000000000003e-05 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:49.496 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.5618153010000002, 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:49:49.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:49:49.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:49:49.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2213 3.f e59/17 3:f1254826:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_102:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.983943+0000", 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.4712872279999996, 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015548381, 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983943+0000", 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983943+0000", 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983946+0000", 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7360000000000001e-06 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990336+0000", 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063905849999999998 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990382+0000", 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6072999999999997e-05 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990407+0000", 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5199999999999999e-05 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990510+0000", 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010243600000000001 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.990537+0000", 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7529999999999999e-05 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999381+0000", 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0088440849999999998 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999491+0000", 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010973599999999999 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2216 3.1a 3:5801baf3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.010946+0000", 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.444284465, 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016423601999999999, 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2216 2024-04-26T07:49:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.510 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.010946+0000", 2024-04-26T07:49:49.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.010946+0000", 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.010949+0000", 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0759999999999999e-06 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.014968+0000", 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040192880000000002 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015003+0000", 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4802999999999999e-05 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015019+0000", 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6497000000000001e-05 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015094+0000", 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5103000000000002e-05 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015209+0000", 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000114208 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.015311+0000", 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102533 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.021592+0000", 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062810119999999999 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.027189+0000", 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0055965800000000003 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.027294+0000", 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105269 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.027369+0000", 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5233000000000003e-05 2024-04-26T07:49:49.514 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.4252427269999997, 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.515 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2220 3.24 e59/17 3:2595c82c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_109:head v 59'6, mlcod=58'4)", 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.051143+0000", 2024-04-26T07:49:49.520 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.4040866369999998, 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015681265999999999, 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.051143+0000", 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.051143+0000", 2024-04-26T07:49:49.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.051146+0000", 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5170000000000002e-06 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055451+0000", 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043053179999999998 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055481+0000", 2024-04-26T07:49:49.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9505e-05 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055495+0000", 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4654999999999999e-05 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055600+0000", 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105067 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.055641+0000", 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0707999999999997e-05 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066772+0000", 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011130697 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066825+0000", 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2799000000000001e-05 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2226 3.24 e59/17 3:259572e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_115:head v 59'8, mlcod=59'6)", 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.122343+0000", 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.3328869269999997, 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014858873999999999, 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.122343+0000", 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.122343+0000", 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.122345+0000", 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0219999999999999e-06 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.127761+0000", 2024-04-26T07:49:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005415474 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.127797+0000", 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6426e-05 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.127821+0000", 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3683e-05 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.128018+0000", 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019710499999999999 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.128062+0000", 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.384e-05 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.137084+0000", 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.009022291 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.137202+0000", 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118033 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2231 3.9 3:90514a14:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.179934+0000", 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.2752956940000004, 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016904933, 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2231 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.179934+0000", 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.179934+0000", 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.179962+0000", 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8126000000000001e-05 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184436+0000", 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044731379999999998 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184489+0000", 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3183000000000002e-05 2024-04-26T07:49:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184518+0000", 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8923000000000001e-05 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184707+0000", 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000188906 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185043+0000", 2024-04-26T07:49:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033642699999999998 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185282+0000", 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023896200000000001 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.193876+0000", 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0085939420000000002 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.196742+0000", 2024-04-26T07:49:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028657629999999999 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.196796+0000", 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3885000000000003e-05 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.196839+0000", 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3677999999999998e-05 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2237 3.14 3:2a3bf868:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.1940438889999996, 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021268025999999999, 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2237 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261188+0000", 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.748e-06 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264952+0000", 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037645809999999999 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264975+0000", 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2918999999999999e-05 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264986+0000", 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0373e-05 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265083+0000", 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7298000000000003e-05 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265313+0000", 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022968700000000001 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265529+0000", 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021579800000000001 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.279284+0000", 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013755276 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282361+0000", 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003077144 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282413+0000", 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2447000000000001e-05 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282454+0000", 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0754999999999999e-05 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2239 3.3 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.1686549179999997, 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020185307, 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2239 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286577+0000", 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7579999999999999e-06 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290701+0000", 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041239379999999997 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290726+0000", 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5312000000000001e-05 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290737+0000", 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1129e-05 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290809+0000", 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1500000000000003e-05 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290943+0000", 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013438999999999999 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.291063+0000", 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119926 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.297286+0000", 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062232440000000002 2024-04-26T07:49:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306608+0000", 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093216859999999992 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306693+0000", 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5278000000000006e-05 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306760+0000", 2024-04-26T07:49:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7145999999999997e-05 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2242 3.2c e59/17 3:3494587f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_131:head v 59'1, mlcod=0'0)", 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.326624+0000", 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.1286059460000004, 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017302700000000001, 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326624+0000", 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326624+0000", 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326627+0000", 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5600000000000001e-06 2024-04-26T07:49:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329380+0000", 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027533449999999999 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329424+0000", 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3747e-05 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329448+0000", 2024-04-26T07:49:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4413000000000002e-05 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329603+0000", 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015526900000000001 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.329657+0000", 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3689e-05 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.343798+0000", 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014140648 2024-04-26T07:49:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.343927+0000", 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012902899999999999 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2243 3.1b e59/17 3:db991f00:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_132:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.333426+0000", 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.1218039559999999, 2024-04-26T07:49:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016361652000000001, 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.333426+0000", 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.333426+0000", 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.333428+0000", 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4099999999999998e-06 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338635+0000", 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005206062 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338671+0000", 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6569000000000002e-05 2024-04-26T07:49:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338689+0000", 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7376000000000001e-05 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338808+0000", 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011959999999999999 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338866+0000", 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7822999999999998e-05 2024-04-26T07:49:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.349642+0000", 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01077582 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.349788+0000", 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014599200000000001 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2245 3.9 3:91913af5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.351383+0000", 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.1038471420000002, 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017499292999999999, 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2245 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.351383+0000", 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.351383+0000", 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.351386+0000", 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.807e-06 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357260+0000", 2024-04-26T07:49:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005874598 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357313+0000", 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2283000000000001e-05 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357356+0000", 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3826999999999999e-05 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357499+0000", 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014246199999999999 2024-04-26T07:49:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357742+0000", 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024279099999999999 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.357971+0000", 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000229349 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.366228+0000", 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082572730000000007 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.368754+0000", 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002525228 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.368824+0000", 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0528e-05 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.368882+0000", 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8146999999999997e-05 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.0817776390000002, 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:49:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:49:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:49.565 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:49.567 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:49.564+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:49.568 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:49.668 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:49.666+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:49.700 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:49.700 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:49.700 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:49.700 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:49.714 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:49.769 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:49.764+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:49.870 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:49.868+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:49.877 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:49.877 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:49.877 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:49.877 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:49.877 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:49.891 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:49.971 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:49.970+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:50.009 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:50.009 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1246 3.2f 3:f6e96107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.762272444000001, 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023540999999999999, 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.010 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1246 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247046+0000", 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9270000000000001e-06 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252338+0000", 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052911449999999997 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252378+0000", 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0299999999999997e-05 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252396+0000", 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8600000000000001e-05 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252475+0000", 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8669000000000002e-05 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252592+0000", 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011717 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252971+0000", 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037877499999999998 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.262239+0000", 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092677920000000004 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270496+0000", 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082573809999999994 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270545+0000", 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8627e-05 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270585+0000", 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9613999999999997e-05 2024-04-26T07:49:50.015 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2102 3.35 e58/17 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.7557923839999994, 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017395158000000001, 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253526+0000", 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.903e-06 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258558+0000", 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050312769999999998 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258594+0000", 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6353999999999998e-05 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258617+0000", 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2785999999999998e-05 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258737+0000", 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011977999999999999 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258763+0000", 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6088000000000002e-05 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.270840+0000", 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012077277000000001 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.270919+0000", 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8693e-05 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2111 3.30 3:0ee8838f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.6154652259999995, 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021248963999999999, 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.020 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2111 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393853+0000", 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3640000000000002e-06 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399704+0000", 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058506870000000002 2024-04-26T07:49:50.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399732+0000", 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8309e-05 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399747+0000", 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5356999999999999e-05 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399899+0000", 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015193300000000001 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.400153+0000", 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025378500000000002 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.400381+0000", 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022828200000000001 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.413732+0000", 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013351059 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.414922+0000", 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001189322 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.415012+0000", 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0210000000000005e-05 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.415100+0000", 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7656000000000002e-05 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2122 3.c 3:33f873c3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4035683839999997, 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022871248, 2024-04-26T07:49:50.026 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2122 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605750+0000", 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6129999999999998e-06 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611353+0000", 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0056032139999999996 2024-04-26T07:49:50.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611382+0000", 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8583000000000001e-05 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611396+0000", 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4517e-05 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611510+0000", 2024-04-26T07:49:50.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011364199999999999 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611637+0000", 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012689799999999999 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611750+0000", 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011253500000000001 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.617831+0000", 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006081319 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628524+0000", 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010693513 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628578+0000", 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3980999999999997e-05 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628619+0000", 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0432999999999997e-05 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2125 3.17 e58/17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.3488908160000008, 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017323336000000002, 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.032 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660428+0000", 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666876+0000", 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064477750000000002 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666918+0000", 2024-04-26T07:49:50.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2512999999999998e-05 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666940+0000", 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2223000000000001e-05 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.667111+0000", 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170509 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.667173+0000", 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2266000000000003e-05 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.677671+0000", 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010497833999999999 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.677748+0000", 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7405999999999997e-05 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2140 3.c 3:30bbfb90:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.2337855599999994, 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018799924999999999, 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2140 2024-04-26T07:49:50.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775533+0000", 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780479+0000", 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049457379999999999 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780517+0000", 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8046999999999997e-05 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780535+0000", 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8332999999999999e-05 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780700+0000", 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016463599999999999 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780955+0000", 2024-04-26T07:49:50.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025536800000000001 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.781190+0000", 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023499099999999999 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.791429+0000", 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010238466999999999 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794125+0000", 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026960090000000001 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794221+0000", 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6099000000000003e-05 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794330+0000", 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109347 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2146 3.38 e58/17 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.0884742870000004, 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015464832, 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920844+0000", 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927172+0000", 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063278589999999999 2024-04-26T07:49:50.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927209+0000", 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6912999999999997e-05 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927226+0000", 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7479e-05 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927361+0000", 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013498300000000001 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927423+0000", 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2076000000000007e-05 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.936218+0000", 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087948760000000001 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.936306+0000", 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8152999999999994e-05 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.046 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2152 3.21 e58/17 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.9368624539999999, 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015640588, 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:50.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072456+0000", 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1629999999999999e-06 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080207+0000", 2024-04-26T07:49:50.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007750903 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080238+0000", 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1207000000000001e-05 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080254+0000", 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6283e-05 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080379+0000", 2024-04-26T07:49:50.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125341 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080410+0000", 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0861000000000001e-05 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.087981+0000", 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007570327 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.088094+0000", 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113503 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2163 3.2f 3:f4a8dc53:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.6643905060000002, 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017273949, 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2163 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344927+0000", 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6419999999999999e-06 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349163+0000", 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042360430000000001 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349182+0000", 2024-04-26T07:49:50.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8966000000000001e-05 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349192+0000", 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8800000000000003e-06 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349266+0000", 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4085000000000006e-05 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349448+0000", 2024-04-26T07:49:50.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018166999999999999 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349615+0000", 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016686000000000001 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.359728+0000", 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010113837000000001 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362078+0000", 2024-04-26T07:49:50.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002349851 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362133+0000", 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4255000000000001e-05 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362199+0000", 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6859999999999993e-05 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2166 3.c 3:3335ddb9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.5859968329999994, 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021989392, 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2166 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423323+0000", 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.456e-06 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427512+0000", 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004189033 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427550+0000", 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427570+0000", 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9397000000000001e-05 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427705+0000", 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013559600000000001 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427969+0000", 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026350100000000002 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.428208+0000", 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023929499999999999 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.436946+0000", 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087374299999999992 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445128+0000", 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081818789999999995 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445231+0000", 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000103393 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445309+0000", 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7539000000000004e-05 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2175 3.5 3:a0e00f63:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4479003679999991, 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016086005, 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.062 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2175 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561419+0000", 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7969999999999998e-06 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565707+0000", 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042876809999999998 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565748+0000", 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1117e-05 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565768+0000", 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9432999999999998e-05 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565883+0000", 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011505099999999999 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.566079+0000", 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019624 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.566256+0000", 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000177539 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.575155+0000", 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0088989489999999997 2024-04-26T07:49:50.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577394+0000", 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002238589 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577449+0000", 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5090999999999998e-05 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577502+0000", 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2518000000000001e-05 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2191 3.16 3:6a379d34:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.2723315159999995, 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018754256, 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.068 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2191 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736987+0000", 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0280000000000001e-06 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740891+0000", 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039036959999999999 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740913+0000", 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1472999999999999e-05 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740924+0000", 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1041e-05 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740993+0000", 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8868999999999994e-05 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.741106+0000", 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113235 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.741201+0000", 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4956000000000004e-05 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750323+0000", 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0091222409999999997 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755659+0000", 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053355579999999998 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755703+0000", 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4836000000000002e-05 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755739+0000", 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5323e-05 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2198 3.2f 3:f6b82421:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:50.073 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.1952405820000003, 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017684153000000001, 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2198 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:50.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814078+0000", 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0750000000000002e-06 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817877+0000", 2024-04-26T07:49:50.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003798624 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817907+0000", 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0369e-05 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817921+0000", 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3284e-05 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818041+0000", 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119912 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818263+0000", 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022216299999999999 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818466+0000", 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000203069 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.823916+0000", 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054501910000000001 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831677+0000", 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077611299999999998 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831722+0000", 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4496000000000002e-05 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831760+0000", 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7839999999999997e-05 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2201 3.30 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.1648089600000002, 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683907000000001, 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.079 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2201 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844511+0000", 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1400000000000002e-06 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848873+0000", 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043614509999999997 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848913+0000", 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9969999999999998e-05 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848930+0000", 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7935999999999999e-05 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849037+0000", 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106019 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849178+0000", 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014120699999999999 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849294+0000", 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000116239 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.855959+0000", 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066650490000000001 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865098+0000", 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0091388460000000008 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865150+0000", 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1993000000000002e-05 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865191+0000", 2024-04-26T07:49:50.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1056999999999997e-05 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2204 3.5 3:a294f995:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.1273257829999999, 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.03032317, 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.085 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2204 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:50.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881994+0000", 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6330000000000002e-06 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888238+0000", 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062439069999999999 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888280+0000", 2024-04-26T07:49:50.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2231999999999998e-05 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888305+0000", 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5060000000000001e-05 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888469+0000", 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016422499999999999 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888479+0000", 2024-04-26T07:49:50.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.008e-05 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.894701+0000", 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062219969999999999 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895063+0000", 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036214800000000002 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895429+0000", 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036549400000000001 2024-04-26T07:49:50.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.909795+0000", 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014366191 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912173+0000", 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023778330000000002 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912250+0000", 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6736000000000005e-05 2024-04-26T07:49:50.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912313+0000", 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633999999999994e-05 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2206 3.16 3:6a8f0fb0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.1034169509999998, 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028443779999999998, 2024-04-26T07:49:50.091 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2206 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905902+0000", 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9059999999999998e-06 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910333+0000", 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044310299999999999 2024-04-26T07:49:50.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910358+0000", 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4683000000000001e-05 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910373+0000", 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5003e-05 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910466+0000", 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3051000000000001e-05 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910844+0000", 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037795800000000002 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.911110+0000", 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000266681 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.924934+0000", 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013823287 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.933975+0000", 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090409510000000002 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934161+0000", 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186276 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934343+0000", 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018195400000000001 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2219 3.d e59/17 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.9623127739999999, 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021609369999999999, 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.097 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047006+0000", 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7389999999999999e-06 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049788+0000", 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027819839999999999 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049813+0000", 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5315000000000001e-05 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049826+0000", 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3098999999999999e-05 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049911+0000", 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5129000000000004e-05 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049936+0000", 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4689999999999999e-05 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068538+0000", 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018601592 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068613+0000", 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4821999999999996e-05 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2222 3.22 3:453f4002:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:50.101 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.9315249159999999, 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018726578000000001, 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2222 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077794+0000", 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5009999999999999e-06 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081660+0000", 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038662480000000001 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081685+0000", 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5273e-05 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081696+0000", 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1294000000000001e-05 2024-04-26T07:49:50.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081793+0000", 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6775999999999996e-05 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081939+0000", 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014589099999999999 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.082072+0000", 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013268700000000001 2024-04-26T07:49:50.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.089206+0000", 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071342580000000001 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096386+0000", 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071801590000000002 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096457+0000", 2024-04-26T07:49:50.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1143999999999995e-05 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096518+0000", 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0346999999999997e-05 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2227 3.3c 3:3cb193a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.879429515, 2024-04-26T07:49:50.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016049378999999999, 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2227 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129892+0000", 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4399999999999996e-06 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134148+0000", 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042560890000000002 2024-04-26T07:49:50.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134185+0000", 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7437000000000001e-05 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134212+0000", 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6503e-05 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134357+0000", 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014499900000000001 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134591+0000", 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023411100000000001 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134802+0000", 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021088899999999999 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.143136+0000", 2024-04-26T07:49:50.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008334335 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145778+0000", 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026417200000000002 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145860+0000", 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2539000000000004e-05 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145936+0000", 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5316999999999997e-05 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2240 3.2 e59/17 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head v 59'1, mlcod=0'0)", 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.7044706280000002, 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016976453999999998, 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304847+0000", 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8300000000000001e-06 2024-04-26T07:49:50.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309042+0000", 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004194634 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309063+0000", 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1067999999999999e-05 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309073+0000", 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9310000000000003e-06 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309178+0000", 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010556399999999999 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309218+0000", 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9693000000000001e-05 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.321671+0000", 2024-04-26T07:49:50.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012453379000000001 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.321822+0000", 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015035499999999999 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.117 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:50.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:49:50.121 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:50.122 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:50.118+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:50.221 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:50.218+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:50.289 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:50.289 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:50.289 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:50.289 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:50.303 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:50.321 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:50.316+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:50.421 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:50.416+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:50.473 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:50.473 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:50.473 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:50.473 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:50.473 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:50.487 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:50.531 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:50.530+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:50.607 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:50.607 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:50.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:50.607 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.047126188999997, 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.608 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:50.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:49:50.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:49:50.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:49:50.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:49:50.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:49:50.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:49:50.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:49:50.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:50.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:49:50.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:49:50.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:49:50.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1243 3.34 e54/17 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head v 54'1, mlcod=0'0)", 2024-04-26T07:49:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.380729957, 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018677787000000001, 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224143+0000", 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7850000000000001e-06 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227226+0000", 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003083293 2024-04-26T07:49:50.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227258+0000", 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2237999999999999e-05 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227273+0000", 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4312e-05 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227395+0000", 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012202200000000001 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227461+0000", 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6217000000000007e-05 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242732+0000", 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015270974 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242819+0000", 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6946000000000004e-05 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2102 3.35 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.358411412000001, 2024-04-26T07:49:50.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025241564000000001, 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2102 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246463+0000", 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.106e-06 2024-04-26T07:49:50.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252299+0000", 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058363080000000001 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252331+0000", 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1914e-05 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252346+0000", 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4829e-05 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252506+0000", 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015995500000000001 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252872+0000", 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000365817 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253249+0000", 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037744100000000001 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271215+0000", 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017965979 2024-04-26T07:49:50.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271568+0000", 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035317600000000002 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271630+0000", 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1853000000000006e-05 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271701+0000", 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1186000000000006e-05 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2109 3.26 3:64cb7bc7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.233393882, 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017368982000000002, 2024-04-26T07:49:50.629 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2109 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371480+0000", 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6800000000000002e-06 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375488+0000", 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040076979999999996 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375515+0000", 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7790999999999999e-05 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375527+0000", 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1705000000000001e-05 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375609+0000", 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1929999999999997e-05 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375757+0000", 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014830400000000001 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375879+0000", 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121169 2024-04-26T07:49:50.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.385948+0000", 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010069567999999999 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388730+0000", 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002781684 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388782+0000", 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1894000000000002e-05 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388846+0000", 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4559000000000003e-05 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.635 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2112 3.26 3:658014ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.188110793, 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022887174, 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2112 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.636 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416763+0000", 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9469999999999999e-06 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422174+0000", 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005410687 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422216+0000", 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1807000000000001e-05 2024-04-26T07:49:50.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422234+0000", 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8706e-05 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422410+0000", 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017526900000000001 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422831+0000", 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042124399999999998 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.423250+0000", 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041928100000000003 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.438715+0000", 2024-04-26T07:49:50.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015465202000000001 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439443+0000", 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00072764499999999996 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439539+0000", 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6173000000000002e-05 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439648+0000", 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108213 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2114 3.10 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:50.642 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.155830024, 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021514529000000001, 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2114 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449044+0000", 2024-04-26T07:49:50.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6369999999999999e-06 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454276+0000", 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052320489999999999 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454310+0000", 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4186000000000001e-05 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454328+0000", 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7977000000000001e-05 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454461+0000", 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013284899999999999 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454722+0000", 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026144500000000002 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454976+0000", 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025349200000000002 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.463666+0000", 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086904649999999996 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470375+0000", 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067091629999999998 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470477+0000", 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101433 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470556+0000", 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8832999999999996e-05 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2144 3.26 3:66326b37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.738462191, 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016531011000000002, 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.649 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2144 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866411+0000", 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.198e-06 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871082+0000", 2024-04-26T07:49:50.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046708499999999998 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871112+0000", 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9558000000000001e-05 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871127+0000", 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5084e-05 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871236+0000", 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109786 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871500+0000", 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000263248 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871737+0000", 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023734900000000001 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882248+0000", 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010511453 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882850+0000", 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00060166699999999996 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882899+0000", 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9144000000000002e-05 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882940+0000", 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0673999999999997e-05 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.655 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2148 3.1e e58/46 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head v 58'3, mlcod=54'1)", 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.6325975570000004, 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018285590000000001, 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972276+0000", 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7930000000000002e-06 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980745+0000", 2024-04-26T07:49:50.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084683919999999999 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980771+0000", 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5911e-05 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980784+0000", 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3241000000000001e-05 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980866+0000", 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2348999999999994e-05 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980891+0000", 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5097e-05 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990494+0000", 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0096024130000000006 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990559+0000", 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5394000000000004e-05 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2157 3.a 3:522571bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.660 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4072120990000005, 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018495228999999998, 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2157 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197662+0000", 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2440000000000002e-06 2024-04-26T07:49:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201962+0000", 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042994369999999997 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201994+0000", 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1850999999999997e-05 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202009+0000", 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5251e-05 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202109+0000", 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100318 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202250+0000", 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014054700000000001 2024-04-26T07:49:50.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202371+0000", 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012143500000000001 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.207294+0000", 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049230929999999999 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216058+0000", 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087642239999999993 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216112+0000", 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3897000000000003e-05 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216154+0000", 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1931999999999998e-05 2024-04-26T07:49:50.666 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2162 3.35 3:ad57cd5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.2837795340000007, 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016822856000000001, 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.667 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2162 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:50.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321094+0000", 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.43e-06 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327241+0000", 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061465360000000002 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327266+0000", 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5922e-05 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327282+0000", 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5603e-05 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327396+0000", 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113418 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327544+0000", 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014825 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327679+0000", 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134905 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337198+0000", 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0095190269999999993 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337818+0000", 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000620737 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337869+0000", 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0893000000000002e-05 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337914+0000", 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5135000000000001e-05 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2171 3.26 3:655b4449:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.1006313779999992, 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016538298, 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.674 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2171 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:50.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504243+0000", 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509432+0000", 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051888860000000002 2024-04-26T07:49:50.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509451+0000", 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9241000000000001e-05 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509464+0000", 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2510999999999999e-05 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509514+0000", 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0083999999999997e-05 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509623+0000", 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109768 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509721+0000", 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7182000000000006e-05 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520340+0000", 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010619358000000001 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520698+0000", 2024-04-26T07:49:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035771499999999999 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520738+0000", 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0623000000000001e-05 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520778+0000", 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9817000000000002e-05 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.680 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2172 3.36 3:6e55231b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.0808816560000007, 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016132018000000001, 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.681 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2172 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523993+0000", 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4070000000000002e-06 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528585+0000", 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00459225 2024-04-26T07:49:50.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528620+0000", 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5073000000000001e-05 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528640+0000", 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9913000000000001e-05 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528743+0000", 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010309100000000001 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528918+0000", 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175203 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.529094+0000", 2024-04-26T07:49:50.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175928 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.539613+0000", 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010518675999999999 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540039+0000", 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042617600000000001 2024-04-26T07:49:50.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540085+0000", 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5367000000000001e-05 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540122+0000", 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6934000000000002e-05 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.687 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2179 3.a 3:50808692:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.9979504349999999, 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018371393999999999, 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2179 2024-04-26T07:49:50.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606923+0000", 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9879999999999999e-06 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612730+0000", 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058072059999999997 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612765+0000", 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5187e-05 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612784+0000", 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8536e-05 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612865+0000", 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1522999999999999e-05 2024-04-26T07:49:50.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612994+0000", 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012873499999999999 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.613100+0000", 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105647 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.618956+0000", 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058564849999999998 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625161+0000", 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062052549999999998 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625237+0000", 2024-04-26T07:49:50.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5364000000000006e-05 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625292+0000", 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5467999999999998e-05 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.694 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2189 3.20 3:05abebd8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.8934134989999993, 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016416799999999999, 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2189 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.695 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711460+0000", 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1390000000000002e-06 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715243+0000", 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00378364 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715266+0000", 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2521e-05 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715276+0000", 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8630000000000003e-06 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715358+0000", 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2520000000000003e-05 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715520+0000", 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161237 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715666+0000", 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014621100000000001 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.721893+0000", 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062276730000000004 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727800+0000", 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059063750000000002 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727841+0000", 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1247e-05 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727874+0000", 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3374000000000003e-05 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2218 3.34 e59/17 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:50.701 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.5691356800000005, 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030663971000000002, 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:50.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035737+0000", 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0869999999999999e-06 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039593+0000", 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038566609999999999 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039642+0000", 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8699999999999998e-05 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7350000000000001e-05 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039870+0000", 2024-04-26T07:49:50.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020093199999999999 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039931+0000", 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1294e-05 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066342+0000", 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026410869 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066399+0000", 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7077999999999998e-05 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2228 3.26 3:64fe9f73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4638474739999996, 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022971215999999999, 2024-04-26T07:49:50.706 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2228 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141027+0000", 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1470000000000001e-06 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145123+0000", 2024-04-26T07:49:50.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040963650000000002 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145151+0000", 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7591999999999999e-05 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145165+0000", 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4381e-05 2024-04-26T07:49:50.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145290+0000", 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012445699999999999 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145588+0000", 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029875499999999999 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145898+0000", 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031002800000000001 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163197+0000", 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017298396000000001 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163680+0000", 2024-04-26T07:49:50.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048320699999999998 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163856+0000", 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017556200000000001 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163995+0000", 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139326 2024-04-26T07:49:50.712 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2230 3.a 3:53d9bc93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4390503999999993, 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019702107, 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.713 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2230 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165823+0000", 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2069999999999998e-06 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169605+0000", 2024-04-26T07:49:50.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037818980000000001 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169633+0000", 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7906999999999999e-05 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169646+0000", 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3132000000000001e-05 2024-04-26T07:49:50.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169796+0000", 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015037699999999999 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.170035+0000", 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238905 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.170260+0000", 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000224551 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184639+0000", 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01437922 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185356+0000", 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000716575 2024-04-26T07:49:50.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185453+0000", 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7188999999999994e-05 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185523+0000", 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0146000000000002e-05 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.719 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2242 3.2c 3:3494587f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.2840121819999997, 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023803956000000001, 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.720 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2242 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320862+0000", 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326077+0000", 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052153720000000002 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326119+0000", 2024-04-26T07:49:50.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1112999999999998e-05 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326139+0000", 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9962999999999998e-05 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326237+0000", 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8110999999999996e-05 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326355+0000", 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011791200000000001 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326459+0000", 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010489600000000001 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338991+0000", 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012531967 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344349+0000", 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053576589999999999 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344529+0000", 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179958 2024-04-26T07:49:50.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344663+0000", 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013385 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2246 3.1e e59/46 3:7a597943:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_135:head v 59'5, mlcod=58'3)", 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:50.726 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.239289994, 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021214457999999999, 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365584+0000", 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.554e-06 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370384+0000", 2024-04-26T07:49:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048000589999999997 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370416+0000", 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370432+0000", 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5553000000000002e-05 2024-04-26T07:49:50.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370552+0000", 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119836 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370593+0000", 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1295999999999999e-05 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.386730+0000", 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016136833999999999 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.386796+0000", 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5747000000000006e-05 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.732 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2248 3.36 3:6c58e6b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:50.732 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:50.732 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.2214946409999996, 2024-04-26T07:49:50.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017638042, 2024-04-26T07:49:50.733 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:50.733 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2248 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383381+0000", 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0999999999999997e-06 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387813+0000", 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004432638 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387857+0000", 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3773000000000003e-05 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387886+0000", 2024-04-26T07:49:50.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8569999999999999e-05 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387994+0000", 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108705 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.388184+0000", 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000189268 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.388342+0000", 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015877900000000001 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398071+0000", 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097290190000000002 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.400936+0000", 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028646679999999999 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.400980+0000", 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3733000000000003e-05 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.401015+0000", 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4789000000000002e-05 2024-04-26T07:49:50.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.740 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.740 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.740 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:50.740 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:50.740 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:50.742 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:50.742 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:50.738+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:50.843 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:50.840+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:50.913 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:50.913 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:50.914 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:50.914 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:50.928 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:50.975 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:50.974+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:51.045 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:51.040+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:51.053 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:51.053 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:51.053 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:51.053 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:51.053 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:51.054 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:49:51.068 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:51.146 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:51.144+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:51.240 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.782002782000006, 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.241 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:51.247 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.496969070999995, 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:51.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.496930238000004, 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.253 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:51.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:49:51.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.496892208000006, 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.259 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:49:51.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:51.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.496770655000006, 2024-04-26T07:49:51.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.496730686000006, 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.270 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:49:51.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:49:51.275 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2103 3.3b 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.979079027000001, 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025234304999999999, 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.276 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2103 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259416+0000", 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6260000000000001e-06 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.265987+0000", 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00657108 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266029+0000", 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1155999999999997e-05 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266055+0000", 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6597e-05 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266194+0000", 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013830200000000001 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266432+0000", 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023884199999999999 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266641+0000", 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020863199999999999 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.279877+0000", 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013236346 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284529+0000", 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046518210000000004 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284593+0000", 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3723e-05 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284647+0000", 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.418e-05 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2108 3.f 3:f0ee051f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:51.281 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.887973364, 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020717233000000002, 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2108 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350520+0000", 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7269999999999999e-06 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358048+0000", 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075278059999999997 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358071+0000", 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3523000000000002e-05 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358083+0000", 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1265e-05 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358172+0000", 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9582999999999999e-05 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358326+0000", 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015335899999999999 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358454+0000", 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0001282 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.364823+0000", 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063690309999999998 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371105+0000", 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062825310000000001 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371167+0000", 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1532999999999995e-05 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371236+0000", 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8675000000000002e-05 2024-04-26T07:49:51.286 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2139 3.e 3:7390af0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.487231048, 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024095845000000001, 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.287 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2139 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751265+0000", 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2729999999999996e-06 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.758971+0000", 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077062930000000003 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759009+0000", 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7429999999999999e-05 2024-04-26T07:49:51.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759027+0000", 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8323000000000001e-05 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759223+0000", 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000196386 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759474+0000", 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250175 2024-04-26T07:49:51.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759705+0000", 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000230998 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.774391+0000", 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014686296999999999 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775046+0000", 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065485499999999998 2024-04-26T07:49:51.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775220+0000", 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017439899999999999 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775357+0000", 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013641599999999999 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.292 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2141 3.e 3:73fc2b27:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.439207929, 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683983999999999, 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2141 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799288+0000", 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-06 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803704+0000", 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044163680000000004 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803745+0000", 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0836e-05 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803764+0000", 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8743e-05 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803912+0000", 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014867299999999999 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804192+0000", 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027982799999999998 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804430+0000", 2024-04-26T07:49:51.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238435 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816451+0000", 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012020507 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819796+0000", 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033448689999999999 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819890+0000", 2024-04-26T07:49:51.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3795999999999994e-05 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819968+0000", 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8208999999999996e-05 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2142 3.15 3:a87525cc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.422108851000001, 2024-04-26T07:49:51.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022647812, 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2142 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816387+0000", 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2560000000000004e-06 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822782+0000", 2024-04-26T07:49:51.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063953079999999997 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822812+0000", 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9876999999999999e-05 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822833+0000", 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1013e-05 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823017+0000", 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018354499999999999 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823252+0000", 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234832 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823515+0000", 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026311800000000001 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.836859+0000", 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01334453 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838722+0000", 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018625650000000001 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838882+0000", 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015986200000000001 2024-04-26T07:49:51.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839031+0000", 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148906 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2150 3.39 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.219405181000001, 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025377047, 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.304 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2150 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019089+0000", 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3590000000000002e-06 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023640+0000", 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045514700000000002 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023666+0000", 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5384e-05 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023680+0000", 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3981999999999999e-05 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023757+0000", 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7249999999999994e-05 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023912+0000", 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015499900000000001 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.024032+0000", 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119628 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.034967+0000", 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010935823000000001 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044357+0000", 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093895449999999991 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044412+0000", 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5359999999999999e-05 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044464+0000", 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1246999999999999e-05 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.309 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2168 3.2d 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.7838733169999994, 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026862164000000001, 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.310 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2168 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454622+0000", 2024-04-26T07:49:51.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459549+0000", 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049275710000000004 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459589+0000", 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9387000000000001e-05 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459609+0000", 2024-04-26T07:49:51.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0392999999999999e-05 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459751+0000", 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014207900000000001 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459996+0000", 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024460500000000001 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.460226+0000", 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023053200000000001 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.469147+0000", 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089203549999999996 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481152+0000", 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012005386999999999 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481352+0000", 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020005199999999999 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481481+0000", 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012850900000000001 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2183 3.37 3:ef675d97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:51.315 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.5893091229999996, 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019732288000000001, 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2183 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649185+0000", 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8200000000000001e-06 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655471+0000", 2024-04-26T07:49:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062857750000000004 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655498+0000", 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7029000000000002e-05 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655509+0000", 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0813e-05 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655609+0000", 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9953999999999999e-05 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655801+0000", 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000192189 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655983+0000", 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018226200000000001 2024-04-26T07:49:51.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668782+0000", 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012798886000000001 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668801+0000", 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377999999999999e-05 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668856+0000", 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5265e-05 2024-04-26T07:49:51.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668915+0000", 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8916999999999999e-05 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2205 3.14 e59/17 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head v 59'3, mlcod=58'1)", 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.3401717509999997, 2024-04-26T07:49:51.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020789596, 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898321+0000", 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6400000000000001e-07 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902172+0000", 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003850787 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902208+0000", 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5952999999999999e-05 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902230+0000", 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1987000000000001e-05 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902392+0000", 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162344 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902418+0000", 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5953e-05 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919038+0000", 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016620234000000001 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919110+0000", 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1474e-05 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2207 3.3f 3:fe080a1d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.3229464130000004, 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021701979999999999, 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2207 2024-04-26T07:49:51.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915549+0000", 2024-04-26T07:49:51.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1200000000000004e-06 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921046+0000", 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054969049999999998 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921067+0000", 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0724e-05 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921079+0000", 2024-04-26T07:49:51.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1533e-05 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921145+0000", 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6662000000000007e-05 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921267+0000", 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121889 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:51.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921388+0000", 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120449 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934035+0000", 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012647818 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937179+0000", 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003143065 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937218+0000", 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9662000000000001e-05 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937247+0000", 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9153e-05 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2213 3.f 3:f1254826:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.2597832180000008, 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021396413, 2024-04-26T07:49:51.331 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2213 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978713+0000", 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982948+0000", 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042354690000000004 2024-04-26T07:49:51.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982982+0000", 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3683000000000003e-05 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983002+0000", 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9599999999999999e-05 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983200+0000", 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000198715 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983466+0000", 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026605500000000001 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983722+0000", 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025512499999999998 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.994151+0000", 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010429528 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999893+0000", 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057413860000000002 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999992+0000", 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9689e-05 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.000105+0000", 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112766 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2217 3.2b e59/17 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.2150339880000001, 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044994659999999999, 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.337 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6300000000000005e-07 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032526+0000", 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090671680000000004 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032570+0000", 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4039000000000003e-05 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032593+0000", 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3873e-05 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032774+0000", 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018014300000000001 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032819+0000", 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5713000000000001e-05 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068399+0000", 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.035580053 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068452+0000", 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3108e-05 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.341 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2219 3.d 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.1988258070000004, 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029242280999999998, 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2219 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4999999999999999e-06 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046427+0000", 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067579299999999997 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046452+0000", 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4341999999999998e-05 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046465+0000", 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3434999999999999e-05 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046565+0000", 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9584000000000001e-05 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046729+0000", 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016413300000000001 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046851+0000", 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012242199999999999 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:51.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068781+0000", 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021930021000000001 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068797+0000", 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6123000000000001e-05 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068862+0000", 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.457e-05 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068908+0000", 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6220999999999997e-05 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2247 3.14 e59/17 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head v 59'5, mlcod=59'3)", 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.8602862079999998, 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019349376000000001, 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:51.347 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378209+0000", 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0929999999999999e-06 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381273+0000", 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00306456 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381314+0000", 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0519000000000003e-05 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381331+0000", 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7547e-05 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381492+0000", 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000160979 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381553+0000", 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0962999999999999e-05 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:51.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397406+0000", 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015853145999999999 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397555+0000", 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014856900000000001 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:51.351 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:51.353 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:51.350+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:51.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:51.453 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:51.448+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:51.488 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:51.488 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:51.488 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:51.488 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:51.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:51.568 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:51.602 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:51.600+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:51.656 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:51.654+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:51.673 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:51.673 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:51.688 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:51.756 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:51.752+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:51.757 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:51.757 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:51.775 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:51.795 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:51.795 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:51.812 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:51.813 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:51.824 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:51.825 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:51.833 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:51.833 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:51.840 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:51.855 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:51.855 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:51.857 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:51.852+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:51.876 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:51.898 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:51.958 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:51.956+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:51.981 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:51.982 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:51.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:52.082 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:52.080+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:52.161 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:52.156+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:52.164 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:52.164 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:52.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:52.262 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:52.258+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:52.276 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T07:49:52.276 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T07:49:52.352 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:52.352 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:52.364 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:52.362+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:52.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:52.465 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:52.462+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:52.486 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:52.487 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:52.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:52.566 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:52.559+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:52.621 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:52.621 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:52.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:52.678 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:52.675+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:52.768 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:52.763+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:52.805 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:52.805 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:52.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:52.869 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:52.870+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:52.970 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:52.966+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:52.991 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:52.991 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:53.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:53.071 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:53.067+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:53.083 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:49:53.131 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:53.131 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:53.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:53.172 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:53.170+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:53.271 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:53.271 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:53.273 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:53.267+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:53.287 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:53.374 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:53.367+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:53.418 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:53.418 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:53.433 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:53.440 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:49:53.479 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:53.478+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:53.566 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:53.566 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:53.582 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:53.621 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:53.571+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:53.677 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:53.671+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:53.748 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:53.748 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:53.763 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:53.778 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:53.771+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:53.879 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:53.875+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:53.882 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:53.882 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:53.896 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:53.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:53.980 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:53.978+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:54.019 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:54.019 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:54.034 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:54.075 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:54.076 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:54.081 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:54.075+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:54.092 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:54.092 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:54.109 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:54.110 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:54.127 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:54.127 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:54.147 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:54.147 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:54.166 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:54.166 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:54.182 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:54.175+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:54.185 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:54.185 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:54.203 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:54.203 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:54.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:54.204 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:54.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.204 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1246 3.2f 3:f6e96107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:49:54.204 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:54.204 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.954066346000001, 2024-04-26T07:49:54.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023540999999999999, 2024-04-26T07:49:54.205 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.205 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.205 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.205 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.206 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.206 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.206 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1246 2024-04-26T07:49:54.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.206 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:54.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247044+0000", 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.247046+0000", 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9270000000000001e-06 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252338+0000", 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052911449999999997 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252378+0000", 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0299999999999997e-05 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252396+0000", 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8600000000000001e-05 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252475+0000", 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8669000000000002e-05 2024-04-26T07:49:54.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252592+0000", 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011717 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.252971+0000", 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037877499999999998 2024-04-26T07:49:54.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.262239+0000", 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092677920000000004 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270496+0000", 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082573809999999994 2024-04-26T07:49:54.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270545+0000", 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8627e-05 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.270585+0000", 2024-04-26T07:49:54.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9613999999999997e-05 2024-04-26T07:49:54.214 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.214 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.214 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.214 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2102 3.35 e58/17 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:54.214 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:54.214 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.947586286, 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017395158000000001, 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:54.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253524+0000", 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253526+0000", 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.903e-06 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258558+0000", 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050312769999999998 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258594+0000", 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6353999999999998e-05 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258617+0000", 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2785999999999998e-05 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258737+0000", 2024-04-26T07:49:54.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011977999999999999 2024-04-26T07:49:54.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.258763+0000", 2024-04-26T07:49:54.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6088000000000002e-05 2024-04-26T07:49:54.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.270840+0000", 2024-04-26T07:49:54.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012077277000000001 2024-04-26T07:49:54.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.270919+0000", 2024-04-26T07:49:54.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8693e-05 2024-04-26T07:49:54.222 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.222 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.222 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.223 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2111 3.30 3:0ee8838f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.223 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:54.223 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.807259128, 2024-04-26T07:49:54.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021248963999999999, 2024-04-26T07:49:54.223 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.223 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.224 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.224 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.224 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.224 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.224 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2111 2024-04-26T07:49:54.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.225 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:54.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393851+0000", 2024-04-26T07:49:54.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.393853+0000", 2024-04-26T07:49:54.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3640000000000002e-06 2024-04-26T07:49:54.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399704+0000", 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058506870000000002 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399732+0000", 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8309e-05 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399747+0000", 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5356999999999999e-05 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.399899+0000", 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015193300000000001 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.400153+0000", 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025378500000000002 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.400381+0000", 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022828200000000001 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.413732+0000", 2024-04-26T07:49:54.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013351059 2024-04-26T07:49:54.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.414922+0000", 2024-04-26T07:49:54.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001189322 2024-04-26T07:49:54.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.415012+0000", 2024-04-26T07:49:54.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0210000000000005e-05 2024-04-26T07:49:54.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.415100+0000", 2024-04-26T07:49:54.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7656000000000002e-05 2024-04-26T07:49:54.233 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.233 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.233 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.233 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2122 3.c 3:33f873c3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.233 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:54.234 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.595362286, 2024-04-26T07:49:54.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022871248, 2024-04-26T07:49:54.234 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.234 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.234 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.234 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.234 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2122 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605748+0000", 2024-04-26T07:49:54.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.605750+0000", 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6129999999999998e-06 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611353+0000", 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0056032139999999996 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611382+0000", 2024-04-26T07:49:54.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8583000000000001e-05 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611396+0000", 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4517e-05 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611510+0000", 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011364199999999999 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611637+0000", 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012689799999999999 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.611750+0000", 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011253500000000001 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.617831+0000", 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006081319 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628524+0000", 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010693513 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628578+0000", 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3980999999999997e-05 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.628619+0000", 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0432999999999997e-05 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2125 3.17 e58/17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.540684718, 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017323336000000002, 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.240 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660425+0000", 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.660428+0000", 2024-04-26T07:49:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666876+0000", 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064477750000000002 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666918+0000", 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2512999999999998e-05 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.666940+0000", 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2223000000000001e-05 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.667111+0000", 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170509 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.667173+0000", 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2266000000000003e-05 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.677671+0000", 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010497833999999999 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.677748+0000", 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7405999999999997e-05 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.244 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2140 3.c 3:30bbfb90:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.425579462, 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018799924999999999, 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2140 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775530+0000", 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775533+0000", 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:49:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780479+0000", 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049457379999999999 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780517+0000", 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8046999999999997e-05 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780535+0000", 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8332999999999999e-05 2024-04-26T07:49:54.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780700+0000", 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016463599999999999 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.780955+0000", 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025536800000000001 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.781190+0000", 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023499099999999999 2024-04-26T07:49:54.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.791429+0000", 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010238466999999999 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794125+0000", 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026960090000000001 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794221+0000", 2024-04-26T07:49:54.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6099000000000003e-05 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.794330+0000", 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109347 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2146 3.38 e58/17 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.280268188999999, 2024-04-26T07:49:54.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015464832, 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920842+0000", 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.920844+0000", 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927172+0000", 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063278589999999999 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927209+0000", 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6912999999999997e-05 2024-04-26T07:49:54.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927226+0000", 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7479e-05 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927361+0000", 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013498300000000001 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.927423+0000", 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2076000000000007e-05 2024-04-26T07:49:54.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.936218+0000", 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087948760000000001 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.936306+0000", 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8152999999999994e-05 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2152 3.21 e58/17 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.128656356, 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015640588, 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072453+0000", 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.072456+0000", 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1629999999999999e-06 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080207+0000", 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007750903 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080238+0000", 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1207000000000001e-05 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080254+0000", 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6283e-05 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080379+0000", 2024-04-26T07:49:54.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000125341 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.080410+0000", 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0861000000000001e-05 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.087981+0000", 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007570327 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.088094+0000", 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113503 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2163 3.2f 3:f4a8dc53:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.856184408000001, 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017273949, 2024-04-26T07:49:54.259 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2163 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344925+0000", 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.344927+0000", 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6419999999999999e-06 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349163+0000", 2024-04-26T07:49:54.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042360430000000001 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349182+0000", 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8966000000000001e-05 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349192+0000", 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8800000000000003e-06 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349266+0000", 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4085000000000006e-05 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349448+0000", 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018166999999999999 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.349615+0000", 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016686000000000001 2024-04-26T07:49:54.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.359728+0000", 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010113837000000001 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362078+0000", 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002349851 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362133+0000", 2024-04-26T07:49:54.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4255000000000001e-05 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.362199+0000", 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6859999999999993e-05 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2166 3.c 3:3335ddb9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.777790735, 2024-04-26T07:49:54.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021989392, 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2166 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423319+0000", 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.423323+0000", 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.456e-06 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427512+0000", 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004189033 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427550+0000", 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427570+0000", 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9397000000000001e-05 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427705+0000", 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013559600000000001 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.427969+0000", 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026350100000000002 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.428208+0000", 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023929499999999999 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.436946+0000", 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087374299999999992 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445128+0000", 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081818789999999995 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445231+0000", 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000103393 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.445309+0000", 2024-04-26T07:49:54.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7539000000000004e-05 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2175 3.5 3:a0e00f63:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.63969427, 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016086005, 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.271 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2175 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561416+0000", 2024-04-26T07:49:54.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.561419+0000", 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7969999999999998e-06 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565707+0000", 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042876809999999998 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565748+0000", 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1117e-05 2024-04-26T07:49:54.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565768+0000", 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9432999999999998e-05 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.565883+0000", 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011505099999999999 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.566079+0000", 2024-04-26T07:49:54.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019624 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.566256+0000", 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000177539 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.575155+0000", 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0088989489999999997 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577394+0000", 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002238589 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577449+0000", 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5090999999999998e-05 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.577502+0000", 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2518000000000001e-05 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2191 3.16 3:6a379d34:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.464125418, 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018754256, 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2191 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736984+0000", 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.736987+0000", 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0280000000000001e-06 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740891+0000", 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039036959999999999 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740913+0000", 2024-04-26T07:49:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1472999999999999e-05 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740924+0000", 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1041e-05 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.740993+0000", 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8868999999999994e-05 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.741106+0000", 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113235 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.741201+0000", 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4956000000000004e-05 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.750323+0000", 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0091222409999999997 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755659+0000", 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053355579999999998 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755703+0000", 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4836000000000002e-05 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.755739+0000", 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5323e-05 2024-04-26T07:49:54.282 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2198 3.2f 3:f6b82421:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.387034484000001, 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017684153000000001, 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2198 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814075+0000", 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.814078+0000", 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0750000000000002e-06 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817877+0000", 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003798624 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817907+0000", 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0369e-05 2024-04-26T07:49:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.817921+0000", 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3284e-05 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818041+0000", 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119912 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818263+0000", 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022216299999999999 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.818466+0000", 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000203069 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.823916+0000", 2024-04-26T07:49:54.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054501910000000001 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831677+0000", 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077611299999999998 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831722+0000", 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4496000000000002e-05 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.831760+0000", 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7839999999999997e-05 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2201 3.30 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.356602862000001, 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683907000000001, 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.289 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2201 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844507+0000", 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.844511+0000", 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1400000000000002e-06 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848873+0000", 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043614509999999997 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848913+0000", 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9969999999999998e-05 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.848930+0000", 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7935999999999999e-05 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849037+0000", 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106019 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849178+0000", 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014120699999999999 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.849294+0000", 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000116239 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.855959+0000", 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0066650490000000001 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865098+0000", 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0091388460000000008 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865150+0000", 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1993000000000002e-05 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.865191+0000", 2024-04-26T07:49:54.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1056999999999997e-05 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2204 3.5 3:a294f995:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.319119685, 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.03032317, 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.295 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2204 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881994+0000", 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6330000000000002e-06 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888238+0000", 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062439069999999999 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888280+0000", 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2231999999999998e-05 2024-04-26T07:49:54.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888305+0000", 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5060000000000001e-05 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888469+0000", 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016422499999999999 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888479+0000", 2024-04-26T07:49:54.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.008e-05 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.894701+0000", 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062219969999999999 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895063+0000", 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036214800000000002 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895429+0000", 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036549400000000001 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.909795+0000", 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014366191 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912173+0000", 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023778330000000002 2024-04-26T07:49:54.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912250+0000", 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6736000000000005e-05 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912313+0000", 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633999999999994e-05 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.302 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2206 3.16 3:6a8f0fb0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:54.302 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:54.302 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.295210853, 2024-04-26T07:49:54.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028443779999999998, 2024-04-26T07:49:54.302 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.302 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.302 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.302 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2206 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:54.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905902+0000", 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9059999999999998e-06 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910333+0000", 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044310299999999999 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910358+0000", 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4683000000000001e-05 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910373+0000", 2024-04-26T07:49:54.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5003e-05 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910466+0000", 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3051000000000001e-05 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910844+0000", 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037795800000000002 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.911110+0000", 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000266681 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.924934+0000", 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013823287 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.933975+0000", 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090409510000000002 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934161+0000", 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186276 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934343+0000", 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018195400000000001 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2219 3.d e59/17 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:54.308 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.154106676, 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021609369999999999, 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047003+0000", 2024-04-26T07:49:54.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.047006+0000", 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7389999999999999e-06 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049788+0000", 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0027819839999999999 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049813+0000", 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5315000000000001e-05 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049826+0000", 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3098999999999999e-05 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049911+0000", 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5129000000000004e-05 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.049936+0000", 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4689999999999999e-05 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068538+0000", 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018601592 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068613+0000", 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4821999999999996e-05 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.312 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2222 3.22 3:453f4002:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.123318818, 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018726578000000001, 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.313 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2222 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077791+0000", 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.077794+0000", 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5009999999999999e-06 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081660+0000", 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038662480000000001 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081685+0000", 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5273e-05 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081696+0000", 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1294000000000001e-05 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081793+0000", 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6775999999999996e-05 2024-04-26T07:49:54.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.081939+0000", 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014589099999999999 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.082072+0000", 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013268700000000001 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.089206+0000", 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071342580000000001 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096386+0000", 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071801590000000002 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096457+0000", 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1143999999999995e-05 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.096518+0000", 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0346999999999997e-05 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.319 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2227 3.3c 3:3cb193a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.071223417000001, 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016049378999999999, 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2227 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129886+0000", 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.129892+0000", 2024-04-26T07:49:54.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4399999999999996e-06 2024-04-26T07:49:54.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134148+0000", 2024-04-26T07:49:54.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042560890000000002 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134185+0000", 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7437000000000001e-05 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134212+0000", 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6503e-05 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134357+0000", 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014499900000000001 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134591+0000", 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023411100000000001 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.134802+0000", 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021088899999999999 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.143136+0000", 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008334335 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145778+0000", 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0026417200000000002 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145860+0000", 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2539000000000004e-05 2024-04-26T07:49:54.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145936+0000", 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5316999999999997e-05 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2240 3.2 e59/17 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head v 59'1, mlcod=0'0)", 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.89626453, 2024-04-26T07:49:54.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016976453999999998, 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304845+0000", 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.304847+0000", 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8300000000000001e-06 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309042+0000", 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004194634 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309063+0000", 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1067999999999999e-05 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309073+0000", 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9310000000000003e-06 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309178+0000", 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010556399999999999 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.309218+0000", 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9693000000000001e-05 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.321671+0000", 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012453379000000001 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.321822+0000", 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015035499999999999 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.330 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.331 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.331 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.331 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:54.332 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:54.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:54.333 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:54.334 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:54.327+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:54.434 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:54.431+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:54.461 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:54.461 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:54.461 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:54.461 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:54.476 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:54.534 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:54.530+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:54.599 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:54.599 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:54.599 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:54.600 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:54.600 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:54.613 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:54.656 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:54.654+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:54.736 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:54.734+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:54.779 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:54.779 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:54.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:54.779 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.219232538, 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:49:54.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:49:54.786 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1243 3.34 e54/17 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head v 54'1, mlcod=0'0)", 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.552836306, 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018677787000000001, 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224143+0000", 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7850000000000001e-06 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227226+0000", 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003083293 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227258+0000", 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2237999999999999e-05 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227273+0000", 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4312e-05 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227395+0000", 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012202200000000001 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227461+0000", 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6217000000000007e-05 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242732+0000", 2024-04-26T07:49:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015270974 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242819+0000", 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6946000000000004e-05 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2102 3.35 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.530517761, 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025241564000000001, 2024-04-26T07:49:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2102 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246463+0000", 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.106e-06 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252299+0000", 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058363080000000001 2024-04-26T07:49:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252331+0000", 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1914e-05 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252346+0000", 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4829e-05 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252506+0000", 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015995500000000001 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252872+0000", 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000365817 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253249+0000", 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037744100000000001 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271215+0000", 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017965979 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271568+0000", 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035317600000000002 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271630+0000", 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1853000000000006e-05 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271701+0000", 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1186000000000006e-05 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2109 3.26 3:64cb7bc7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.405500231, 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017368982000000002, 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2109 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371480+0000", 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6800000000000002e-06 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375488+0000", 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040076979999999996 2024-04-26T07:49:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375515+0000", 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7790999999999999e-05 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375527+0000", 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1705000000000001e-05 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375609+0000", 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1929999999999997e-05 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375757+0000", 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014830400000000001 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375879+0000", 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121169 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.385948+0000", 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010069567999999999 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388730+0000", 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002781684 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388782+0000", 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1894000000000002e-05 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388846+0000", 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4559000000000003e-05 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2112 3.26 3:658014ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.360217142, 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022887174, 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2112 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416763+0000", 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9469999999999999e-06 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422174+0000", 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005410687 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422216+0000", 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1807000000000001e-05 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422234+0000", 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8706e-05 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422410+0000", 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017526900000000001 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422831+0000", 2024-04-26T07:49:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042124399999999998 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.423250+0000", 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041928100000000003 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.438715+0000", 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015465202000000001 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439443+0000", 2024-04-26T07:49:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00072764499999999996 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439539+0000", 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6173000000000002e-05 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439648+0000", 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108213 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2114 3.10 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.327936373, 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021514529000000001, 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2114 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449044+0000", 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6369999999999999e-06 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454276+0000", 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052320489999999999 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454310+0000", 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4186000000000001e-05 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454328+0000", 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7977000000000001e-05 2024-04-26T07:49:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454461+0000", 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013284899999999999 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454722+0000", 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026144500000000002 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454976+0000", 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025349200000000002 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.463666+0000", 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086904649999999996 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470375+0000", 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067091629999999998 2024-04-26T07:49:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470477+0000", 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101433 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470556+0000", 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8832999999999996e-05 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2144 3.26 3:66326b37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.91056854, 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016531011000000002, 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2144 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866411+0000", 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.198e-06 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871082+0000", 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046708499999999998 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871112+0000", 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9558000000000001e-05 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871127+0000", 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5084e-05 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871236+0000", 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109786 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871500+0000", 2024-04-26T07:49:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000263248 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871737+0000", 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023734900000000001 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882248+0000", 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010511453 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882850+0000", 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00060166699999999996 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882899+0000", 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9144000000000002e-05 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882940+0000", 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0673999999999997e-05 2024-04-26T07:49:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2148 3.1e e58/46 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head v 58'3, mlcod=54'1)", 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.804703906, 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018285590000000001, 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972276+0000", 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7930000000000002e-06 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980745+0000", 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084683919999999999 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980771+0000", 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5911e-05 2024-04-26T07:49:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980784+0000", 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3241000000000001e-05 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980866+0000", 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2348999999999994e-05 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980891+0000", 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5097e-05 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990494+0000", 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0096024130000000006 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990559+0000", 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5394000000000004e-05 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2157 3.a 3:522571bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.579318448, 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018495228999999998, 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2157 2024-04-26T07:49:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197662+0000", 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2440000000000002e-06 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201962+0000", 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042994369999999997 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201994+0000", 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1850999999999997e-05 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202009+0000", 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5251e-05 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202109+0000", 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100318 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202250+0000", 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014054700000000001 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202371+0000", 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012143500000000001 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.207294+0000", 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049230929999999999 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216058+0000", 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087642239999999993 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216112+0000", 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3897000000000003e-05 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216154+0000", 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1931999999999998e-05 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2162 3.35 3:ad57cd5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.455885883000001, 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016822856000000001, 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2162 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321094+0000", 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.43e-06 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327241+0000", 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061465360000000002 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327266+0000", 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5922e-05 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327282+0000", 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5603e-05 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327396+0000", 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113418 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327544+0000", 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014825 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327679+0000", 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134905 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337198+0000", 2024-04-26T07:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0095190269999999993 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337818+0000", 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000620737 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337869+0000", 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0893000000000002e-05 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337914+0000", 2024-04-26T07:49:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5135000000000001e-05 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2171 3.26 3:655b4449:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.272737726999999, 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016538298, 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2171 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504243+0000", 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509432+0000", 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051888860000000002 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509451+0000", 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9241000000000001e-05 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509464+0000", 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2510999999999999e-05 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509514+0000", 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0083999999999997e-05 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509623+0000", 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109768 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509721+0000", 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7182000000000006e-05 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520340+0000", 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010619358000000001 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520698+0000", 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035771499999999999 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520738+0000", 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0623000000000001e-05 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520778+0000", 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9817000000000002e-05 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2172 3.36 3:6e55231b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.252988005000001, 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016132018000000001, 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2172 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523993+0000", 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4070000000000002e-06 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528585+0000", 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00459225 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528620+0000", 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5073000000000001e-05 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528640+0000", 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9913000000000001e-05 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528743+0000", 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010309100000000001 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528918+0000", 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175203 2024-04-26T07:49:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.529094+0000", 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175928 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.539613+0000", 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010518675999999999 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540039+0000", 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042617600000000001 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540085+0000", 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5367000000000001e-05 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540122+0000", 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6934000000000002e-05 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2179 3.a 3:50808692:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.170056784, 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018371393999999999, 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2179 2024-04-26T07:49:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606923+0000", 2024-04-26T07:49:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9879999999999999e-06 2024-04-26T07:49:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612730+0000", 2024-04-26T07:49:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058072059999999997 2024-04-26T07:49:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612765+0000", 2024-04-26T07:49:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5187e-05 2024-04-26T07:49:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612784+0000", 2024-04-26T07:49:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8536e-05 2024-04-26T07:49:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612865+0000", 2024-04-26T07:49:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1522999999999999e-05 2024-04-26T07:49:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612994+0000", 2024-04-26T07:49:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012873499999999999 2024-04-26T07:49:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.613100+0000", 2024-04-26T07:49:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105647 2024-04-26T07:49:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.618956+0000", 2024-04-26T07:49:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058564849999999998 2024-04-26T07:49:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625161+0000", 2024-04-26T07:49:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062052549999999998 2024-04-26T07:49:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625237+0000", 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5364000000000006e-05 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625292+0000", 2024-04-26T07:49:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5467999999999998e-05 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2189 3.20 3:05abebd8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.065519847999999, 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016416799999999999, 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2189 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711460+0000", 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1390000000000002e-06 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715243+0000", 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00378364 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715266+0000", 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2521e-05 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715276+0000", 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8630000000000003e-06 2024-04-26T07:49:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715358+0000", 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2520000000000003e-05 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715520+0000", 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161237 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715666+0000", 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014621100000000001 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.721893+0000", 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062276730000000004 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727800+0000", 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059063750000000002 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727841+0000", 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1247e-05 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727874+0000", 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3374000000000003e-05 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2218 3.34 e59/17 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.741242029, 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030663971000000002, 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035737+0000", 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0869999999999999e-06 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039593+0000", 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038566609999999999 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039642+0000", 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8699999999999998e-05 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7350000000000001e-05 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039870+0000", 2024-04-26T07:49:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020093199999999999 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039931+0000", 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1294e-05 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066342+0000", 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026410869 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066399+0000", 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7077999999999998e-05 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2228 3.26 3:64fe9f73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.635953822999999, 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022971215999999999, 2024-04-26T07:49:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2228 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141027+0000", 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1470000000000001e-06 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145123+0000", 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040963650000000002 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145151+0000", 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7591999999999999e-05 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145165+0000", 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4381e-05 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145290+0000", 2024-04-26T07:49:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012445699999999999 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145588+0000", 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029875499999999999 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145898+0000", 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031002800000000001 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163197+0000", 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017298396000000001 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163680+0000", 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048320699999999998 2024-04-26T07:49:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163856+0000", 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017556200000000001 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163995+0000", 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139326 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2230 3.a 3:53d9bc93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.611156748999999, 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019702107, 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2230 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165823+0000", 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2069999999999998e-06 2024-04-26T07:49:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169605+0000", 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037818980000000001 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169633+0000", 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7906999999999999e-05 2024-04-26T07:49:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169646+0000", 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3132000000000001e-05 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169796+0000", 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015037699999999999 2024-04-26T07:49:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.170035+0000", 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238905 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.170260+0000", 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000224551 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184639+0000", 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01437922 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185356+0000", 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000716575 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185453+0000", 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7188999999999994e-05 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185523+0000", 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0146000000000002e-05 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2242 3.2c 3:3494587f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.456118531, 2024-04-26T07:49:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023803956000000001, 2024-04-26T07:49:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2242 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320862+0000", 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326077+0000", 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052153720000000002 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326119+0000", 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1112999999999998e-05 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326139+0000", 2024-04-26T07:49:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9962999999999998e-05 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326237+0000", 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8110999999999996e-05 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326355+0000", 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011791200000000001 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326459+0000", 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010489600000000001 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338991+0000", 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012531967 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344349+0000", 2024-04-26T07:49:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053576589999999999 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344529+0000", 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179958 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344663+0000", 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013385 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2246 3.1e e59/46 3:7a597943:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_135:head v 59'5, mlcod=58'3)", 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.411396343, 2024-04-26T07:49:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021214457999999999, 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365584+0000", 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.554e-06 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370384+0000", 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048000589999999997 2024-04-26T07:49:54.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370416+0000", 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370432+0000", 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5553000000000002e-05 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370552+0000", 2024-04-26T07:49:54.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119836 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370593+0000", 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1295999999999999e-05 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.386730+0000", 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016136833999999999 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.386796+0000", 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5747000000000006e-05 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2248 3.36 3:6c58e6b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:54.904 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.393600989999999, 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017638042, 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2248 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:54.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383381+0000", 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0999999999999997e-06 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387813+0000", 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004432638 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387857+0000", 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3773000000000003e-05 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387886+0000", 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8569999999999999e-05 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387994+0000", 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108705 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.388184+0000", 2024-04-26T07:49:54.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000189268 2024-04-26T07:49:54.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:54.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.388342+0000", 2024-04-26T07:49:54.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015877900000000001 2024-04-26T07:49:54.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398071+0000", 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097290190000000002 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.400936+0000", 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028646679999999999 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.400980+0000", 2024-04-26T07:49:54.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3733000000000003e-05 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.401015+0000", 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4789000000000002e-05 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:54.911 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:54.912 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:54.913 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:54.914 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:54.911+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:55.015 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:55.010+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:55.084 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:55.084 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:55.084 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:55.084 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:55.099 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:55.143 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:55.142+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:55.216 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:55.214+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:55.267 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:55.267 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:55.267 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:55.267 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:55.268 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:55.282 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:55.323 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:55.322+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:55.418 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:55.414+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:55.452 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:55.452 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:55.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:55.452 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:55.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.452 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.993426690000007, 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:49:55.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:49:55.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:49:55.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708392978999996, 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.459 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:55.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.464 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708354146000005, 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:49:55.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:49:55.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:49:55.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.470 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708316116000006, 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:55.471 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:49:55.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:49:55.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708194563000006, 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:49:55.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:49:55.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:55.482 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708154594000007, 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:49:55.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2103 3.3b 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.190502935, 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025234304999999999, 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.488 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2103 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259416+0000", 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6260000000000001e-06 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.265987+0000", 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00657108 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266029+0000", 2024-04-26T07:49:55.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1155999999999997e-05 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266055+0000", 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6597e-05 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266194+0000", 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013830200000000001 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266432+0000", 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023884199999999999 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266641+0000", 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020863199999999999 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.279877+0000", 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013236346 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284529+0000", 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046518210000000004 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284593+0000", 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3723e-05 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284647+0000", 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.418e-05 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.493 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2108 3.f 3:f0ee051f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.099397271999999, 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020717233000000002, 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.494 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2108 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350520+0000", 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7269999999999999e-06 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358048+0000", 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075278059999999997 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358071+0000", 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3523000000000002e-05 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358083+0000", 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1265e-05 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358172+0000", 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9582999999999999e-05 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358326+0000", 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015335899999999999 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358454+0000", 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0001282 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.364823+0000", 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063690309999999998 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371105+0000", 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062825310000000001 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371167+0000", 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1532999999999995e-05 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371236+0000", 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8675000000000002e-05 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2139 3.e 3:7390af0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.698654956, 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024095845000000001, 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2139 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751265+0000", 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2729999999999996e-06 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.758971+0000", 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077062930000000003 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759009+0000", 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7429999999999999e-05 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759027+0000", 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8323000000000001e-05 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759223+0000", 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000196386 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759474+0000", 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250175 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759705+0000", 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000230998 2024-04-26T07:49:55.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.774391+0000", 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014686296999999999 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775046+0000", 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065485499999999998 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775220+0000", 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017439899999999999 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775357+0000", 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013641599999999999 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2141 3.e 3:73fc2b27:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.650631837000001, 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683983999999999, 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.505 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2141 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799288+0000", 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-06 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803704+0000", 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044163680000000004 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803745+0000", 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0836e-05 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803764+0000", 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8743e-05 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803912+0000", 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014867299999999999 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804192+0000", 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027982799999999998 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804430+0000", 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238435 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816451+0000", 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012020507 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819796+0000", 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033448689999999999 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819890+0000", 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3795999999999994e-05 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819968+0000", 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8208999999999996e-05 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.510 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2142 3.15 3:a87525cc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.633532759, 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022647812, 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.511 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2142 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816387+0000", 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2560000000000004e-06 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822782+0000", 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063953079999999997 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822812+0000", 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9876999999999999e-05 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822833+0000", 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1013e-05 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823017+0000", 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018354499999999999 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823252+0000", 2024-04-26T07:49:55.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234832 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823515+0000", 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026311800000000001 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.836859+0000", 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01334453 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838722+0000", 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018625650000000001 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838882+0000", 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015986200000000001 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839031+0000", 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148906 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.516 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2150 3.39 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.430829088999999, 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025377047, 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2150 2024-04-26T07:49:55.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019089+0000", 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3590000000000002e-06 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023640+0000", 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045514700000000002 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023666+0000", 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5384e-05 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023680+0000", 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3981999999999999e-05 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023757+0000", 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7249999999999994e-05 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023912+0000", 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015499900000000001 2024-04-26T07:49:55.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.024032+0000", 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119628 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.034967+0000", 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010935823000000001 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044357+0000", 2024-04-26T07:49:55.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093895449999999991 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044412+0000", 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5359999999999999e-05 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044464+0000", 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1246999999999999e-05 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2168 3.2d 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.995297225, 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026862164000000001, 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2168 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.523 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454622+0000", 2024-04-26T07:49:55.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459549+0000", 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049275710000000004 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459589+0000", 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9387000000000001e-05 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459609+0000", 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0392999999999999e-05 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459751+0000", 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014207900000000001 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459996+0000", 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024460500000000001 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.460226+0000", 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023053200000000001 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.469147+0000", 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089203549999999996 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481152+0000", 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012005386999999999 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481352+0000", 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020005199999999999 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481481+0000", 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012850900000000001 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.528 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2183 3.37 3:ef675d97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.800733031, 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019732288000000001, 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2183 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649185+0000", 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8200000000000001e-06 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655471+0000", 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062857750000000004 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655498+0000", 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7029000000000002e-05 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655509+0000", 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0813e-05 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655609+0000", 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9953999999999999e-05 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655801+0000", 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000192189 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655983+0000", 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018226200000000001 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668782+0000", 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012798886000000001 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668801+0000", 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377999999999999e-05 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668856+0000", 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5265e-05 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668915+0000", 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8916999999999999e-05 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2205 3.14 e59/17 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head v 59'3, mlcod=58'1)", 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.551595659, 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020789596, 2024-04-26T07:49:55.534 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898321+0000", 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6400000000000001e-07 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902172+0000", 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003850787 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902208+0000", 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5952999999999999e-05 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902230+0000", 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1987000000000001e-05 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902392+0000", 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162344 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902418+0000", 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5953e-05 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919038+0000", 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016620234000000001 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919110+0000", 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1474e-05 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2207 3.3f 3:fe080a1d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:55.538 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.534370321000001, 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021701979999999999, 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2207 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915549+0000", 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1200000000000004e-06 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921046+0000", 2024-04-26T07:49:55.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054969049999999998 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921067+0000", 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0724e-05 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921079+0000", 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1533e-05 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921145+0000", 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6662000000000007e-05 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921267+0000", 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121889 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921388+0000", 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120449 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934035+0000", 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012647818 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937179+0000", 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003143065 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937218+0000", 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9662000000000001e-05 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937247+0000", 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9153e-05 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2213 3.f 3:f1254826:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.471207125999999, 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021396413, 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.544 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2213 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978713+0000", 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982948+0000", 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042354690000000004 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982982+0000", 2024-04-26T07:49:55.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3683000000000003e-05 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983002+0000", 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9599999999999999e-05 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983200+0000", 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000198715 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983466+0000", 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026605500000000001 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983722+0000", 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025512499999999998 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.994151+0000", 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010429528 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999893+0000", 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057413860000000002 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999992+0000", 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9689e-05 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.000105+0000", 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112766 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.549 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2217 3.2b e59/17 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.426457896000001, 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044994659999999999, 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6300000000000005e-07 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032526+0000", 2024-04-26T07:49:55.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090671680000000004 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032570+0000", 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4039000000000003e-05 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032593+0000", 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3873e-05 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032774+0000", 2024-04-26T07:49:55.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018014300000000001 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032819+0000", 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5713000000000001e-05 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068399+0000", 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.035580053 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068452+0000", 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3108e-05 2024-04-26T07:49:55.553 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2219 3.d 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.410249715000001, 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029242280999999998, 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:55.554 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2219 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4999999999999999e-06 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046427+0000", 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067579299999999997 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046452+0000", 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4341999999999998e-05 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046465+0000", 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3434999999999999e-05 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046565+0000", 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9584000000000001e-05 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046729+0000", 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016413300000000001 2024-04-26T07:49:55.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046851+0000", 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012242199999999999 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068781+0000", 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021930021000000001 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068797+0000", 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6123000000000001e-05 2024-04-26T07:49:55.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068862+0000", 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.457e-05 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068908+0000", 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6220999999999997e-05 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2247 3.14 e59/17 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head v 59'5, mlcod=59'3)", 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.071710116, 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019349376000000001, 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378209+0000", 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0929999999999999e-06 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381273+0000", 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00306456 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:55.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381314+0000", 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0519000000000003e-05 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381331+0000", 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7547e-05 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381492+0000", 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000160979 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381553+0000", 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0962999999999999e-05 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397406+0000", 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015853145999999999 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397555+0000", 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014856900000000001 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.563 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.564 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.564 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:55.564 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:55.564 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:55.564 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:49:55.566 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:55.562+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:55.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:55.667 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:55.666+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:55.701 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:55.701 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:55.701 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:55.701 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:55.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:49:55.768 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:55.766+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:55.836 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:55.836 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:55.836 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:55.836 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:55.836 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:55.851 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:49:55.869 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:55.866+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:55.970 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:55.963+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:55.980 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1113 3.6 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.711563384000002, 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015424972, 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1113 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266304+0000", 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6060000000000001e-06 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270480+0000", 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041759689999999999 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270523+0000", 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2908000000000003e-05 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270541+0000", 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8790000000000001e-05 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270636+0000", 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4690000000000003e-05 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270821+0000", 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018512100000000001 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271288+0000", 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046690099999999998 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.280701+0000", 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0094125839999999999 2024-04-26T07:49:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281610+0000", 2024-04-26T07:49:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090926400000000001 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281676+0000", 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5809999999999995e-05 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281726+0000", 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0328999999999999e-05 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2110 3.23 3:c664601d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 15.595561908000001, 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017472562000000001, 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2110 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382305+0000", 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6630000000000002e-06 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.384976+0000", 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026707620000000001 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385010+0000", 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.358e-05 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385026+0000", 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6487999999999999e-05 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385180+0000", 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153609 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385551+0000", 2024-04-26T07:49:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000370971 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385906+0000", 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035550399999999998 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.397683+0000", 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011776426 2024-04-26T07:49:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399475+0000", 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001792837 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399663+0000", 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018749500000000001 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399775+0000", 2024-04-26T07:49:55.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011222699999999999 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2114 3.10 e58/17 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 15.522965586, 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014481571, 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:55.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454902+0000", 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7800000000000001e-06 2024-04-26T07:49:55.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459802+0000", 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049001319999999998 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459839+0000", 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7055999999999999e-05 2024-04-26T07:49:55.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459855+0000", 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6345e-05 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460023+0000", 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167579 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:55.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460071+0000", 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8046e-05 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469193+0000", 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091217039999999996 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469380+0000", 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018792900000000001 2024-04-26T07:49:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2115 3.12 3:48da4f83:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 15.516420839, 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020926337, 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:55.999 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2115 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461447+0000", 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464785+0000", 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033385540000000001 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464814+0000", 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9167e-05 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464832+0000", 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8097999999999999e-05 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464996+0000", 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016315399999999999 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465292+0000", 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029592699999999997 2024-04-26T07:49:56.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465562+0000", 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027075899999999997 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.477813+0000", 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012250749 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482150+0000", 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043364340000000001 2024-04-26T07:49:56.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482260+0000", 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110204 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482370+0000", 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110234 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2124 3.12 3:48cdd107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 15.344632213000001, 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017263152, 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2124 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633237+0000", 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2690000000000001e-06 2024-04-26T07:49:56.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637016+0000", 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037793480000000001 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637055+0000", 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9138999999999999e-05 2024-04-26T07:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637073+0000", 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8070000000000001e-05 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637251+0000", 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017822500000000001 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637652+0000", 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040054000000000001 2024-04-26T07:49:56.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.638078+0000", 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042600299999999999 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.647434+0000", 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093557510000000007 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650193+0000", 2024-04-26T07:49:56.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027596180000000001 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650366+0000", 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017236899999999999 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650495+0000", 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012982 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2125 3.17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 15.321837092999999, 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02199247, 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2125 2024-04-26T07:49:56.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656030+0000", 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.658975+0000", 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029456349999999998 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659019+0000", 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3405999999999997e-05 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659046+0000", 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6659e-05 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659219+0000", 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017387300000000001 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659499+0000", 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279926 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659769+0000", 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026926000000000001 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.668218+0000", 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084496710000000006 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677830+0000", 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096117779999999996 2024-04-26T07:49:56.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677932+0000", 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010155800000000001 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.678020+0000", 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8211e-05 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.016 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2150 3.39 e58/17 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head v 58'1, mlcod=0'0)", 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.953959942999999, 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019626325999999999, 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023907+0000", 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.576e-06 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032657+0000", 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0087502129999999997 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032704+0000", 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7024999999999998e-05 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032725+0000", 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1002999999999999e-05 2024-04-26T07:49:56.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032879+0000", 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015357599999999999 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032924+0000", 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5509000000000001e-05 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043391+0000", 2024-04-26T07:49:56.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010466787 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043531+0000", 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013963699999999999 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2154 3.6 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.856495772000001, 2024-04-26T07:49:56.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018109798999999999, 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2154 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121373+0000", 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8829999999999999e-06 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124488+0000", 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031152179999999999 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124534+0000", 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6615e-05 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124555+0000", 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0377000000000002e-05 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124721+0000", 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000166226 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125056+0000", 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033541799999999998 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125363+0000", 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030636900000000002 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.138525+0000", 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013161806 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139390+0000", 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00086512899999999996 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139439+0000", 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8795000000000003e-05 2024-04-26T07:49:56.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139478+0000", 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9962999999999997e-05 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2156 3.2b 3:d74e6742:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.806049513, 2024-04-26T07:49:56.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017757953999999999, 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2156 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171819+0000", 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5159999999999996e-06 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174698+0000", 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028785109999999998 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174739+0000", 2024-04-26T07:49:56.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0544999999999999e-05 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174757+0000", 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8267e-05 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174970+0000", 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021284799999999999 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175288+0000", 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031840500000000001 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175516+0000", 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022821500000000001 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.183262+0000", 2024-04-26T07:49:56.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077455629999999996 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189370+0000", 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061082590000000004 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189505+0000", 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134554 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189573+0000", 2024-04-26T07:49:56.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8270999999999997e-05 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2165 3.12 3:48c02635:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.582964507, 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021758514999999999, 2024-04-26T07:49:56.034 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2165 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394904+0000", 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398287+0000", 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033835380000000002 2024-04-26T07:49:56.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398343+0000", 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5148999999999997e-05 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398365+0000", 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2688999999999999e-05 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398525+0000", 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159801 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398876+0000", 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035097600000000002 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:56.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.399237+0000", 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036067100000000002 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.409713+0000", 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010476348 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416491+0000", 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067777569999999997 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416579+0000", 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412000000000007e-05 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416658+0000", 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9231000000000001e-05 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2167 3.23 3:c5a42c94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.541891041, 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015687599999999999, 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2167 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.041 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435977+0000", 2024-04-26T07:49:56.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9899999999999999e-06 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439816+0000", 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038388860000000001 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439841+0000", 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4632000000000001e-05 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439855+0000", 2024-04-26T07:49:56.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.415e-05 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440055+0000", 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019957199999999999 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440486+0000", 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043156999999999999 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:56.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440829+0000", 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034250799999999999 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.449821+0000", 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.008992033 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451400+0000", 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001579502 2024-04-26T07:49:56.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451504+0000", 2024-04-26T07:49:56.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010365399999999999 2024-04-26T07:49:56.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451661+0000", 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015710299999999999 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2169 3.3d 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.511932602, 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016653068, 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2169 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:49:56.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465937+0000", 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0359999999999997e-06 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468355+0000", 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024184660000000002 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468411+0000", 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5594000000000003e-05 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468440+0000", 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8683e-05 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468600+0000", 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000160061 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468843+0000", 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000243076 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.469075+0000", 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023207999999999999 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.476674+0000", 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0075994410000000002 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482385+0000", 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057110879999999996 2024-04-26T07:49:56.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482521+0000", 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135241 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482585+0000", 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4301999999999995e-05 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2170 3.12 3:48f78380:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.498121562, 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019689475000000001, 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2170 2024-04-26T07:49:56.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479749+0000", 2024-04-26T07:49:56.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7130000000000002e-06 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481893+0000", 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002144048 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481950+0000", 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7192999999999999e-05 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481979+0000", 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9414999999999999e-05 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482084+0000", 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105105 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482257+0000", 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173053 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:56.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482414+0000", 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000156498 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.489832+0000", 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074180399999999999 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499155+0000", 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093232509999999994 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499312+0000", 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015707899999999999 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499432+0000", 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012008 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.059 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2173 3.1b 3:d9c20b7c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.442311628000001, 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014202282, 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.060 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2173 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535556+0000", 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2370000000000001e-06 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.062 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537406+0000", 2024-04-26T07:49:56.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001850108 2024-04-26T07:49:56.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537459+0000", 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2488000000000003e-05 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537483+0000", 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4839000000000001e-05 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537586+0000", 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010207199999999999 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537761+0000", 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000175482 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537909+0000", 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014747499999999999 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.543692+0000", 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057834719999999996 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549614+0000", 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059216779999999997 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549690+0000", 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6682999999999997e-05 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549755+0000", 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4747999999999997e-05 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2190 3.17 3:ea98e33f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.255991668, 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017436619, 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.069 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2190 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:49:56.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721876+0000", 2024-04-26T07:49:56.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9390000000000002e-06 2024-04-26T07:49:56.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724451+0000", 2024-04-26T07:49:56.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025750019999999998 2024-04-26T07:49:56.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724476+0000", 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4811e-05 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724490+0000", 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4949e-05 2024-04-26T07:49:56.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724564+0000", 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3774000000000002e-05 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724694+0000", 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012977099999999999 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:56.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724806+0000", 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011196099999999999 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.732550+0000", 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077441649999999999 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739171+0000", 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066207799999999997 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739249+0000", 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8095000000000004e-05 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739309+0000", 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0371999999999997e-05 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2200 3.1 3:80d4e2c6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:56.076 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.144300508000001, 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015722348000000001, 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2200 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833566+0000", 2024-04-26T07:49:56.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7460000000000001e-06 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835679+0000", 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021130960000000001 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835704+0000", 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5194e-05 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835716+0000", 2024-04-26T07:49:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2326e-05 2024-04-26T07:49:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835834+0000", 2024-04-26T07:49:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117939 2024-04-26T07:49:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835968+0000", 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013391499999999999 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.836142+0000", 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017374600000000001 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.840818+0000", 2024-04-26T07:49:56.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046765790000000002 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849134+0000", 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0083158650000000004 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849234+0000", 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9629000000000004e-05 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849286+0000", 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2312999999999999e-05 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2201 3.30 e58/17 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head v 58'2, mlcod=0'0)", 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.128735146, 2024-04-26T07:49:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015421710999999999, 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:49:56.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849130+0000", 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858099+0000", 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089693169999999992 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858132+0000", 2024-04-26T07:49:56.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2573000000000001e-05 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858146+0000", 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3750999999999999e-05 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858247+0000", 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101265 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858271+0000", 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4006e-05 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864493+0000", 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062218079999999997 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864551+0000", 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8408e-05 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.087 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2217 3.2b 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.958224468000001, 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.048883261999999997, 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.088 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2217 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019644+0000", 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9729999999999999e-06 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022277+0000", 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026334779999999999 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022312+0000", 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4737000000000003e-05 2024-04-26T07:49:56.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022324+0000", 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1770000000000001e-05 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022410+0000", 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.598e-05 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022601+0000", 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019102100000000001 2024-04-26T07:49:56.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022771+0000", 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017026500000000001 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.029808+0000", 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070363259999999999 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068387+0000", 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.038579667999999998 2024-04-26T07:49:56.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068459+0000", 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1649000000000005e-05 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068523+0000", 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4394999999999996e-05 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.093 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2238 3.12 3:4adae178:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.706442711999999, 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015875822000000001, 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:49:56.094 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2238 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271425+0000", 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.039e-06 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273472+0000", 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020474669999999999 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273520+0000", 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7289000000000001e-05 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273539+0000", 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9222999999999999e-05 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273640+0000", 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100833 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273805+0000", 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000165854 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273934+0000", 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000128331 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.281376+0000", 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074421349999999999 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287206+0000", 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058303369999999997 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287258+0000", 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1412000000000002e-05 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287298+0000", 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9901999999999998e-05 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.099 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2239 3.3 e59/17 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head v 59'3, mlcod=58'1)", 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.687000908, 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015017188000000001, 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:49:56.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290865+0000", 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6759999999999999e-06 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296505+0000", 2024-04-26T07:49:56.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00564001 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296547+0000", 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2256000000000003e-05 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296565+0000", 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7856e-05 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:49:56.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296653+0000", 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8113000000000002e-05 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296681+0000", 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7818999999999999e-05 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305803+0000", 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.009121901 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:49:56.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305881+0000", 2024-04-26T07:49:56.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7557000000000003e-05 2024-04-26T07:49:56.104 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.104 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.104 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.104 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:49:56.104 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:49:56.104 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:56.106 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:49:56.106 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:56.102+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:56.206 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:56.199+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:56.280 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:56.280 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:56.281 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:49:56.281 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:56.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:49:56.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:49:56.339 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:56.335+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:56.408 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:56.403+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:49:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:49:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:49:56.453 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:49:56.453 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:49:56.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:49:56.483 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:56.499 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:56.509 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:56.503+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:56.516 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:56.533 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:56.533 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:56.553 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:56.553 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:56.574 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:56.591 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:56.591 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:56.595 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:56.595 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:56.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:49:56.618 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:56.618 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:56.618 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:56.611+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:56.711 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:56.707+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:56.731 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:56.731 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:56.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:49:56.835 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:49:56.831+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:49:56.904 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:49:56.913 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:56.910+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:56.921 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:56.921 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:56.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:49:57.026 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:57.023+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:57.096 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:57.096 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:57.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:49:57.115 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:57.114+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:57.216 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:57.211+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:57.279 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:57.279 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:57.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:49:57.317 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:57.314+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:57.418 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:57.415+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:57.452 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:57.453 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:57.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:49:57.519 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:57.518+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:57.620 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:57.618+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:57.648 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:57.648 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:57.663 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:49:57.721 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:57.715+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:57.796 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:57.797 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:57.811 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:49:57.822 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:57.819+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:57.923 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:57.922+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:57.933 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:57.934 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:57.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:49:58.040 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:58.038+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:58.115 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:58.115 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:58.125 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:58.122+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:58.129 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:49:58.225 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:58.222+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:58.289 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:58.289 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:58.303 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:49:58.347 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:58.346+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:58.427 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:58.426+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:58.464 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:58.465 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:58.479 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:49:58.571 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:58.570+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:58.629 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:58.626+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:58.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:49:58.647 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:58.648 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:58.662 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:49:58.747 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:49:58.746+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:49:58.794 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:49:58.795 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:49:58.811 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:49:58.811 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:49:58.827 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:49:58.828 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:49:58.829 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:49:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:49:58.830 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:58.826+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:58.842 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:49:58.846 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:49:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:49:58.865 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:49:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:49:58.884 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:49:58.885 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:49:58.903 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:49:58.903 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:49:58.923 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:49:58.923 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:49:58.931 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:49:58.931+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:49:58.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:49:59.009 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:59.010 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:59.010 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:59.010 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:59.010 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:59.024 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:49:59.075 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:59.074+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:59.133 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:59.130+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:59.152 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:59.153 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:59.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:59.153 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:59.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.153 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:49:59.153 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:59.154 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.592532102999996, 2024-04-26T07:49:59.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:49:59.154 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.154 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:49:59.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:49:59.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:49:59.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:1243 3.34 e54/17 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head v 54'1, mlcod=0'0)", 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.926135871, 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018677787000000001, 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224141+0000", 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.224143+0000", 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7850000000000001e-06 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227226+0000", 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003083293 2024-04-26T07:49:59.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227258+0000", 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2237999999999999e-05 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227273+0000", 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4312e-05 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227395+0000", 2024-04-26T07:49:59.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012202200000000001 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.227461+0000", 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6217000000000007e-05 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242732+0000", 2024-04-26T07:49:59.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015270974 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242819+0000", 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6946000000000004e-05 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2102 3.35 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:59.166 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.903817325999999, 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025241564000000001, 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2102 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246463+0000", 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.106e-06 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252299+0000", 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058363080000000001 2024-04-26T07:49:59.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252331+0000", 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1914e-05 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252346+0000", 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4829e-05 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252506+0000", 2024-04-26T07:49:59.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015995500000000001 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252872+0000", 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000365817 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253249+0000", 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037744100000000001 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271215+0000", 2024-04-26T07:49:59.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017965979 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271568+0000", 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035317600000000002 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271630+0000", 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1853000000000006e-05 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271701+0000", 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1186000000000006e-05 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2109 3.26 3:64cb7bc7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.778799796000001, 2024-04-26T07:49:59.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017368982000000002, 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2109 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371477+0000", 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371480+0000", 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6800000000000002e-06 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375488+0000", 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040076979999999996 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375515+0000", 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7790999999999999e-05 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375527+0000", 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1705000000000001e-05 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375609+0000", 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1929999999999997e-05 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375757+0000", 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014830400000000001 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:59.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.375879+0000", 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121169 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.385948+0000", 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010069567999999999 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388730+0000", 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002781684 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388782+0000", 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1894000000000002e-05 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.388846+0000", 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4559000000000003e-05 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2112 3.26 3:658014ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.733516707, 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022887174, 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.179 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2112 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416760+0000", 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.416763+0000", 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9469999999999999e-06 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422174+0000", 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005410687 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422216+0000", 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1807000000000001e-05 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422234+0000", 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8706e-05 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422410+0000", 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017526900000000001 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.422831+0000", 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042124399999999998 2024-04-26T07:49:59.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.423250+0000", 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041928100000000003 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.438715+0000", 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015465202000000001 2024-04-26T07:49:59.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439443+0000", 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00072764499999999996 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439539+0000", 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6173000000000002e-05 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.439648+0000", 2024-04-26T07:49:59.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108213 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2114 3.10 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.701235938, 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021514529000000001, 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2114 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449041+0000", 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.449044+0000", 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6369999999999999e-06 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454276+0000", 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052320489999999999 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454310+0000", 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4186000000000001e-05 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454328+0000", 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7977000000000001e-05 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454461+0000", 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013284899999999999 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454722+0000", 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026144500000000002 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.454976+0000", 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025349200000000002 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.463666+0000", 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086904649999999996 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470375+0000", 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067091629999999998 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470477+0000", 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101433 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.470556+0000", 2024-04-26T07:49:59.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8832999999999996e-05 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2144 3.26 3:66326b37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.283868105, 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016531011000000002, 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.191 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2144 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866409+0000", 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.866411+0000", 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.198e-06 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871082+0000", 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046708499999999998 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871112+0000", 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9558000000000001e-05 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871127+0000", 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5084e-05 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871236+0000", 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109786 2024-04-26T07:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871500+0000", 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000263248 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.871737+0000", 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023734900000000001 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882248+0000", 2024-04-26T07:49:59.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010511453 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882850+0000", 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00060166699999999996 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882899+0000", 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9144000000000002e-05 2024-04-26T07:49:59.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.882940+0000", 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0673999999999997e-05 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2148 3.1e e58/46 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head v 58'3, mlcod=54'1)", 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.178003471, 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018285590000000001, 2024-04-26T07:49:59.197 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972274+0000", 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.972276+0000", 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7930000000000002e-06 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980745+0000", 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084683919999999999 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980771+0000", 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5911e-05 2024-04-26T07:49:59.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980784+0000", 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3241000000000001e-05 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980866+0000", 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2348999999999994e-05 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.980891+0000", 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5097e-05 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990494+0000", 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0096024130000000006 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.990559+0000", 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5394000000000004e-05 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2157 3.a 3:522571bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.952618012999999, 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018495228999999998, 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.202 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2157 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197659+0000", 2024-04-26T07:49:59.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.197662+0000", 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2440000000000002e-06 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201962+0000", 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042994369999999997 2024-04-26T07:49:59.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.201994+0000", 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1850999999999997e-05 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202009+0000", 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5251e-05 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202109+0000", 2024-04-26T07:49:59.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100318 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202250+0000", 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014054700000000001 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.202371+0000", 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012143500000000001 2024-04-26T07:49:59.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.207294+0000", 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049230929999999999 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216058+0000", 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087642239999999993 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216112+0000", 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3897000000000003e-05 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.216154+0000", 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1931999999999998e-05 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2162 3.35 3:ad57cd5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.829185448, 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016822856000000001, 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2162 2024-04-26T07:49:59.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321092+0000", 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.321094+0000", 2024-04-26T07:49:59.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.43e-06 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327241+0000", 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061465360000000002 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327266+0000", 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5922e-05 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327282+0000", 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5603e-05 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327396+0000", 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113418 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327544+0000", 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014825 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.327679+0000", 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000134905 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337198+0000", 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0095190269999999993 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337818+0000", 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000620737 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337869+0000", 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0893000000000002e-05 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.337914+0000", 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5135000000000001e-05 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.214 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2171 3.26 3:655b4449:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.646037291999999, 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016538298, 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.215 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2171 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504240+0000", 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.504243+0000", 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509432+0000", 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051888860000000002 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509451+0000", 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9241000000000001e-05 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509464+0000", 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2510999999999999e-05 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509514+0000", 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0083999999999997e-05 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509623+0000", 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109768 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.509721+0000", 2024-04-26T07:49:59.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7182000000000006e-05 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520340+0000", 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010619358000000001 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520698+0000", 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035771499999999999 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520738+0000", 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0623000000000001e-05 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.520778+0000", 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9817000000000002e-05 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2172 3.36 3:6e55231b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.626287569999999, 2024-04-26T07:49:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016132018000000001, 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2172 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523989+0000", 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.523993+0000", 2024-04-26T07:49:59.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4070000000000002e-06 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528585+0000", 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00459225 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528620+0000", 2024-04-26T07:49:59.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5073000000000001e-05 2024-04-26T07:49:59.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528640+0000", 2024-04-26T07:49:59.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9913000000000001e-05 2024-04-26T07:49:59.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528743+0000", 2024-04-26T07:49:59.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010309100000000001 2024-04-26T07:49:59.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.528918+0000", 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175203 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.529094+0000", 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175928 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.539613+0000", 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010518675999999999 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540039+0000", 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042617600000000001 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540085+0000", 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5367000000000001e-05 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.540122+0000", 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6934000000000002e-05 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2179 3.a 3:50808692:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.543356349, 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018371393999999999, 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.229 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2179 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606921+0000", 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.606923+0000", 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9879999999999999e-06 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612730+0000", 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058072059999999997 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612765+0000", 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5187e-05 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612784+0000", 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8536e-05 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612865+0000", 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1522999999999999e-05 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.612994+0000", 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012873499999999999 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.613100+0000", 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105647 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.618956+0000", 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058564849999999998 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625161+0000", 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062052549999999998 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625237+0000", 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5364000000000006e-05 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.625292+0000", 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5467999999999998e-05 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.234 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2189 3.20 3:05abebd8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.438819413000001, 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016416799999999999, 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2189 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.235 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711458+0000", 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.711460+0000", 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1390000000000002e-06 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715243+0000", 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00378364 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715266+0000", 2024-04-26T07:49:59.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2521e-05 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715276+0000", 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8630000000000003e-06 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715358+0000", 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2520000000000003e-05 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715520+0000", 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161237 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.715666+0000", 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014621100000000001 2024-04-26T07:49:59.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.721893+0000", 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062276730000000004 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727800+0000", 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059063750000000002 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727841+0000", 2024-04-26T07:49:59.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1247e-05 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.727874+0000", 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3374000000000003e-05 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2218 3.34 e59/17 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.114541593999999, 2024-04-26T07:49:59.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030663971000000002, 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035737+0000", 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0869999999999999e-06 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039593+0000", 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038566609999999999 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039642+0000", 2024-04-26T07:49:59.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8699999999999998e-05 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7350000000000001e-05 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039870+0000", 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020093199999999999 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039931+0000", 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1294e-05 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066342+0000", 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026410869 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066399+0000", 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7077999999999998e-05 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.245 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2228 3.26 3:64fe9f73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.009253388000001, 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022971215999999999, 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2228 2024-04-26T07:49:59.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141024+0000", 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.141027+0000", 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1470000000000001e-06 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145123+0000", 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040963650000000002 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145151+0000", 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7591999999999999e-05 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145165+0000", 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4381e-05 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145290+0000", 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012445699999999999 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145588+0000", 2024-04-26T07:49:59.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029875499999999999 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.145898+0000", 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031002800000000001 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163197+0000", 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017298396000000001 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163680+0000", 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048320699999999998 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163856+0000", 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017556200000000001 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.163995+0000", 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139326 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.251 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2230 3.a 3:53d9bc93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.984456313999999, 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019702107, 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2230 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.252 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165821+0000", 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.165823+0000", 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2069999999999998e-06 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169605+0000", 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037818980000000001 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169633+0000", 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7906999999999999e-05 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169646+0000", 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3132000000000001e-05 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.169796+0000", 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015037699999999999 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.170035+0000", 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238905 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.170260+0000", 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000224551 2024-04-26T07:49:59.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.184639+0000", 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01437922 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185356+0000", 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000716575 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185453+0000", 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7188999999999994e-05 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.185523+0000", 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0146000000000002e-05 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2242 3.2c 3:3494587f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.829418096000001, 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023803956000000001, 2024-04-26T07:49:59.257 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2242 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320862+0000", 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326077+0000", 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052153720000000002 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326119+0000", 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1112999999999998e-05 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326139+0000", 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9962999999999998e-05 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326237+0000", 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8110999999999996e-05 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326355+0000", 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011791200000000001 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326459+0000", 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010489600000000001 2024-04-26T07:49:59.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338991+0000", 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012531967 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344349+0000", 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053576589999999999 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344529+0000", 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179958 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344663+0000", 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013385 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.263 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2246 3.1e e59/46 3:7a597943:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_135:head v 59'5, mlcod=58'3)", 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.784695908, 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021214457999999999, 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365581+0000", 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.365584+0000", 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.554e-06 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370384+0000", 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048000589999999997 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370416+0000", 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370432+0000", 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5553000000000002e-05 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370552+0000", 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119836 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.370593+0000", 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1295999999999999e-05 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.386730+0000", 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016136833999999999 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.386796+0000", 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5747000000000006e-05 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.267 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2248 3.36 3:6c58e6b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.766900554999999, 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017638042, 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2248 2024-04-26T07:49:59.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383376+0000", 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.383381+0000", 2024-04-26T07:49:59.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0999999999999997e-06 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387813+0000", 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004432638 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387857+0000", 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3773000000000003e-05 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387886+0000", 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8569999999999999e-05 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.387994+0000", 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000108705 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.388184+0000", 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000189268 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.388342+0000", 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015877900000000001 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398071+0000", 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097290190000000002 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.400936+0000", 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028646679999999999 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.400980+0000", 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3733000000000003e-05 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.401015+0000", 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4789000000000002e-05 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.274 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.274 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:59.275 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:49:59.276 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:49:59.274+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:49:59.376 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:49:59.374+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:49:59.447 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:59.447 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:59.447 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:49:59.448 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:59.462 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:49:59.477 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:59.475+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:59.578 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:49:59.575+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:49:59.632 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:59.632 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:49:59.632 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:49:59.632 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:49:59.632 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:59.647 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:49:59.678 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:49:59.679+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:49:59.774 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:49:59.774 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:49:59.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:49:59.774 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:49:59.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.31526295499999, 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:49:59.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:49:59.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:49:59.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.030229244, 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.782 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:49:59.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:49:59.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.03019041100001, 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.788 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:49:59.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:49:59.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:49:59.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:49:59.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:49:59.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.794 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.03015238099999, 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.795 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:49:59.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:49:59.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.03003082799999, 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.801 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:49:59.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:49:59.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:49:59.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:49:59.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.02999085899999, 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.807 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.812 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2103 3.3b 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.5123392, 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025234304999999999, 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2103 2024-04-26T07:49:59.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259416+0000", 2024-04-26T07:49:59.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6260000000000001e-06 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.265987+0000", 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00657108 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266029+0000", 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1155999999999997e-05 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266055+0000", 2024-04-26T07:49:59.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6597e-05 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266194+0000", 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013830200000000001 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266432+0000", 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023884199999999999 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266641+0000", 2024-04-26T07:49:59.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020863199999999999 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.279877+0000", 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013236346 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284529+0000", 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046518210000000004 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284593+0000", 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3723e-05 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284647+0000", 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.418e-05 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.818 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2108 3.f 3:f0ee051f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.421233536999999, 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020717233000000002, 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2108 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350520+0000", 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7269999999999999e-06 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358048+0000", 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075278059999999997 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358071+0000", 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3523000000000002e-05 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358083+0000", 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1265e-05 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358172+0000", 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9582999999999999e-05 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358326+0000", 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015335899999999999 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358454+0000", 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0001282 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.364823+0000", 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063690309999999998 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371105+0000", 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062825310000000001 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371167+0000", 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1532999999999995e-05 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371236+0000", 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8675000000000002e-05 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2139 3.e 3:7390af0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.020491221, 2024-04-26T07:49:59.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024095845000000001, 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2139 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751265+0000", 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2729999999999996e-06 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.758971+0000", 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077062930000000003 2024-04-26T07:49:59.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759009+0000", 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7429999999999999e-05 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759027+0000", 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8323000000000001e-05 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759223+0000", 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000196386 2024-04-26T07:49:59.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759474+0000", 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250175 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759705+0000", 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000230998 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.774391+0000", 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014686296999999999 2024-04-26T07:49:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775046+0000", 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065485499999999998 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775220+0000", 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017439899999999999 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775357+0000", 2024-04-26T07:49:59.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013641599999999999 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2141 3.e 3:73fc2b27:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.972468102000001, 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683983999999999, 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2141 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799288+0000", 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-06 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803704+0000", 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044163680000000004 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803745+0000", 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0836e-05 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803764+0000", 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8743e-05 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803912+0000", 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014867299999999999 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804192+0000", 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027982799999999998 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804430+0000", 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238435 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816451+0000", 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012020507 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819796+0000", 2024-04-26T07:49:59.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033448689999999999 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819890+0000", 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3795999999999994e-05 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819968+0000", 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8208999999999996e-05 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2142 3.15 3:a87525cc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.955369023999999, 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022647812, 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2142 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816387+0000", 2024-04-26T07:49:59.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2560000000000004e-06 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822782+0000", 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063953079999999997 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822812+0000", 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9876999999999999e-05 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822833+0000", 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1013e-05 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823017+0000", 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018354499999999999 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823252+0000", 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234832 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:49:59.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823515+0000", 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026311800000000001 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.836859+0000", 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01334453 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838722+0000", 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018625650000000001 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838882+0000", 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015986200000000001 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839031+0000", 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148906 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2150 3.39 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.752665354000001, 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025377047, 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2150 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019089+0000", 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3590000000000002e-06 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023640+0000", 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045514700000000002 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023666+0000", 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5384e-05 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023680+0000", 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3981999999999999e-05 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023757+0000", 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7249999999999994e-05 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023912+0000", 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015499900000000001 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.024032+0000", 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119628 2024-04-26T07:49:59.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.034967+0000", 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010935823000000001 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044357+0000", 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093895449999999991 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044412+0000", 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5359999999999999e-05 2024-04-26T07:49:59.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044464+0000", 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1246999999999999e-05 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2168 3.2d 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.31713349, 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026862164000000001, 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.848 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2168 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454622+0000", 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459549+0000", 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049275710000000004 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459589+0000", 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9387000000000001e-05 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459609+0000", 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0392999999999999e-05 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459751+0000", 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014207900000000001 2024-04-26T07:49:59.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459996+0000", 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024460500000000001 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.460226+0000", 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023053200000000001 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.469147+0000", 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089203549999999996 2024-04-26T07:49:59.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481152+0000", 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012005386999999999 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481352+0000", 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020005199999999999 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481481+0000", 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012850900000000001 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2183 3.37 3:ef675d97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:49:59.854 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:59.855 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.122569296000002, 2024-04-26T07:49:59.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019732288000000001, 2024-04-26T07:49:59.855 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.855 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.855 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.855 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.855 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.856 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.856 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2183 2024-04-26T07:49:59.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.856 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:59.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:49:59.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649185+0000", 2024-04-26T07:49:59.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8200000000000001e-06 2024-04-26T07:49:59.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655471+0000", 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062857750000000004 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655498+0000", 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7029000000000002e-05 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655509+0000", 2024-04-26T07:49:59.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0813e-05 2024-04-26T07:49:59.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655609+0000", 2024-04-26T07:49:59.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9953999999999999e-05 2024-04-26T07:49:59.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655801+0000", 2024-04-26T07:49:59.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000192189 2024-04-26T07:49:59.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655983+0000", 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018226200000000001 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668782+0000", 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012798886000000001 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668801+0000", 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377999999999999e-05 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668856+0000", 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5265e-05 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668915+0000", 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8916999999999999e-05 2024-04-26T07:49:59.863 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2205 3.14 e59/17 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head v 59'3, mlcod=58'1)", 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.873431923999998, 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020789596, 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.864 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898321+0000", 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6400000000000001e-07 2024-04-26T07:49:59.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902172+0000", 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003850787 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902208+0000", 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5952999999999999e-05 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902230+0000", 2024-04-26T07:49:59.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1987000000000001e-05 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902392+0000", 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162344 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902418+0000", 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5953e-05 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919038+0000", 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016620234000000001 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919110+0000", 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1474e-05 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2207 3.3f 3:fe080a1d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:59.868 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.856206585999999, 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021701979999999999, 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2207 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915549+0000", 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1200000000000004e-06 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921046+0000", 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054969049999999998 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921067+0000", 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0724e-05 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921079+0000", 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1533e-05 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921145+0000", 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6662000000000007e-05 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921267+0000", 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121889 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921388+0000", 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120449 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934035+0000", 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012647818 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937179+0000", 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003143065 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937218+0000", 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9662000000000001e-05 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937247+0000", 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9153e-05 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2213 3.f 3:f1254826:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:59.874 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.793043391000001, 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021396413, 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2213 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978713+0000", 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982948+0000", 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042354690000000004 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982982+0000", 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3683000000000003e-05 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983002+0000", 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9599999999999999e-05 2024-04-26T07:49:59.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983200+0000", 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000198715 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983466+0000", 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026605500000000001 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983722+0000", 2024-04-26T07:49:59.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025512499999999998 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.994151+0000", 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010429528 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999893+0000", 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057413860000000002 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999992+0000", 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9689e-05 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.000105+0000", 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112766 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.880 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2217 3.2b e59/17 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head v 59'2, mlcod=0'0)", 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.748294161, 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044994659999999999, 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6300000000000005e-07 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032526+0000", 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090671680000000004 2024-04-26T07:49:59.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032570+0000", 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4039000000000003e-05 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032593+0000", 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3873e-05 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032774+0000", 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018014300000000001 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032819+0000", 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5713000000000001e-05 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068399+0000", 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.035580053 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068452+0000", 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3108e-05 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2219 3.d 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.732085980000001, 2024-04-26T07:49:59.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029242280999999998, 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2219 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:49:59.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4999999999999999e-06 2024-04-26T07:49:59.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046427+0000", 2024-04-26T07:49:59.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067579299999999997 2024-04-26T07:49:59.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046452+0000", 2024-04-26T07:49:59.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4341999999999998e-05 2024-04-26T07:49:59.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046465+0000", 2024-04-26T07:49:59.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3434999999999999e-05 2024-04-26T07:49:59.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046565+0000", 2024-04-26T07:49:59.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9584000000000001e-05 2024-04-26T07:49:59.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046729+0000", 2024-04-26T07:49:59.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016413300000000001 2024-04-26T07:49:59.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:49:59.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046851+0000", 2024-04-26T07:49:59.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012242199999999999 2024-04-26T07:49:59.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:49:59.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068781+0000", 2024-04-26T07:49:59.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021930021000000001 2024-04-26T07:49:59.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:49:59.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068797+0000", 2024-04-26T07:49:59.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6123000000000001e-05 2024-04-26T07:49:59.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068862+0000", 2024-04-26T07:49:59.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.457e-05 2024-04-26T07:49:59.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068908+0000", 2024-04-26T07:49:59.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6220999999999997e-05 2024-04-26T07:49:59.895 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.895 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.896 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.896 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2247 3.14 e59/17 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head v 59'5, mlcod=59'3)", 2024-04-26T07:49:59.896 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:59.896 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.393546381, 2024-04-26T07:49:59.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019349376000000001, 2024-04-26T07:49:59.897 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:49:59.897 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:49:59.897 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:49:59.897 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:49:59.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:49:59.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:59.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:49:59.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:49:59.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:49:59.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:49:59.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378209+0000", 2024-04-26T07:49:59.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0929999999999999e-06 2024-04-26T07:49:59.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:49:59.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381273+0000", 2024-04-26T07:49:59.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00306456 2024-04-26T07:49:59.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:49:59.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381314+0000", 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0519000000000003e-05 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381331+0000", 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7547e-05 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381492+0000", 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000160979 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381553+0000", 2024-04-26T07:49:59.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0962999999999999e-05 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397406+0000", 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015853145999999999 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397555+0000", 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014856900000000001 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.902 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.903 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.903 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:49:59.903 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:49:59.903 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:49:59.904 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:49:59.902+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:49:59.905 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:49:59.917 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:50:00.005 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:00.002+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:00.034 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:00.034 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:00.034 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:00.034 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:00.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:00.106 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:00.103+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:00.167 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:00.167 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:00.182 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:00.207 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:00.202+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:00.308 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:00.307+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:00.344 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:00.344 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:00.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:00.344 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:00.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.344 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1113 3.6 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.076644383999998, 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015424972, 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1113 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266304+0000", 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6060000000000001e-06 2024-04-26T07:50:00.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270480+0000", 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041759689999999999 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270523+0000", 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2908000000000003e-05 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270541+0000", 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8790000000000001e-05 2024-04-26T07:50:00.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270636+0000", 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4690000000000003e-05 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270821+0000", 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018512100000000001 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271288+0000", 2024-04-26T07:50:00.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046690099999999998 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.280701+0000", 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0094125839999999999 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281610+0000", 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090926400000000001 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281676+0000", 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5809999999999995e-05 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281726+0000", 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0328999999999999e-05 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.350 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2110 3.23 3:c664601d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.960642908000001, 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017472562000000001, 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2110 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382305+0000", 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6630000000000002e-06 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.384976+0000", 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026707620000000001 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385010+0000", 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.358e-05 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385026+0000", 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6487999999999999e-05 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385180+0000", 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153609 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385551+0000", 2024-04-26T07:50:00.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000370971 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385906+0000", 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035550399999999998 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.397683+0000", 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011776426 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399475+0000", 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001792837 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399663+0000", 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018749500000000001 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399775+0000", 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011222699999999999 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2114 3.10 e58/17 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.888046586000002, 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014481571, 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454902+0000", 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7800000000000001e-06 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459802+0000", 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049001319999999998 2024-04-26T07:50:00.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459839+0000", 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7055999999999999e-05 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459855+0000", 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6345e-05 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460023+0000", 2024-04-26T07:50:00.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167579 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460071+0000", 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8046e-05 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469193+0000", 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091217039999999996 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469380+0000", 2024-04-26T07:50:00.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018792900000000001 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2115 3.12 3:48da4f83:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.881501838999998, 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020926337, 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2115 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461447+0000", 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464785+0000", 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033385540000000001 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464814+0000", 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9167e-05 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464832+0000", 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8097999999999999e-05 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464996+0000", 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016315399999999999 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465292+0000", 2024-04-26T07:50:00.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029592699999999997 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465562+0000", 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027075899999999997 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.477813+0000", 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012250749 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482150+0000", 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043364340000000001 2024-04-26T07:50:00.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482260+0000", 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110204 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482370+0000", 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110234 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2124 3.12 3:48cdd107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.709713213000001, 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017263152, 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2124 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:00.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:00.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633237+0000", 2024-04-26T07:50:00.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2690000000000001e-06 2024-04-26T07:50:00.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637016+0000", 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037793480000000001 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637055+0000", 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9138999999999999e-05 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637073+0000", 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8070000000000001e-05 2024-04-26T07:50:00.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637251+0000", 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017822500000000001 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637652+0000", 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040054000000000001 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:00.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.638078+0000", 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042600299999999999 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.647434+0000", 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093557510000000007 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650193+0000", 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027596180000000001 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650366+0000", 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017236899999999999 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650495+0000", 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012982 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2125 3.17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.373 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:00.374 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.686918092999999, 2024-04-26T07:50:00.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02199247, 2024-04-26T07:50:00.374 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.374 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.374 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.375 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2125 2024-04-26T07:50:00.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.375 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:00.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656030+0000", 2024-04-26T07:50:00.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.658975+0000", 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029456349999999998 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659019+0000", 2024-04-26T07:50:00.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3405999999999997e-05 2024-04-26T07:50:00.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659046+0000", 2024-04-26T07:50:00.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6659e-05 2024-04-26T07:50:00.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659219+0000", 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017387300000000001 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659499+0000", 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279926 2024-04-26T07:50:00.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659769+0000", 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026926000000000001 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.668218+0000", 2024-04-26T07:50:00.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084496710000000006 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677830+0000", 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096117779999999996 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677932+0000", 2024-04-26T07:50:00.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010155800000000001 2024-04-26T07:50:00.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.678020+0000", 2024-04-26T07:50:00.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8211e-05 2024-04-26T07:50:00.382 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.382 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.383 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.383 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2150 3.39 e58/17 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:00.383 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:00.383 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.319040943000001, 2024-04-26T07:50:00.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019626325999999999, 2024-04-26T07:50:00.383 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.384 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.384 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.384 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:00.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:00.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023907+0000", 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.576e-06 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032657+0000", 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0087502129999999997 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032704+0000", 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7024999999999998e-05 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032725+0000", 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1002999999999999e-05 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032879+0000", 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015357599999999999 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032924+0000", 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5509000000000001e-05 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043391+0000", 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010466787 2024-04-26T07:50:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043531+0000", 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013963699999999999 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2154 3.6 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.221576771999999, 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018109798999999999, 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2154 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121373+0000", 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8829999999999999e-06 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124488+0000", 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031152179999999999 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124534+0000", 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6615e-05 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124555+0000", 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0377000000000002e-05 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124721+0000", 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000166226 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125056+0000", 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033541799999999998 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125363+0000", 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030636900000000002 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.138525+0000", 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013161806 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139390+0000", 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00086512899999999996 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139439+0000", 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8795000000000003e-05 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139478+0000", 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9962999999999997e-05 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.394 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2156 3.2b 3:d74e6742:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.171130513000001, 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017757953999999999, 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2156 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.395 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171819+0000", 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5159999999999996e-06 2024-04-26T07:50:00.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174698+0000", 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028785109999999998 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174739+0000", 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0544999999999999e-05 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174757+0000", 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8267e-05 2024-04-26T07:50:00.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174970+0000", 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021284799999999999 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175288+0000", 2024-04-26T07:50:00.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031840500000000001 2024-04-26T07:50:00.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:00.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175516+0000", 2024-04-26T07:50:00.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022821500000000001 2024-04-26T07:50:00.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.183262+0000", 2024-04-26T07:50:00.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077455629999999996 2024-04-26T07:50:00.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189370+0000", 2024-04-26T07:50:00.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061082590000000004 2024-04-26T07:50:00.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189505+0000", 2024-04-26T07:50:00.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134554 2024-04-26T07:50:00.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189573+0000", 2024-04-26T07:50:00.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8270999999999997e-05 2024-04-26T07:50:00.402 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.403 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.403 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.403 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2165 3.12 3:48c02635:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.403 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:00.403 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.948045507, 2024-04-26T07:50:00.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021758514999999999, 2024-04-26T07:50:00.404 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.404 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.404 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.404 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.404 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.405 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.405 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2165 2024-04-26T07:50:00.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.405 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:00.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:00.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394904+0000", 2024-04-26T07:50:00.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:50:00.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398287+0000", 2024-04-26T07:50:00.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033835380000000002 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398343+0000", 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5148999999999997e-05 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398365+0000", 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2688999999999999e-05 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398525+0000", 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159801 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398876+0000", 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035097600000000002 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.399237+0000", 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036067100000000002 2024-04-26T07:50:00.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.409713+0000", 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010476348 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416491+0000", 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067777569999999997 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416579+0000", 2024-04-26T07:50:00.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412000000000007e-05 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416658+0000", 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9231000000000001e-05 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2167 3.23 3:c5a42c94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.906972041, 2024-04-26T07:50:00.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015687599999999999, 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2167 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435977+0000", 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9899999999999999e-06 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439816+0000", 2024-04-26T07:50:00.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038388860000000001 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439841+0000", 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4632000000000001e-05 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439855+0000", 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.415e-05 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440055+0000", 2024-04-26T07:50:00.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019957199999999999 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440486+0000", 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043156999999999999 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440829+0000", 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034250799999999999 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.449821+0000", 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.008992033 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451400+0000", 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001579502 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451504+0000", 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010365399999999999 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451661+0000", 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015710299999999999 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2169 3.3d 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.877013602000002, 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016653068, 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.418 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2169 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465937+0000", 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0359999999999997e-06 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468355+0000", 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024184660000000002 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468411+0000", 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5594000000000003e-05 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468440+0000", 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8683e-05 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468600+0000", 2024-04-26T07:50:00.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000160061 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468843+0000", 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000243076 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.469075+0000", 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023207999999999999 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.476674+0000", 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0075994410000000002 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482385+0000", 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057110879999999996 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482521+0000", 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135241 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482585+0000", 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4301999999999995e-05 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.424 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2170 3.12 3:48f78380:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.863202562000001, 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019689475000000001, 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2170 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479749+0000", 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7130000000000002e-06 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481893+0000", 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002144048 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481950+0000", 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7192999999999999e-05 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481979+0000", 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9414999999999999e-05 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482084+0000", 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105105 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482257+0000", 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173053 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482414+0000", 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000156498 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.489832+0000", 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074180399999999999 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499155+0000", 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093232509999999994 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499312+0000", 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015707899999999999 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499432+0000", 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012008 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2173 3.1b 3:d9c20b7c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.807392627999999, 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014202282, 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.431 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2173 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:00.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535556+0000", 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2370000000000001e-06 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537406+0000", 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001850108 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537459+0000", 2024-04-26T07:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2488000000000003e-05 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537483+0000", 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4839000000000001e-05 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537586+0000", 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010207199999999999 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537761+0000", 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000175482 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537909+0000", 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014747499999999999 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.543692+0000", 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057834719999999996 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549614+0000", 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059216779999999997 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549690+0000", 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6682999999999997e-05 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549755+0000", 2024-04-26T07:50:00.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4747999999999997e-05 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2190 3.17 3:ea98e33f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.621072668, 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017436619, 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.437 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2190 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721876+0000", 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9390000000000002e-06 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724451+0000", 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025750019999999998 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724476+0000", 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4811e-05 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724490+0000", 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4949e-05 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724564+0000", 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3774000000000002e-05 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724694+0000", 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012977099999999999 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724806+0000", 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011196099999999999 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.732550+0000", 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077441649999999999 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739171+0000", 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066207799999999997 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739249+0000", 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8095000000000004e-05 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739309+0000", 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0371999999999997e-05 2024-04-26T07:50:00.442 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2200 3.1 3:80d4e2c6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.509381508000001, 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015722348000000001, 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.443 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2200 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833566+0000", 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7460000000000001e-06 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835679+0000", 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021130960000000001 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835704+0000", 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5194e-05 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835716+0000", 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2326e-05 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835834+0000", 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117939 2024-04-26T07:50:00.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835968+0000", 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013391499999999999 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.836142+0000", 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017374600000000001 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.840818+0000", 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046765790000000002 2024-04-26T07:50:00.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849134+0000", 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0083158650000000004 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849234+0000", 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9629000000000004e-05 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849286+0000", 2024-04-26T07:50:00.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2312999999999999e-05 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2201 3.30 e58/17 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.493816146, 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015421710999999999, 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849130+0000", 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858099+0000", 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089693169999999992 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858132+0000", 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2573000000000001e-05 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858146+0000", 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3750999999999999e-05 2024-04-26T07:50:00.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858247+0000", 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101265 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858271+0000", 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4006e-05 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864493+0000", 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062218079999999997 2024-04-26T07:50:00.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864551+0000", 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8408e-05 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2217 3.2b 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.323305468000001, 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.048883261999999997, 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.453 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2217 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019644+0000", 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9729999999999999e-06 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022277+0000", 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026334779999999999 2024-04-26T07:50:00.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022312+0000", 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4737000000000003e-05 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022324+0000", 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1770000000000001e-05 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022410+0000", 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.598e-05 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022601+0000", 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019102100000000001 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022771+0000", 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017026500000000001 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.029808+0000", 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070363259999999999 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068387+0000", 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.038579667999999998 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068459+0000", 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1649000000000005e-05 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068523+0000", 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4394999999999996e-05 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2238 3.12 3:4adae178:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.071523712000001, 2024-04-26T07:50:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015875822000000001, 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2238 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271425+0000", 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.039e-06 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273472+0000", 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020474669999999999 2024-04-26T07:50:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273520+0000", 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7289000000000001e-05 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273539+0000", 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9222999999999999e-05 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273640+0000", 2024-04-26T07:50:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100833 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273805+0000", 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000165854 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273934+0000", 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000128331 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.281376+0000", 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074421349999999999 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287206+0000", 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058303369999999997 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287258+0000", 2024-04-26T07:50:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1412000000000002e-05 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287298+0000", 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9901999999999998e-05 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2239 3.3 e59/17 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.052081908000002, 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015017188000000001, 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290865+0000", 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6759999999999999e-06 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296505+0000", 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00564001 2024-04-26T07:50:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296547+0000", 2024-04-26T07:50:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2256000000000003e-05 2024-04-26T07:50:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296565+0000", 2024-04-26T07:50:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7856e-05 2024-04-26T07:50:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296653+0000", 2024-04-26T07:50:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8113000000000002e-05 2024-04-26T07:50:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296681+0000", 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7818999999999999e-05 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305803+0000", 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.009121901 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305881+0000", 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7557000000000003e-05 2024-04-26T07:50:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.472 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:00.473 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:00.474 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:00.470+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:00.575 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:00.574+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:00.649 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:00.649 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:00.663 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:00.675 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:00.674+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:00.776 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:00.774+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:00.787 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:00.787 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:00.801 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:00.877 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:00.875+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 88.266930083000005, 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:50:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1110 3.25 3:a41b494f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.681168792999998, 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012576264, 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1110 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243099+0000", 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.091e-06 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245358+0000", 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022582739999999998 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245385+0000", 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7535999999999999e-05 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245398+0000", 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2965e-05 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245462+0000", 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4150000000000001e-05 2024-04-26T07:50:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245564+0000", 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101828 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245651+0000", 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7503999999999994e-05 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.252240+0000", 2024-04-26T07:50:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065883399999999998 2024-04-26T07:50:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255588+0000", 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00334805 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255640+0000", 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1904000000000003e-05 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255673+0000", 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3621999999999998e-05 2024-04-26T07:50:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:1113 3.6 e53/17 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head v 53'1, mlcod=0'0)", 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.652781046999998, 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098513860000000002, 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271487+0000", 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.013e-06 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274777+0000", 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032900289999999999 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274803+0000", 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5765000000000001e-05 2024-04-26T07:50:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274817+0000", 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4678000000000001e-05 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274943+0000", 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125394 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274986+0000", 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2759000000000002e-05 2024-04-26T07:50:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281271+0000", 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062853789999999998 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281336+0000", 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5369000000000004e-05 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 20.606599054, 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 20.44194031, 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 20.420066268999999, 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.877267282999998, 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.82517743, 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.798689102000001, 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.630423891, 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2181 3.25 3:a4112efc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.296637538999999, 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098076180000000006, 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2181 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627646+0000", 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7272e-05 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629343+0000", 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016969470000000001 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629378+0000", 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4953999999999998e-05 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629393+0000", 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4956e-05 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629486+0000", 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3129999999999998e-05 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629645+0000", 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015958300000000001 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629784+0000", 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013875199999999999 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.636610+0000", 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068263109999999998 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637298+0000", 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068795100000000001 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637372+0000", 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637436+0000", 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4029999999999995e-05 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.173393625999999, 2024-04-26T07:50:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.067579240000001, 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2211 3.4 3:20747335:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.965528551999999, 2024-04-26T07:50:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012423844999999999, 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2211 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958740+0000", 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.959e-06 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960929+0000", 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021885730000000001 2024-04-26T07:50:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960958+0000", 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8711999999999999e-05 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960973+0000", 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5855e-05 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961069+0000", 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5229000000000006e-05 2024-04-26T07:50:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961252+0000", 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183573 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961380+0000", 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012739699999999999 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970375+0000", 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089949120000000007 2024-04-26T07:50:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971060+0000", 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068572900000000005 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971112+0000", 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1697000000000003e-05 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971161+0000", 2024-04-26T07:50:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9209000000000003e-05 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2215 3.0 3:031fd526:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.925398833999999, 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01231753, 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2215 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998870+0000", 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0879999999999999e-06 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000428+0000", 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001558083 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000457+0000", 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.864e-05 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000468+0000", 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1097000000000001e-05 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000538+0000", 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9671000000000004e-05 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000706+0000", 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168417 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000835+0000", 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012877599999999999 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.005328+0000", 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044927129999999997 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011073+0000", 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057450840000000001 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011130+0000", 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6997000000000003e-05 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011185+0000", 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4963999999999998e-05 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2216 3.1a e59/17 3:5801baf3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_105:head v 59'4, mlcod=58'2)", 2024-04-26T07:50:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.909054848, 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011266452, 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0200000000000001e-07 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020123+0000", 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049112399999999999 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020158+0000", 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5015000000000003e-05 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020175+0000", 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7099e-05 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020284+0000", 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010912 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020320+0000", 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6316000000000003e-05 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026418+0000", 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060978500000000001 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026478+0000", 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.961e-05 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2223 3.3e 3:7c169570:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.836150462999999, 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010053697, 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2223 2024-04-26T07:50:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088119+0000", 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.676e-06 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090038+0000", 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019183690000000001 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090064+0000", 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6177e-05 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090079+0000", 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4939999999999999e-05 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090147+0000", 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8480999999999997e-05 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090280+0000", 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013264900000000001 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090396+0000", 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011664599999999999 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.095595+0000", 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051988010000000003 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098039+0000", 2024-04-26T07:50:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024432920000000001 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098109+0000", 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0604000000000004e-05 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098169+0000", 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0062000000000002e-05 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2225 3.3e 3:7e14b81a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.815138580999999, 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010006395, 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2225 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109129+0000", 2024-04-26T07:50:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.643e-06 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110799+0000", 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016698679999999999 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110830+0000", 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0642999999999998e-05 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110842+0000", 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2407e-05 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110918+0000", 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6191000000000003e-05 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.111053+0000", 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013477300000000001 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.111184+0000", 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013110199999999999 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.116228+0000", 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050444180000000002 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119016+0000", 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002787866 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119075+0000", 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8585999999999998e-05 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119134+0000", 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8897999999999998e-05 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.716818189000001, 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2235 3.25 3:a5eb05f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.697293407, 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010713906, 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2235 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226976+0000", 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228832+0000", 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001856702 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228861+0000", 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8861999999999999e-05 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228874+0000", 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228966+0000", 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2201999999999996e-05 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229169+0000", 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020313199999999999 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229345+0000", 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017556399999999999 2024-04-26T07:50:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.236963+0000", 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076176789999999996 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237572+0000", 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000609155 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237632+0000", 2024-04-26T07:50:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0523000000000003e-05 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237686+0000", 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4150000000000002e-05 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:01.040 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:01.041 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:01.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:01.043 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:01.043+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:01.143 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:01.143+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:01.220 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:01.220 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:01.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:01.244 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:01.242+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:01.248 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:01.248 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:01.265 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:01.266 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:01.282 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:01.301 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:01.301 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:01.321 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:01.322 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:01.344 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:01.344 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:01.344 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:01.342+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:01.365 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:01.365 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:01.367 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:01.367 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:01.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:01.387 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:01.445 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:01.442+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:01.504 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:01.504 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:01.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:01.546 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:01.542+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:01.645 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:01.646 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:01.647 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:01.646+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:01.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:01.747 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:01.746+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:01.788 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:01.788 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:01.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:01.849 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:01.846+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:01.932 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:01.933 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:01.946 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:50:01.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:01.992 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:01.991+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:02.051 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:02.046+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:02.081 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:02.081 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:02.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:02.183 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:02.182+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:02.253 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:02.251+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:02.265 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:02.265 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:02.280 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:02.354 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:02.351+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:02.443 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:02.443 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:02.455 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:02.450+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:02.458 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:02.555 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:02.555+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:02.628 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:02.629 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:02.643 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:02.687 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:02.686+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:02.757 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:02.754+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:02.760 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:02.760 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:02.775 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:02.867 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:02.866+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:02.930 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:50:02.947 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:02.948 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:02.958 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:02.955+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:02.962 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:03.059 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:03.059+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:03.129 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:03.129 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:03.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:03.160 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:03.159+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:03.260 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:03.260 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:03.261 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:03.258+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:03.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:03.362 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:03.358+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:03.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:03.437 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:03.438 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:03.452 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:03.463 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:03.463+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:03.555 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:03.564 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:03.562+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:03.573 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:03.590 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:03.590 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:03.606 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:03.620 INFO:tasks.workunit.client.0.smithi053.stderr:200+0 records in 2024-04-26T07:50:03.620 INFO:tasks.workunit.client.0.smithi053.stderr:200+0 records out 2024-04-26T07:50:03.620 INFO:tasks.workunit.client.0.smithi053.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 19.4706 s, 108 MB/s 2024-04-26T07:50:03.621 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:03.621 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:03.627 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:03.627 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:03.636 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:03.646 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:03.646 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:03.665 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:03.663+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:03.674 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:03.675 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:03.695 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:03.695 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:03.766 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:03.762+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:03.793 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_50_03 2024-04-26T07:50:03.811 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:03.811 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:03.811 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:03.811 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:03.811 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:03.825 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:03.867 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:03.867+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:03.967 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:03.967+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:03.996 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:03.996 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.537529648, 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:03.997 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:03.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:50:03.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:50:04.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.003 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.25249593700001, 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:04.004 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:50:04.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.009 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.252457104, 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:04.010 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:50:04.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.015 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.252419074, 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:50:04.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:50:04.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:50:04.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:50:04.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:04.021 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.252297521, 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:50:04.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:04.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:04.027 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.252257552, 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:50:04.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:50:04.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:50:04.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2103 3.3b 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.734605893000001, 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025234304999999999, 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.034 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2103 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259416+0000", 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6260000000000001e-06 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.265987+0000", 2024-04-26T07:50:04.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00657108 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266029+0000", 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1155999999999997e-05 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266055+0000", 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6597e-05 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266194+0000", 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013830200000000001 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266432+0000", 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023884199999999999 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266641+0000", 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020863199999999999 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.279877+0000", 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013236346 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284529+0000", 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046518210000000004 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284593+0000", 2024-04-26T07:50:04.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3723e-05 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284647+0000", 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.418e-05 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2108 3.f 3:f0ee051f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:50:04.040 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.643500230000001, 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020717233000000002, 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2108 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:50:04.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350520+0000", 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7269999999999999e-06 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358048+0000", 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075278059999999997 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358071+0000", 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3523000000000002e-05 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358083+0000", 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1265e-05 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358172+0000", 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9582999999999999e-05 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358326+0000", 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015335899999999999 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358454+0000", 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0001282 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.364823+0000", 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063690309999999998 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371105+0000", 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062825310000000001 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371167+0000", 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1532999999999995e-05 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371236+0000", 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8675000000000002e-05 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2139 3.e 3:7390af0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.242757913999998, 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024095845000000001, 2024-04-26T07:50:04.046 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2139 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:50:04.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751265+0000", 2024-04-26T07:50:04.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2729999999999996e-06 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.758971+0000", 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077062930000000003 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759009+0000", 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7429999999999999e-05 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759027+0000", 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8323000000000001e-05 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759223+0000", 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000196386 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759474+0000", 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250175 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759705+0000", 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000230998 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.774391+0000", 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014686296999999999 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775046+0000", 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065485499999999998 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775220+0000", 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017439899999999999 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775357+0000", 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013641599999999999 2024-04-26T07:50:04.052 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2141 3.e 3:73fc2b27:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.194734794999999, 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683983999999999, 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.053 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2141 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:50:04.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799288+0000", 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-06 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803704+0000", 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044163680000000004 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803745+0000", 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0836e-05 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803764+0000", 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8743e-05 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803912+0000", 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014867299999999999 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804192+0000", 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027982799999999998 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804430+0000", 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238435 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816451+0000", 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012020507 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819796+0000", 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033448689999999999 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819890+0000", 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3795999999999994e-05 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819968+0000", 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8208999999999996e-05 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.062 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2142 3.15 3:a87525cc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.177635717000001, 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022647812, 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.063 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2142 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816387+0000", 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2560000000000004e-06 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822782+0000", 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063953079999999997 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822812+0000", 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9876999999999999e-05 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822833+0000", 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1013e-05 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823017+0000", 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018354499999999999 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823252+0000", 2024-04-26T07:50:04.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234832 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823515+0000", 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026311800000000001 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.836859+0000", 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01334453 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838722+0000", 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018625650000000001 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838882+0000", 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015986200000000001 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839031+0000", 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148906 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2150 3.39 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.974932046999999, 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025377047, 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.069 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2150 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019089+0000", 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3590000000000002e-06 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023640+0000", 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045514700000000002 2024-04-26T07:50:04.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023666+0000", 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5384e-05 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023680+0000", 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3981999999999999e-05 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023757+0000", 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7249999999999994e-05 2024-04-26T07:50:04.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023912+0000", 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015499900000000001 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.024032+0000", 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119628 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.034967+0000", 2024-04-26T07:50:04.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010935823000000001 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044357+0000", 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093895449999999991 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044412+0000", 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5359999999999999e-05 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044464+0000", 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1246999999999999e-05 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2168 3.2d 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.539400183000001, 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026862164000000001, 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.075 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2168 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454622+0000", 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459549+0000", 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049275710000000004 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459589+0000", 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9387000000000001e-05 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459609+0000", 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0392999999999999e-05 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459751+0000", 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014207900000000001 2024-04-26T07:50:04.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459996+0000", 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024460500000000001 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.460226+0000", 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023053200000000001 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.469147+0000", 2024-04-26T07:50:04.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089203549999999996 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481152+0000", 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012005386999999999 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481352+0000", 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020005199999999999 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481481+0000", 2024-04-26T07:50:04.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012850900000000001 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2183 3.37 3:ef675d97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.344835989, 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019732288000000001, 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.081 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2183 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649185+0000", 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8200000000000001e-06 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655471+0000", 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062857750000000004 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655498+0000", 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7029000000000002e-05 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655509+0000", 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0813e-05 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655609+0000", 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9953999999999999e-05 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655801+0000", 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000192189 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655983+0000", 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018226200000000001 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668782+0000", 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012798886000000001 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668801+0000", 2024-04-26T07:50:04.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377999999999999e-05 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668856+0000", 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5265e-05 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668915+0000", 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8916999999999999e-05 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2205 3.14 e59/17 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.095698617, 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020789596, 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:50:04.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898321+0000", 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6400000000000001e-07 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902172+0000", 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003850787 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902208+0000", 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5952999999999999e-05 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902230+0000", 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1987000000000001e-05 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902392+0000", 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162344 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902418+0000", 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5953e-05 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919038+0000", 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016620234000000001 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919110+0000", 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1474e-05 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2207 3.3f 3:fe080a1d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.078473279000001, 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021701979999999999, 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.092 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2207 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:50:04.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915549+0000", 2024-04-26T07:50:04.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1200000000000004e-06 2024-04-26T07:50:04.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921046+0000", 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054969049999999998 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921067+0000", 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0724e-05 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921079+0000", 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1533e-05 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921145+0000", 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6662000000000007e-05 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921267+0000", 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121889 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921388+0000", 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120449 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934035+0000", 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012647818 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937179+0000", 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003143065 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937218+0000", 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9662000000000001e-05 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937247+0000", 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9153e-05 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2213 3.f 3:f1254826:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.015310083999999, 2024-04-26T07:50:04.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021396413, 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2213 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978713+0000", 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982948+0000", 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042354690000000004 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982982+0000", 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3683000000000003e-05 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983002+0000", 2024-04-26T07:50:04.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9599999999999999e-05 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983200+0000", 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000198715 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983466+0000", 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026605500000000001 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983722+0000", 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025512499999999998 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.994151+0000", 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010429528 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999893+0000", 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057413860000000002 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999992+0000", 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9689e-05 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.000105+0000", 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112766 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2217 3.2b e59/17 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:04.105 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.970560853999999, 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044994659999999999, 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6300000000000005e-07 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032526+0000", 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090671680000000004 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032570+0000", 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4039000000000003e-05 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032593+0000", 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3873e-05 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032774+0000", 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018014300000000001 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032819+0000", 2024-04-26T07:50:04.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5713000000000001e-05 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068399+0000", 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.035580053 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068452+0000", 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3108e-05 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.109 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.110 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2219 3.d 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:04.110 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:50:04.110 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.954352672999999, 2024-04-26T07:50:04.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029242280999999998, 2024-04-26T07:50:04.110 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.110 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.111 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.111 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:04.111 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:04.111 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.111 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2219 2024-04-26T07:50:04.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.111 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:50:04.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:50:04.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:50:04.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4999999999999999e-06 2024-04-26T07:50:04.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046427+0000", 2024-04-26T07:50:04.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067579299999999997 2024-04-26T07:50:04.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046452+0000", 2024-04-26T07:50:04.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4341999999999998e-05 2024-04-26T07:50:04.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046465+0000", 2024-04-26T07:50:04.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3434999999999999e-05 2024-04-26T07:50:04.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046565+0000", 2024-04-26T07:50:04.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9584000000000001e-05 2024-04-26T07:50:04.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046729+0000", 2024-04-26T07:50:04.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016413300000000001 2024-04-26T07:50:04.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:04.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046851+0000", 2024-04-26T07:50:04.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012242199999999999 2024-04-26T07:50:04.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068781+0000", 2024-04-26T07:50:04.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021930021000000001 2024-04-26T07:50:04.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:04.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068797+0000", 2024-04-26T07:50:04.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6123000000000001e-05 2024-04-26T07:50:04.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068862+0000", 2024-04-26T07:50:04.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.457e-05 2024-04-26T07:50:04.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068908+0000", 2024-04-26T07:50:04.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6220999999999997e-05 2024-04-26T07:50:04.120 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.120 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.120 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2247 3.14 e59/17 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head v 59'5, mlcod=59'3)", 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.615813073999998, 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019349376000000001, 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:04.121 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378209+0000", 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0929999999999999e-06 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381273+0000", 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00306456 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381314+0000", 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0519000000000003e-05 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381331+0000", 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7547e-05 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381492+0000", 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000160979 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381553+0000", 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0962999999999999e-05 2024-04-26T07:50:04.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397406+0000", 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015853145999999999 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397555+0000", 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014856900000000001 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:04.125 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:04.126 INFO:tasks.workunit.client.0.smithi053.stdout:bucket quota max size set for the given user: buck_2024_03_26_07_50_03 2024-04-26T07:50:04.127 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:04.126+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:04.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:04.228 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:04.226+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:04.243 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:04.243 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:04.243 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:04.243 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:04.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:04.329 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:04.327+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:04.365 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:04.365 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:04.365 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:04.365 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:04.365 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:04.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:04.472 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:04.471+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:04.531 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:04.530+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1113 3.6 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.285094018999999, 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015424972, 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.555 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1113 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:04.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266304+0000", 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6060000000000001e-06 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270480+0000", 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041759689999999999 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270523+0000", 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2908000000000003e-05 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270541+0000", 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8790000000000001e-05 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270636+0000", 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4690000000000003e-05 2024-04-26T07:50:04.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270821+0000", 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018512100000000001 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271288+0000", 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046690099999999998 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.280701+0000", 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0094125839999999999 2024-04-26T07:50:04.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281610+0000", 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090926400000000001 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281676+0000", 2024-04-26T07:50:04.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5809999999999995e-05 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281726+0000", 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0328999999999999e-05 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2110 3.23 3:c664601d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.169092543000001, 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017472562000000001, 2024-04-26T07:50:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2110 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:04.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:04.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382305+0000", 2024-04-26T07:50:04.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6630000000000002e-06 2024-04-26T07:50:04.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.384976+0000", 2024-04-26T07:50:04.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026707620000000001 2024-04-26T07:50:04.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385010+0000", 2024-04-26T07:50:04.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.358e-05 2024-04-26T07:50:04.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385026+0000", 2024-04-26T07:50:04.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6487999999999999e-05 2024-04-26T07:50:04.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385180+0000", 2024-04-26T07:50:04.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153609 2024-04-26T07:50:04.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385551+0000", 2024-04-26T07:50:04.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000370971 2024-04-26T07:50:04.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:04.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385906+0000", 2024-04-26T07:50:04.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035550399999999998 2024-04-26T07:50:04.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.397683+0000", 2024-04-26T07:50:04.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011776426 2024-04-26T07:50:04.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399475+0000", 2024-04-26T07:50:04.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001792837 2024-04-26T07:50:04.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399663+0000", 2024-04-26T07:50:04.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018749500000000001 2024-04-26T07:50:04.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399775+0000", 2024-04-26T07:50:04.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011222699999999999 2024-04-26T07:50:04.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.572 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.572 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2114 3.10 e58/17 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.096496220999999, 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014481571, 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:04.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454902+0000", 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7800000000000001e-06 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459802+0000", 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049001319999999998 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459839+0000", 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7055999999999999e-05 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459855+0000", 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6345e-05 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460023+0000", 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167579 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460071+0000", 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8046e-05 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469193+0000", 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091217039999999996 2024-04-26T07:50:04.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469380+0000", 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018792900000000001 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2115 3.12 3:48da4f83:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.089951473999999, 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020926337, 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.577 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2115 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:04.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461447+0000", 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464785+0000", 2024-04-26T07:50:04.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033385540000000001 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464814+0000", 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9167e-05 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464832+0000", 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8097999999999999e-05 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464996+0000", 2024-04-26T07:50:04.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016315399999999999 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465292+0000", 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029592699999999997 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465562+0000", 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027075899999999997 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.477813+0000", 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012250749 2024-04-26T07:50:04.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482150+0000", 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043364340000000001 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482260+0000", 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110204 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482370+0000", 2024-04-26T07:50:04.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110234 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2124 3.12 3:48cdd107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.918162848000001, 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017263152, 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2124 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633237+0000", 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2690000000000001e-06 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637016+0000", 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037793480000000001 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637055+0000", 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9138999999999999e-05 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637073+0000", 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8070000000000001e-05 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637251+0000", 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017822500000000001 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637652+0000", 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040054000000000001 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.638078+0000", 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042600299999999999 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.647434+0000", 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093557510000000007 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650193+0000", 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027596180000000001 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650366+0000", 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017236899999999999 2024-04-26T07:50:04.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650495+0000", 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012982 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2125 3.17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.895367728, 2024-04-26T07:50:04.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02199247, 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2125 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:04.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:04.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656030+0000", 2024-04-26T07:50:04.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:50:04.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.658975+0000", 2024-04-26T07:50:04.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029456349999999998 2024-04-26T07:50:04.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659019+0000", 2024-04-26T07:50:04.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3405999999999997e-05 2024-04-26T07:50:04.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659046+0000", 2024-04-26T07:50:04.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6659e-05 2024-04-26T07:50:04.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659219+0000", 2024-04-26T07:50:04.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017387300000000001 2024-04-26T07:50:04.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659499+0000", 2024-04-26T07:50:04.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279926 2024-04-26T07:50:04.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:04.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659769+0000", 2024-04-26T07:50:04.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026926000000000001 2024-04-26T07:50:04.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.668218+0000", 2024-04-26T07:50:04.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084496710000000006 2024-04-26T07:50:04.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677830+0000", 2024-04-26T07:50:04.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096117779999999996 2024-04-26T07:50:04.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677932+0000", 2024-04-26T07:50:04.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010155800000000001 2024-04-26T07:50:04.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.678020+0000", 2024-04-26T07:50:04.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8211e-05 2024-04-26T07:50:04.600 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.600 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.601 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.601 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2150 3.39 e58/17 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:04.601 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:04.601 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.527490577999998, 2024-04-26T07:50:04.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019626325999999999, 2024-04-26T07:50:04.602 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.602 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.602 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.602 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023907+0000", 2024-04-26T07:50:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.576e-06 2024-04-26T07:50:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032657+0000", 2024-04-26T07:50:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0087502129999999997 2024-04-26T07:50:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032704+0000", 2024-04-26T07:50:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7024999999999998e-05 2024-04-26T07:50:04.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032725+0000", 2024-04-26T07:50:04.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1002999999999999e-05 2024-04-26T07:50:04.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032879+0000", 2024-04-26T07:50:04.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015357599999999999 2024-04-26T07:50:04.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032924+0000", 2024-04-26T07:50:04.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5509000000000001e-05 2024-04-26T07:50:04.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043391+0000", 2024-04-26T07:50:04.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010466787 2024-04-26T07:50:04.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043531+0000", 2024-04-26T07:50:04.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013963699999999999 2024-04-26T07:50:04.611 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.611 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.611 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.612 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2154 3.6 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.612 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:04.612 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.430026407, 2024-04-26T07:50:04.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018109798999999999, 2024-04-26T07:50:04.612 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.613 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.613 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.613 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.613 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.613 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.613 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2154 2024-04-26T07:50:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121373+0000", 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8829999999999999e-06 2024-04-26T07:50:04.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124488+0000", 2024-04-26T07:50:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031152179999999999 2024-04-26T07:50:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124534+0000", 2024-04-26T07:50:04.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6615e-05 2024-04-26T07:50:04.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124555+0000", 2024-04-26T07:50:04.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0377000000000002e-05 2024-04-26T07:50:04.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124721+0000", 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000166226 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125056+0000", 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033541799999999998 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125363+0000", 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030636900000000002 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.138525+0000", 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013161806 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139390+0000", 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00086512899999999996 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139439+0000", 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8795000000000003e-05 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139478+0000", 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9962999999999997e-05 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2156 3.2b 3:d74e6742:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.379580147999999, 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017757953999999999, 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2156 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171819+0000", 2024-04-26T07:50:04.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5159999999999996e-06 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174698+0000", 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028785109999999998 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174739+0000", 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0544999999999999e-05 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174757+0000", 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8267e-05 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174970+0000", 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021284799999999999 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175288+0000", 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031840500000000001 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:04.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175516+0000", 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022821500000000001 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.183262+0000", 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077455629999999996 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189370+0000", 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061082590000000004 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189505+0000", 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134554 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189573+0000", 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8270999999999997e-05 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2165 3.12 3:48c02635:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.626 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.156495142000001, 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021758514999999999, 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2165 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394904+0000", 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398287+0000", 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033835380000000002 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398343+0000", 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5148999999999997e-05 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398365+0000", 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2688999999999999e-05 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398525+0000", 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159801 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398876+0000", 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035097600000000002 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.399237+0000", 2024-04-26T07:50:04.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036067100000000002 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.409713+0000", 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010476348 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416491+0000", 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067777569999999997 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416579+0000", 2024-04-26T07:50:04.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412000000000007e-05 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416658+0000", 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9231000000000001e-05 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.632 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2167 3.23 3:c5a42c94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.115421676, 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015687599999999999, 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2167 2024-04-26T07:50:04.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435977+0000", 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9899999999999999e-06 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439816+0000", 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038388860000000001 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439841+0000", 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4632000000000001e-05 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439855+0000", 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.415e-05 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440055+0000", 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019957199999999999 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440486+0000", 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043156999999999999 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440829+0000", 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034250799999999999 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.449821+0000", 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.008992033 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451400+0000", 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001579502 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451504+0000", 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010365399999999999 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451661+0000", 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015710299999999999 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.638 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2169 3.3d 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.085463236999999, 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016653068, 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.639 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2169 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465937+0000", 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0359999999999997e-06 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468355+0000", 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024184660000000002 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468411+0000", 2024-04-26T07:50:04.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5594000000000003e-05 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468440+0000", 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8683e-05 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468600+0000", 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000160061 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468843+0000", 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000243076 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.469075+0000", 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023207999999999999 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.476674+0000", 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0075994410000000002 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482385+0000", 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057110879999999996 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482521+0000", 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135241 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482585+0000", 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4301999999999995e-05 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2170 3.12 3:48f78380:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.071652196999999, 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019689475000000001, 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2170 2024-04-26T07:50:04.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479749+0000", 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7130000000000002e-06 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481893+0000", 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002144048 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481950+0000", 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7192999999999999e-05 2024-04-26T07:50:04.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481979+0000", 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9414999999999999e-05 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482084+0000", 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105105 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482257+0000", 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173053 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482414+0000", 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000156498 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.489832+0000", 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074180399999999999 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499155+0000", 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093232509999999994 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499312+0000", 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015707899999999999 2024-04-26T07:50:04.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499432+0000", 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012008 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2173 3.1b 3:d9c20b7c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.015842263, 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014202282, 2024-04-26T07:50:04.651 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2173 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535556+0000", 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2370000000000001e-06 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537406+0000", 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001850108 2024-04-26T07:50:04.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537459+0000", 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2488000000000003e-05 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537483+0000", 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4839000000000001e-05 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537586+0000", 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010207199999999999 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537761+0000", 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000175482 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537909+0000", 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014747499999999999 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.543692+0000", 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057834719999999996 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549614+0000", 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059216779999999997 2024-04-26T07:50:04.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549690+0000", 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6682999999999997e-05 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549755+0000", 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4747999999999997e-05 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.657 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2190 3.17 3:ea98e33f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.829522303000001, 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017436619, 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.658 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2190 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721876+0000", 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9390000000000002e-06 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724451+0000", 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025750019999999998 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724476+0000", 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4811e-05 2024-04-26T07:50:04.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724490+0000", 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4949e-05 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724564+0000", 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3774000000000002e-05 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724694+0000", 2024-04-26T07:50:04.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012977099999999999 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724806+0000", 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011196099999999999 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.732550+0000", 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077441649999999999 2024-04-26T07:50:04.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739171+0000", 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066207799999999997 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739249+0000", 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8095000000000004e-05 2024-04-26T07:50:04.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739309+0000", 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0371999999999997e-05 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2200 3.1 3:80d4e2c6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.717831143000002, 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015722348000000001, 2024-04-26T07:50:04.664 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2200 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833566+0000", 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7460000000000001e-06 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835679+0000", 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021130960000000001 2024-04-26T07:50:04.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835704+0000", 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5194e-05 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835716+0000", 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2326e-05 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835834+0000", 2024-04-26T07:50:04.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117939 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835968+0000", 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013391499999999999 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.836142+0000", 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017374600000000001 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.840818+0000", 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046765790000000002 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849134+0000", 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0083158650000000004 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849234+0000", 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9629000000000004e-05 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849286+0000", 2024-04-26T07:50:04.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2312999999999999e-05 2024-04-26T07:50:04.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.670 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.670 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2201 3.30 e58/17 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:04.670 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:04.673 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.702265781000001, 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015421710999999999, 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849130+0000", 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858099+0000", 2024-04-26T07:50:04.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089693169999999992 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858132+0000", 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2573000000000001e-05 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858146+0000", 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3750999999999999e-05 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858247+0000", 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101265 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858271+0000", 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4006e-05 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864493+0000", 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062218079999999997 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864551+0000", 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8408e-05 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2217 3.2b 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.531755102999998, 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.048883261999999997, 2024-04-26T07:50:04.678 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2217 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019644+0000", 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9729999999999999e-06 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022277+0000", 2024-04-26T07:50:04.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026334779999999999 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022312+0000", 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4737000000000003e-05 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022324+0000", 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1770000000000001e-05 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022410+0000", 2024-04-26T07:50:04.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.598e-05 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022601+0000", 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019102100000000001 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022771+0000", 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017026500000000001 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.029808+0000", 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070363259999999999 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068387+0000", 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.038579667999999998 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068459+0000", 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1649000000000005e-05 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068523+0000", 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4394999999999996e-05 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2238 3.12 3:4adae178:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.279973346999999, 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015875822000000001, 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.684 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2238 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271425+0000", 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.039e-06 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273472+0000", 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020474669999999999 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273520+0000", 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7289000000000001e-05 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273539+0000", 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9222999999999999e-05 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273640+0000", 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100833 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273805+0000", 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000165854 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273934+0000", 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000128331 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.281376+0000", 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074421349999999999 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287206+0000", 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058303369999999997 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287258+0000", 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1412000000000002e-05 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287298+0000", 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9901999999999998e-05 2024-04-26T07:50:04.689 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2239 3.3 e59/17 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.260531542999999, 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015017188000000001, 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290865+0000", 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6759999999999999e-06 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296505+0000", 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00564001 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296547+0000", 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2256000000000003e-05 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296565+0000", 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7856e-05 2024-04-26T07:50:04.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296653+0000", 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8113000000000002e-05 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296681+0000", 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7818999999999999e-05 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305803+0000", 2024-04-26T07:50:04.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.009121901 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305881+0000", 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7557000000000003e-05 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:04.694 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:04.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:04.696 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:04.694+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:04.797 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:04.798+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:04.853 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:04.854 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:04.854 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:04.854 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:04.866 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:04.911 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:04.911+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:04.958 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:50:04.990 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:04.991 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:04.999 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:04.999+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:05.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:05.099 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:05.099+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:05.166 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:05.166 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:05.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:05.166 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:05.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 92.506647192000003, 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:50:05.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1110 3.25 3:a41b494f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:05.172 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.920885902000002, 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012576264, 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1110 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243099+0000", 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.091e-06 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245358+0000", 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022582739999999998 2024-04-26T07:50:05.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245385+0000", 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7535999999999999e-05 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245398+0000", 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2965e-05 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245462+0000", 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4150000000000001e-05 2024-04-26T07:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245564+0000", 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101828 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245651+0000", 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7503999999999994e-05 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.252240+0000", 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065883399999999998 2024-04-26T07:50:05.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255588+0000", 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00334805 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255640+0000", 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1904000000000003e-05 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255673+0000", 2024-04-26T07:50:05.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3621999999999998e-05 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:1113 3.6 e53/17 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head v 53'1, mlcod=0'0)", 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.892498156000002, 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098513860000000002, 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271487+0000", 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.013e-06 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274777+0000", 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032900289999999999 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274803+0000", 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5765000000000001e-05 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274817+0000", 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4678000000000001e-05 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274943+0000", 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125394 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274986+0000", 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2759000000000002e-05 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281271+0000", 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062853789999999998 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281336+0000", 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5369000000000004e-05 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.846316163000001, 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:05.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:05.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.681657419, 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:05.188 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:05.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:05.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.659783378, 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.194 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.199 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.116984391999999, 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:05.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.064894539000001, 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.204 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:05.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.208 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.038406211000002, 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:05.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:05.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.212 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.870141, 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:05.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:05.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2181 3.25 3:a4112efc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.536354648, 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098076180000000006, 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.218 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2181 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627646+0000", 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7272e-05 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629343+0000", 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016969470000000001 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629378+0000", 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4953999999999998e-05 2024-04-26T07:50:05.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629393+0000", 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4956e-05 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629486+0000", 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3129999999999998e-05 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629645+0000", 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015958300000000001 2024-04-26T07:50:05.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629784+0000", 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013875199999999999 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.636610+0000", 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068263109999999998 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637298+0000", 2024-04-26T07:50:05.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068795100000000001 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637372+0000", 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637436+0000", 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4029999999999995e-05 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.223 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.413110735, 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:05.227 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.307296349000001, 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.228 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:05.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:05.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:05.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.234 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2211 3.4 3:20747335:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.205245660999999, 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012423844999999999, 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2211 2024-04-26T07:50:05.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958740+0000", 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.959e-06 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960929+0000", 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021885730000000001 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960958+0000", 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8711999999999999e-05 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960973+0000", 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5855e-05 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961069+0000", 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5229000000000006e-05 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961252+0000", 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183573 2024-04-26T07:50:05.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961380+0000", 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012739699999999999 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970375+0000", 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089949120000000007 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971060+0000", 2024-04-26T07:50:05.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068572900000000005 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971112+0000", 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1697000000000003e-05 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971161+0000", 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9209000000000003e-05 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.240 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2215 3.0 3:031fd526:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.165115943, 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01231753, 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2215 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:05.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998870+0000", 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0879999999999999e-06 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000428+0000", 2024-04-26T07:50:05.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001558083 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000457+0000", 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.864e-05 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000468+0000", 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1097000000000001e-05 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000538+0000", 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9671000000000004e-05 2024-04-26T07:50:05.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000706+0000", 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168417 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000835+0000", 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012877599999999999 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.005328+0000", 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044927129999999997 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011073+0000", 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057450840000000001 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011130+0000", 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6997000000000003e-05 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011185+0000", 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4963999999999998e-05 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.245 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2216 3.1a e59/17 3:5801baf3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_105:head v 59'4, mlcod=58'2)", 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.148771957000001, 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011266452, 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0200000000000001e-07 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020123+0000", 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049112399999999999 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020158+0000", 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5015000000000003e-05 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020175+0000", 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7099e-05 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020284+0000", 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010912 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020320+0000", 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6316000000000003e-05 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026418+0000", 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060978500000000001 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026478+0000", 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.961e-05 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2223 3.3e 3:7c169570:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.075867572, 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010053697, 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.250 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2223 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088119+0000", 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.676e-06 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090038+0000", 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019183690000000001 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090064+0000", 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6177e-05 2024-04-26T07:50:05.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090079+0000", 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4939999999999999e-05 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090147+0000", 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8480999999999997e-05 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090280+0000", 2024-04-26T07:50:05.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013264900000000001 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090396+0000", 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011664599999999999 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.095595+0000", 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051988010000000003 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098039+0000", 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024432920000000001 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098109+0000", 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0604000000000004e-05 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098169+0000", 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0062000000000002e-05 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2225 3.3e 3:7e14b81a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.05485569, 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010006395, 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2225 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109129+0000", 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.643e-06 2024-04-26T07:50:05.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110799+0000", 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016698679999999999 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110830+0000", 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0642999999999998e-05 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110842+0000", 2024-04-26T07:50:05.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2407e-05 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110918+0000", 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6191000000000003e-05 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.111053+0000", 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013477300000000001 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.111184+0000", 2024-04-26T07:50:05.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013110199999999999 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.116228+0000", 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050444180000000002 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119016+0000", 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002787866 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119075+0000", 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8585999999999998e-05 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119134+0000", 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8897999999999998e-05 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:05.261 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.956535297999999, 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2235 3.25 3:a5eb05f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.937010516000001, 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010713906, 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.267 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2235 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226976+0000", 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228832+0000", 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001856702 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228861+0000", 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8861999999999999e-05 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228874+0000", 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228966+0000", 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2201999999999996e-05 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229169+0000", 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020313199999999999 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229345+0000", 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017556399999999999 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.236963+0000", 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076176789999999996 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237572+0000", 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000609155 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237632+0000", 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0523000000000003e-05 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237686+0000", 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4150000000000002e-05 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.272 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:05.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:05.274 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:05.271+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:05.323 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:50:05.395 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:05.395+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:05.431 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:05.431 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:05.431 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:05.431 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:05.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:05.487 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:05.487+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:05.576 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:05.575+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:05.604 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:05.604 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:05.604 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:05.604 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:05.604 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:05.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:05.676 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:05.674+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:05.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:05.777 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:05.775+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1840 4.34 4:2d4d6bac:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.265725760000002, 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006653356, 2024-04-26T07:50:05.783 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1840 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515123+0000", 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.652e-06 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515132+0000", 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.884e-06 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515155+0000", 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3323999999999999e-05 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515169+0000", 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3828999999999999e-05 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515237+0000", 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7949999999999998e-05 2024-04-26T07:50:05.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515378+0000", 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014126199999999999 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515534+0000", 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155661 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.516132+0000", 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00059858100000000005 2024-04-26T07:50:05.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521715+0000", 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055827359999999996 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521748+0000", 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3136000000000003e-05 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521774+0000", 2024-04-26T07:50:05.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6341000000000001e-05 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2103 3.3b e58/17 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.514278536999999, 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017139903000000001, 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266571+0000", 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5859999999999999e-06 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275000+0000", 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084295080000000005 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275062+0000", 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1579000000000001e-05 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275091+0000", 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8563000000000001e-05 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275209+0000", 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118866 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275240+0000", 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0372999999999999e-05 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283650+0000", 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084105450000000002 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283708+0000", 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7883000000000001e-05 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2107 3.2d e58/17 3:b4925b2e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_6:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.447516425, 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012595189, 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333333+0000", 2024-04-26T07:50:05.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2639999999999998e-06 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337333+0000", 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004000605 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337358+0000", 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4241999999999999e-05 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337370+0000", 2024-04-26T07:50:05.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2387e-05 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337563+0000", 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000192635 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337602+0000", 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9135999999999999e-05 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.345823+0000", 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082215599999999993 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.345926+0000", 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010236 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.797 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2113 3.2d e58/17 3:b71e74a3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_12:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.338034704000002, 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012014733, 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442814+0000", 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8169999999999999e-06 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446730+0000", 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0039164589999999997 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446765+0000", 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4758999999999997e-05 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446781+0000", 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5733999999999999e-05 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446914+0000", 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013332200000000001 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446951+0000", 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7104999999999998e-05 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454717+0000", 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077659970000000002 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454827+0000", 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010954 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.801 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2117 3.4 e58/17 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 25.271915628999999, 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010325226, 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:05.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508934+0000", 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7030000000000002e-06 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511870+0000", 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002935736 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511919+0000", 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8962000000000003e-05 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511944+0000", 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5216e-05 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.512056+0000", 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011173 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.512087+0000", 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1256e-05 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519161+0000", 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070740819999999998 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519256+0000", 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5540999999999999e-05 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.813806532000001, 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.806 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:05.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.811 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2149 3.2e 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.788221206999999, 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016993692000000001, 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2149 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.812 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992628+0000", 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5959999999999998e-06 2024-04-26T07:50:05.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995727+0000", 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003098506 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995778+0000", 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0868999999999997e-05 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995797+0000", 2024-04-26T07:50:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9128999999999999e-05 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995958+0000", 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016100199999999999 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996233+0000", 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027535400000000001 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996496+0000", 2024-04-26T07:50:05.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026286700000000002 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.007925+0000", 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011428880000000001 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009253+0000", 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013284150000000001 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009433+0000", 2024-04-26T07:50:05.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017974500000000001 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009619+0000", 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000186329 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.713058819, 2024-04-26T07:50:05.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:05.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:05.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:05.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2158 3.1c 3:38bce1b3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.559955744, 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015533498, 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.823 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2158 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220895+0000", 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7929999999999999e-06 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224209+0000", 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033143500000000002 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224260+0000", 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0515e-05 2024-04-26T07:50:05.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224288+0000", 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8189999999999999e-05 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224463+0000", 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174909 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224695+0000", 2024-04-26T07:50:05.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023159799999999999 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224998+0000", 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030391199999999999 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.234190+0000", 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091915550000000006 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236135+0000", 2024-04-26T07:50:05.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019451430000000001 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236300+0000", 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016472000000000001 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236425+0000", 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012481300000000001 2024-04-26T07:50:05.828 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2161 3.0 e58/17 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.483281737999999, 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016578915999999999, 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297568+0000", 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7999999999999999e-06 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300910+0000", 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033417189999999999 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300956+0000", 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6139e-05 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300975+0000", 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8856e-05 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301137+0000", 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162583 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301205+0000", 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7627999999999997e-05 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314035+0000", 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012830187 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314144+0000", 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109004 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.411346307999999, 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.833 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:05.838 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.320587182000001, 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2169 3.3d e58/17 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.310759195999999, 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01191763, 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470089+0000", 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.798e-06 2024-04-26T07:50:05.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474285+0000", 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041955780000000002 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474328+0000", 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2709000000000001e-05 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474352+0000", 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4273e-05 2024-04-26T07:50:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474456+0000", 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000103523 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474484+0000", 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8538999999999999e-05 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481924+0000", 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074399030000000003 2024-04-26T07:50:05.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482005+0000", 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1306999999999999e-05 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2194 3.1e 3:79c69c28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.012655232, 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013321008000000001, 2024-04-26T07:50:05.847 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2194 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768194+0000", 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209999999999999e-06 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769679+0000", 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014842239999999999 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769715+0000", 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6514000000000003e-05 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769732+0000", 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6935999999999998e-05 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769841+0000", 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108564 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.770078+0000", 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000237524 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.770234+0000", 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155721 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.775501+0000", 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00526685 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781386+0000", 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058848950000000002 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781458+0000", 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1898999999999997e-05 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781513+0000", 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.516e-05 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.852 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2209 3.4 e59/17 3:22b8f135:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_98:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.842535896000001, 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0069373619999999999, 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8099999999999998e-07 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940053+0000", 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00174117 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940082+0000", 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9635999999999999e-05 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940097+0000", 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4596000000000001e-05 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940197+0000", 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940232+0000", 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5116000000000001e-05 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.945149+0000", 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049168140000000003 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.945248+0000", 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9257000000000002e-05 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2211 3.4 e59/17 3:20747335:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_100:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.819349274, 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093734109999999999, 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.857 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961499+0000", 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.855e-06 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963144+0000", 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001644656 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963183+0000", 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8469e-05 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963199+0000", 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6643e-05 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963291+0000", 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1459000000000006e-05 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963321+0000", 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0408000000000001e-05 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970797+0000", 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074760729999999997 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970871+0000", 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3848000000000002e-05 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2215 3.0 e59/17 3:031fd526:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_104:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.779905069000002, 2024-04-26T07:50:05.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098835109999999993, 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000944+0000", 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0540000000000002e-06 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003412+0000", 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024678899999999999 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003434+0000", 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2719000000000001e-05 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003446+0000", 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1798e-05 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003523+0000", 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6240000000000002e-05 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003553+0000", 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0264999999999999e-05 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.010746+0000", 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071935949999999997 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.010825+0000", 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8949999999999995e-05 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2224 3.4 e59/17 3:235f71f4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_113:head v 59'4, mlcod=59'2)", 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.679869154999999, 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071865310000000003, 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100980+0000", 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2670000000000001e-06 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102596+0000", 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00161578 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102625+0000", 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9043e-05 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102639+0000", 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3935e-05 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102724+0000", 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.564e-05 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102751+0000", 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6361000000000001e-05 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.108094+0000", 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053428759999999999 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.108164+0000", 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0629000000000004e-05 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.869 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2231 3.9 e59/17 3:90514a14:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_120:head v 59'1, mlcod=0'0)", 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.595601394999999, 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010909064, 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:05.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185246+0000", 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0999999999999999e-07 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189938+0000", 2024-04-26T07:50:05.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046919199999999996 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189957+0000", 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9358e-05 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189970+0000", 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2870999999999999e-05 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.190053+0000", 2024-04-26T07:50:05.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2515000000000005e-05 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.190079+0000", 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6871000000000001e-05 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196101+0000", 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060217939999999996 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196155+0000", 2024-04-26T07:50:05.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3325000000000002e-05 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2245 3.9 e59/17 3:91913af5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_134:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.422975080000001, 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010257782, 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:05.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357874+0000", 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0209999999999998e-06 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361945+0000", 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040714319999999998 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361977+0000", 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1256e-05 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361991+0000", 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.416e-05 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.362085+0000", 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4073999999999994e-05 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.362120+0000", 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5460000000000003e-05 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.368061+0000", 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059409179999999999 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:05.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.368130+0000", 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8460999999999994e-05 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:05.878 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:05.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:05.880 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:05.881 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:05.881 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:05.878+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:05.887 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:05.887 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:05.904 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:05.925 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:05.925 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:05.946 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:05.947 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:05.966 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:05.980 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:05.979+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:05.986 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:06.011 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:06.012 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:06.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:06.111 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:06.111+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:06.178 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:06.178 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:06.182 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:06.182+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:06.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:06.283 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:06.283+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:06.359 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:06.359 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:06.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:06.419 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:06.418+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:06.485 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:06.483+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:06.504 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:06.504 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:06.518 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:06.586 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:06.583+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:06.687 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:06.687+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:06.688 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:06.688 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:06.703 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:06.788 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:06.787+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:06.827 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:06.827 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:06.841 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:06.891 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:06.890+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:06.966 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:06.966 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:06.980 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:06.990 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:06.987+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:07.090 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:07.091+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:07.147 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:07.147 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:07.161 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:07.211 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:07.210+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:07.286 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:07.286 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:07.292 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:07.291+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:07.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:07.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:50:07.393 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:07.390+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:07.466 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:07.466 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:07.481 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:07.493 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:07.491+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:07.595 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:07.595+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:07.649 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:07.649 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:07.663 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:07.707 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:07.706+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:07.717 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:50:07.786 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:07.787 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:07.797 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:07.794+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:07.801 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:07.898 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:07.895+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:07.969 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:07.969 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:07.983 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:08.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:08.035 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:08.034+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:08.099 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:08.099+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:08.109 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:08.109 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:08.122 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:08.140 INFO:tasks.workunit.client.0.smithi053.stdout:quota enabled for the bucket: buck_2024_03_26_07_50_03 2024-04-26T07:50:08.140 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 2Gb. 2024-04-26T07:50:08.140 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:50:08.140 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-04-26T07:50:08.140 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:50:08.140 INFO:tasks.workunit.client.0.smithi053.stdout:delete objects successful 2024-04-26T07:50:08.156 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:08.157 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:08.174 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:08.174 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:08.189 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:08.190 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:08.205 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:08.206 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:08.215 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:08.214+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:08.225 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:08.244 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:08.263 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:08.263 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:08.283 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:08.284 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:08.295 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:08.295 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:08.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:08.295 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.83715949099999, 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.063492230999999996, 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.296 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456489+0000", 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456492+0000", 2024-04-26T07:50:08.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.593e-06 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456505+0000", 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3373999999999999e-05 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456527+0000", 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2008999999999999e-05 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456544+0000", 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7317e-05 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456677+0000", 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013302499999999999 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.456707+0000", 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0133000000000001e-05 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517377+0000", 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.060669997000000003 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.517824+0000", 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044626000000000003 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.518333+0000", 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00050894899999999997 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519784+0000", 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001451798 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519814+0000", 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9573e-05 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519900+0000", 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6359000000000004e-05 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.519981+0000", 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0844e-05 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.55212578, 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023954609000000002, 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.302 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 113 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741523+0000", 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741524+0000", 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4300000000000002e-07 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741531+0000", 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.17e-06 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741541+0000", 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0227000000000001e-05 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741549+0000", 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7300000000000005e-06 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759121+0000", 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017572107 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759253+0000", 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132146 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.759470+0000", 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021670399999999999 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.763957+0000", 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044876309999999997 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765269+0000", 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013119189999999999 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765360+0000", 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0610000000000002e-05 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765477+0000", 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117522 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.307 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.55208694700001, 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024157953999999999, 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 114 2024-04-26T07:50:08.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741562+0000", 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7400000000000003e-07 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741569+0000", 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2300000000000002e-06 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741580+0000", 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0066e-05 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741587+0000", 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7069999999999992e-06 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760213+0000", 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018625511000000001 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760448+0000", 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023568499999999999 2024-04-26T07:50:08.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.760940+0000", 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00049129600000000001 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764154+0000", 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003213844 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765494+0000", 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00134033 2024-04-26T07:50:08.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765601+0000", 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000107235 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765719+0000", 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011837600000000001 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.313 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.55204891699999, 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024603509999999999, 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 115 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741600+0000", 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5000000000000002e-07 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741686+0000", 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5319000000000001e-05 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741698+0000", 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2024e-05 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741706+0000", 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4829999999999999e-06 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.761861+0000", 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020154792000000001 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762132+0000", 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000270771 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.762528+0000", 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039612000000000002 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.765888+0000", 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033602129999999999 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766037+0000", 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148689 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766107+0000", 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0413000000000005e-05 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766203+0000", 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6036e-05 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:08.319 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.55192736399999, 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024676262000000001, 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 116 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741721+0000", 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741722+0000", 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5000000000000001e-07 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741728+0000", 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.536e-06 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741738+0000", 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0346999999999999e-05 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741746+0000", 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0430000000000008e-06 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764265+0000", 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02251914 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764419+0000", 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015423499999999999 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.764628+0000", 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000208242 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766014+0000", 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001386452 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766231+0000", 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021695800000000001 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766303+0000", 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1732999999999999e-05 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766397+0000", 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4726000000000001e-05 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4166.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.55188739499999, 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026786608999999999, 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4166", 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/1496647225", 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 117 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741761+0000", 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741762+0000", 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6300000000000005e-07 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741768+0000", 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8830000000000003e-06 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741778+0000", 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0494e-05 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.741786+0000", 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0199999999999994e-06 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766473+0000", 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024686446000000001 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.766709+0000", 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000236851 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.767085+0000", 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037514699999999999 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768293+0000", 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012082970000000001 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768340+0000", 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7089000000000003e-05 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768436+0000", 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6095999999999996e-05 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:15.768548+0000", 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000111623 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.330 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2103 3.3b 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.034235735999999, 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025234304999999999, 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2103 2024-04-26T07:50:08.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259413+0000", 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.259416+0000", 2024-04-26T07:50:08.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6260000000000001e-06 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.265987+0000", 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00657108 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266029+0000", 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1155999999999997e-05 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266055+0000", 2024-04-26T07:50:08.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6597e-05 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266194+0000", 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013830200000000001 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266432+0000", 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023884199999999999 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:08.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.266641+0000", 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020863199999999999 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.279877+0000", 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013236346 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284529+0000", 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046518210000000004 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284593+0000", 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3723e-05 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.284647+0000", 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.418e-05 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2108 3.f 3:f0ee051f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:50:08.336 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.943130072999999, 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020717233000000002, 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2108 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:50:08.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350518+0000", 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.350520+0000", 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7269999999999999e-06 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358048+0000", 2024-04-26T07:50:08.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075278059999999997 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358071+0000", 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3523000000000002e-05 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358083+0000", 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1265e-05 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358172+0000", 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9582999999999999e-05 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358326+0000", 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015335899999999999 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.358454+0000", 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0001282 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.364823+0000", 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063690309999999998 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371105+0000", 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062825310000000001 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371167+0000", 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1532999999999995e-05 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.371236+0000", 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8675000000000002e-05 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2139 3.e 3:7390af0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.542387757, 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024095845000000001, 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.342 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2139 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751261+0000", 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.751265+0000", 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2729999999999996e-06 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.758971+0000", 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0077062930000000003 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759009+0000", 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7429999999999999e-05 2024-04-26T07:50:08.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759027+0000", 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8323000000000001e-05 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759223+0000", 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000196386 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759474+0000", 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250175 2024-04-26T07:50:08.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.759705+0000", 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000230998 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.774391+0000", 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014686296999999999 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775046+0000", 2024-04-26T07:50:08.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065485499999999998 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775220+0000", 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017439899999999999 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.775357+0000", 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013641599999999999 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2141 3.e 3:73fc2b27:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.494364638, 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020683983999999999, 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2141 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799284+0000", 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.799288+0000", 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-06 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803704+0000", 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044163680000000004 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803745+0000", 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0836e-05 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803764+0000", 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8743e-05 2024-04-26T07:50:08.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.803912+0000", 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014867299999999999 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804192+0000", 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027982799999999998 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.804430+0000", 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000238435 2024-04-26T07:50:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816451+0000", 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012020507 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819796+0000", 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033448689999999999 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819890+0000", 2024-04-26T07:50:08.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3795999999999994e-05 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.819968+0000", 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8208999999999996e-05 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2142 3.15 3:a87525cc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.477265559999999, 2024-04-26T07:50:08.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022647812, 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2142 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816383+0000", 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.816387+0000", 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2560000000000004e-06 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822782+0000", 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063953079999999997 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822812+0000", 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9876999999999999e-05 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.822833+0000", 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1013e-05 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823017+0000", 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018354499999999999 2024-04-26T07:50:08.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823252+0000", 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234832 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.823515+0000", 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026311800000000001 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.836859+0000", 2024-04-26T07:50:08.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01334453 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838722+0000", 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018625650000000001 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.838882+0000", 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015986200000000001 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.839031+0000", 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000148906 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2150 3.39 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.274561890000001, 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025377047, 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.362 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2150 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019087+0000", 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.019089+0000", 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3590000000000002e-06 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023640+0000", 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045514700000000002 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023666+0000", 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5384e-05 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023680+0000", 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3981999999999999e-05 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023757+0000", 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7249999999999994e-05 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.023912+0000", 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015499900000000001 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.024032+0000", 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119628 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.034967+0000", 2024-04-26T07:50:08.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010935823000000001 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044357+0000", 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093895449999999991 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044412+0000", 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5359999999999999e-05 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.044464+0000", 2024-04-26T07:50:08.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1246999999999999e-05 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2168 3.2d 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.839030026, 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026862164000000001, 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.368 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2168 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454618+0000", 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.454622+0000", 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459549+0000", 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049275710000000004 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459589+0000", 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9387000000000001e-05 2024-04-26T07:50:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459609+0000", 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0392999999999999e-05 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459751+0000", 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014207900000000001 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.459996+0000", 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024460500000000001 2024-04-26T07:50:08.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.460226+0000", 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023053200000000001 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.469147+0000", 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0089203549999999996 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481152+0000", 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012005386999999999 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481352+0000", 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020005199999999999 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.481481+0000", 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012850900000000001 2024-04-26T07:50:08.373 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2183 3.37 3:ef675d97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.644465832000002, 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019732288000000001, 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.374 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2183 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649183+0000", 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.649185+0000", 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8200000000000001e-06 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655471+0000", 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062857750000000004 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655498+0000", 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7029000000000002e-05 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655509+0000", 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0813e-05 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655609+0000", 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9953999999999999e-05 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655801+0000", 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000192189 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.655983+0000", 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018226200000000001 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668782+0000", 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012798886000000001 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668801+0000", 2024-04-26T07:50:08.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377999999999999e-05 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668856+0000", 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5265e-05 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.668915+0000", 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8916999999999999e-05 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2205 3.14 e59/17 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.395328460000002, 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020789596, 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898320+0000", 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.898321+0000", 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6400000000000001e-07 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902172+0000", 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003850787 2024-04-26T07:50:08.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902208+0000", 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5952999999999999e-05 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902230+0000", 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1987000000000001e-05 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902392+0000", 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162344 2024-04-26T07:50:08.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.902418+0000", 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5953e-05 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919038+0000", 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016620234000000001 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919110+0000", 2024-04-26T07:50:08.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1474e-05 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2207 3.3f 3:fe080a1d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.378103121999999, 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021701979999999999, 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.384 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2207 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915545+0000", 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.915549+0000", 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1200000000000004e-06 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921046+0000", 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054969049999999998 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921067+0000", 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0724e-05 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921079+0000", 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1533e-05 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921145+0000", 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6662000000000007e-05 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921267+0000", 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121889 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.921388+0000", 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120449 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934035+0000", 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012647818 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937179+0000", 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003143065 2024-04-26T07:50:08.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937218+0000", 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9662000000000001e-05 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.937247+0000", 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9153e-05 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.389 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2213 3.f 3:f1254826:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.314939927000001, 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021396413, 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2213 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978709+0000", 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.978713+0000", 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982948+0000", 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042354690000000004 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.982982+0000", 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3683000000000003e-05 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983002+0000", 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9599999999999999e-05 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983200+0000", 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000198715 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983466+0000", 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026605500000000001 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:08.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.983722+0000", 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025512499999999998 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.994151+0000", 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010429528 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999893+0000", 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057413860000000002 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.999992+0000", 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9689e-05 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.000105+0000", 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000112766 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2217 3.2b e59/17 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:08.395 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.270190697, 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044994659999999999, 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:50:08.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.023458+0000", 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6300000000000005e-07 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032526+0000", 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090671680000000004 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032570+0000", 2024-04-26T07:50:08.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4039000000000003e-05 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032593+0000", 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3873e-05 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032774+0000", 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018014300000000001 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.032819+0000", 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5713000000000001e-05 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068399+0000", 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.035580053 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068452+0000", 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3108e-05 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2219 3.d 3:b1029326:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.253982516000001, 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029242280999999998, 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2219 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039666+0000", 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4999999999999999e-06 2024-04-26T07:50:08.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046427+0000", 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067579299999999997 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046452+0000", 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4341999999999998e-05 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046465+0000", 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3434999999999999e-05 2024-04-26T07:50:08.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046565+0000", 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9584000000000001e-05 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046729+0000", 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016413300000000001 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.046851+0000", 2024-04-26T07:50:08.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012242199999999999 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068781+0000", 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021930021000000001 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068797+0000", 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6123000000000001e-05 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068862+0000", 2024-04-26T07:50:08.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.457e-05 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.068908+0000", 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6220999999999997e-05 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2247 3.14 e59/17 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head v 59'5, mlcod=59'3)", 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.915442917, 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019349376000000001, 2024-04-26T07:50:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378206+0000", 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.378209+0000", 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0929999999999999e-06 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381273+0000", 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00306456 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381314+0000", 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0519000000000003e-05 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381331+0000", 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7547e-05 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381492+0000", 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000160979 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.381553+0000", 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0962999999999999e-05 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397406+0000", 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015853145999999999 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397555+0000", 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014856900000000001 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:08.409 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:08.411 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:08.410+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:08.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:08.511 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:08.510+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:08.578 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:08.579 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:08.579 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:08.579 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:08.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:08.643 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:08.643+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:08.713 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:08.713 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:08.713 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:08.713 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:08.713 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:08.714 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:08.711+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:08.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:08.819 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:08.819+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1113 3.6 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.625998258000003, 2024-04-26T07:50:08.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015424972, 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1113 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266304+0000", 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6060000000000001e-06 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270480+0000", 2024-04-26T07:50:08.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041759689999999999 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270523+0000", 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2908000000000003e-05 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270541+0000", 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8790000000000001e-05 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270636+0000", 2024-04-26T07:50:08.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4690000000000003e-05 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270821+0000", 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018512100000000001 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271288+0000", 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046690099999999998 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.280701+0000", 2024-04-26T07:50:08.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0094125839999999999 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281610+0000", 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090926400000000001 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281676+0000", 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5809999999999995e-05 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281726+0000", 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0328999999999999e-05 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2110 3.23 3:c664601d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.509996782000002, 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017472562000000001, 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2110 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382305+0000", 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6630000000000002e-06 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.384976+0000", 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026707620000000001 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385010+0000", 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.358e-05 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385026+0000", 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6487999999999999e-05 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385180+0000", 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153609 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385551+0000", 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000370971 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385906+0000", 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035550399999999998 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.397683+0000", 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011776426 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399475+0000", 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001792837 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399663+0000", 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018749500000000001 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399775+0000", 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011222699999999999 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.905 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2114 3.10 e58/17 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.437400459999999, 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014481571, 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:08.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454902+0000", 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7800000000000001e-06 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459802+0000", 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049001319999999998 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459839+0000", 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7055999999999999e-05 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459855+0000", 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6345e-05 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460023+0000", 2024-04-26T07:50:08.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167579 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460071+0000", 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8046e-05 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469193+0000", 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091217039999999996 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469380+0000", 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018792900000000001 2024-04-26T07:50:08.909 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2115 3.12 3:48da4f83:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.430855713, 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020926337, 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.910 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2115 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461447+0000", 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464785+0000", 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033385540000000001 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464814+0000", 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9167e-05 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464832+0000", 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8097999999999999e-05 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464996+0000", 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016315399999999999 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465292+0000", 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029592699999999997 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465562+0000", 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027075899999999997 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.477813+0000", 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012250749 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482150+0000", 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043364340000000001 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482260+0000", 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110204 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482370+0000", 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110234 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2124 3.12 3:48cdd107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.915 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.259067086999998, 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017263152, 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2124 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633237+0000", 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2690000000000001e-06 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637016+0000", 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037793480000000001 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637055+0000", 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9138999999999999e-05 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637073+0000", 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8070000000000001e-05 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637251+0000", 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017822500000000001 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637652+0000", 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040054000000000001 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.638078+0000", 2024-04-26T07:50:08.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042600299999999999 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.647434+0000", 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093557510000000007 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650193+0000", 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027596180000000001 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650366+0000", 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017236899999999999 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650495+0000", 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012982 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2125 3.17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:08.921 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.236271967, 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02199247, 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2125 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:08.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656030+0000", 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.658975+0000", 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029456349999999998 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659019+0000", 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3405999999999997e-05 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659046+0000", 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6659e-05 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659219+0000", 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017387300000000001 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659499+0000", 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279926 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659769+0000", 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026926000000000001 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.668218+0000", 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084496710000000006 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677830+0000", 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096117779999999996 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677932+0000", 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010155800000000001 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.678020+0000", 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8211e-05 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2150 3.39 e58/17 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.868394816999999, 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019626325999999999, 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023907+0000", 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.576e-06 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032657+0000", 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0087502129999999997 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032704+0000", 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7024999999999998e-05 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032725+0000", 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1002999999999999e-05 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032879+0000", 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015357599999999999 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032924+0000", 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5509000000000001e-05 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043391+0000", 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010466787 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043531+0000", 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013963699999999999 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2154 3.6 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.770930646, 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018109798999999999, 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2154 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121373+0000", 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8829999999999999e-06 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124488+0000", 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031152179999999999 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124534+0000", 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6615e-05 2024-04-26T07:50:08.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124555+0000", 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0377000000000002e-05 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124721+0000", 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000166226 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125056+0000", 2024-04-26T07:50:08.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033541799999999998 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125363+0000", 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030636900000000002 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.138525+0000", 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013161806 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139390+0000", 2024-04-26T07:50:08.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00086512899999999996 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139439+0000", 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8795000000000003e-05 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139478+0000", 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9962999999999997e-05 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2156 3.2b 3:d74e6742:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.720484386999999, 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017757953999999999, 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2156 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171819+0000", 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5159999999999996e-06 2024-04-26T07:50:08.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174698+0000", 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028785109999999998 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174739+0000", 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0544999999999999e-05 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174757+0000", 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8267e-05 2024-04-26T07:50:08.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174970+0000", 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021284799999999999 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175288+0000", 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031840500000000001 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175516+0000", 2024-04-26T07:50:08.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022821500000000001 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.183262+0000", 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077455629999999996 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189370+0000", 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061082590000000004 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189505+0000", 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134554 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189573+0000", 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8270999999999997e-05 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2165 3.12 3:48c02635:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:08.942 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.497399381000001, 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021758514999999999, 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2165 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394904+0000", 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398287+0000", 2024-04-26T07:50:08.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033835380000000002 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398343+0000", 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5148999999999997e-05 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398365+0000", 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2688999999999999e-05 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398525+0000", 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159801 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398876+0000", 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035097600000000002 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.399237+0000", 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036067100000000002 2024-04-26T07:50:08.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.409713+0000", 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010476348 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416491+0000", 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067777569999999997 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416579+0000", 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412000000000007e-05 2024-04-26T07:50:08.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416658+0000", 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9231000000000001e-05 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2167 3.23 3:c5a42c94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.456325915000001, 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015687599999999999, 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.948 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2167 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435977+0000", 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9899999999999999e-06 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439816+0000", 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038388860000000001 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439841+0000", 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4632000000000001e-05 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439855+0000", 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.415e-05 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440055+0000", 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019957199999999999 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440486+0000", 2024-04-26T07:50:08.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043156999999999999 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440829+0000", 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034250799999999999 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.449821+0000", 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.008992033 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451400+0000", 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001579502 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451504+0000", 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010365399999999999 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451661+0000", 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015710299999999999 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2169 3.3d 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.426367475999999, 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016653068, 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.954 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2169 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465937+0000", 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0359999999999997e-06 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468355+0000", 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024184660000000002 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468411+0000", 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5594000000000003e-05 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468440+0000", 2024-04-26T07:50:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8683e-05 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468600+0000", 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000160061 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468843+0000", 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000243076 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.469075+0000", 2024-04-26T07:50:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023207999999999999 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.476674+0000", 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0075994410000000002 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482385+0000", 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057110879999999996 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482521+0000", 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135241 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482585+0000", 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4301999999999995e-05 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2170 3.12 3:48f78380:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.959 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.412556435999999, 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019689475000000001, 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2170 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479749+0000", 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7130000000000002e-06 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481893+0000", 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002144048 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481950+0000", 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7192999999999999e-05 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481979+0000", 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9414999999999999e-05 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482084+0000", 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105105 2024-04-26T07:50:08.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482257+0000", 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173053 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482414+0000", 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000156498 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.489832+0000", 2024-04-26T07:50:08.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074180399999999999 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499155+0000", 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093232509999999994 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499312+0000", 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015707899999999999 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499432+0000", 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012008 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2173 3.1b 3:d9c20b7c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.356746502, 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014202282, 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.965 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2173 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535556+0000", 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2370000000000001e-06 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537406+0000", 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001850108 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537459+0000", 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2488000000000003e-05 2024-04-26T07:50:08.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537483+0000", 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4839000000000001e-05 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537586+0000", 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010207199999999999 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537761+0000", 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000175482 2024-04-26T07:50:08.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537909+0000", 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014747499999999999 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.543692+0000", 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057834719999999996 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549614+0000", 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059216779999999997 2024-04-26T07:50:08.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549690+0000", 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6682999999999997e-05 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549755+0000", 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4747999999999997e-05 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2190 3.17 3:ea98e33f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.170426542000001, 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017436619, 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2190 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.971 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721876+0000", 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9390000000000002e-06 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724451+0000", 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025750019999999998 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724476+0000", 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4811e-05 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724490+0000", 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4949e-05 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724564+0000", 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3774000000000002e-05 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724694+0000", 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012977099999999999 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724806+0000", 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011196099999999999 2024-04-26T07:50:08.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.732550+0000", 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077441649999999999 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739171+0000", 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066207799999999997 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739249+0000", 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8095000000000004e-05 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739309+0000", 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0371999999999997e-05 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2200 3.1 3:80d4e2c6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.058735381999998, 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015722348000000001, 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.976 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2200 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833566+0000", 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7460000000000001e-06 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835679+0000", 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021130960000000001 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835704+0000", 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5194e-05 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835716+0000", 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2326e-05 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835834+0000", 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117939 2024-04-26T07:50:08.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835968+0000", 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013391499999999999 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.836142+0000", 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017374600000000001 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.840818+0000", 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046765790000000002 2024-04-26T07:50:08.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849134+0000", 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0083158650000000004 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849234+0000", 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9629000000000004e-05 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849286+0000", 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2312999999999999e-05 2024-04-26T07:50:08.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2201 3.30 e58/17 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.043170020000002, 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015421710999999999, 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849130+0000", 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858099+0000", 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089693169999999992 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858132+0000", 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2573000000000001e-05 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858146+0000", 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3750999999999999e-05 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858247+0000", 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101265 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858271+0000", 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4006e-05 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864493+0000", 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062218079999999997 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864551+0000", 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8408e-05 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2217 3.2b 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.872659341999999, 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.048883261999999997, 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.986 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2217 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019644+0000", 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9729999999999999e-06 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022277+0000", 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026334779999999999 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022312+0000", 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4737000000000003e-05 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022324+0000", 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1770000000000001e-05 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022410+0000", 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.598e-05 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022601+0000", 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019102100000000001 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022771+0000", 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017026500000000001 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.029808+0000", 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070363259999999999 2024-04-26T07:50:08.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068387+0000", 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.038579667999999998 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068459+0000", 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1649000000000005e-05 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068523+0000", 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4394999999999996e-05 2024-04-26T07:50:08.991 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2238 3.12 3:4adae178:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.620877585999999, 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015875822000000001, 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2238 2024-04-26T07:50:08.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271425+0000", 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.039e-06 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273472+0000", 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020474669999999999 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273520+0000", 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7289000000000001e-05 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:08.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273539+0000", 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9222999999999999e-05 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273640+0000", 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100833 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273805+0000", 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000165854 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273934+0000", 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000128331 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.281376+0000", 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074421349999999999 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287206+0000", 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058303369999999997 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287258+0000", 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1412000000000002e-05 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287298+0000", 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9901999999999998e-05 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2239 3.3 e59/17 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:08.997 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.601435781999999, 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015017188000000001, 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:08.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290865+0000", 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6759999999999999e-06 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296505+0000", 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00564001 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296547+0000", 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2256000000000003e-05 2024-04-26T07:50:08.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296565+0000", 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7856e-05 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296653+0000", 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8113000000000002e-05 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296681+0000", 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7818999999999999e-05 2024-04-26T07:50:09.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305803+0000", 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.009121901 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305881+0000", 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7557000000000003e-05 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.001 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:09.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:09.003 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:09.002+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:09.104 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:09.103+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:09.170 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:09.173 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:09.173 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:09.183 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:09.205 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:09.202+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:09.306 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:09.303+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:09.353 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:09.353 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:09.354 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:09.354 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:09.354 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:09.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:09.406 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:09.402+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:09.508 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:09.506+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:09.546 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:09.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:09.546 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:09.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.546 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:50:09.546 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:09.546 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 96.885328677999993, 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:50:09.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:50:09.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:50:09.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:50:09.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1110 3.25 3:a41b494f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.299567388, 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012576264, 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.552 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1110 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243099+0000", 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.091e-06 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245358+0000", 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022582739999999998 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245385+0000", 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7535999999999999e-05 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245398+0000", 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2965e-05 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245462+0000", 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4150000000000001e-05 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245564+0000", 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101828 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245651+0000", 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7503999999999994e-05 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.252240+0000", 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065883399999999998 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255588+0000", 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00334805 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255640+0000", 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1904000000000003e-05 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255673+0000", 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3621999999999998e-05 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:1113 3.6 e53/17 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head v 53'1, mlcod=0'0)", 2024-04-26T07:50:09.557 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.271179642, 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098513860000000002, 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:09.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271487+0000", 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.013e-06 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274777+0000", 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032900289999999999 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274803+0000", 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5765000000000001e-05 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274817+0000", 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4678000000000001e-05 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274943+0000", 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125394 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274986+0000", 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2759000000000002e-05 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281271+0000", 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062853789999999998 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281336+0000", 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5369000000000004e-05 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.224997648999999, 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.562 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:09.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:09.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:09.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:09.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:09.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:09.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.060338904999998, 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.568 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:09.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:09.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.038464864000002, 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.574 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:09.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:09.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:09.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:09.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.495665878000001, 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:09.579 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.443576024999999, 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.586 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:09.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:09.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:09.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.417087696999999, 2024-04-26T07:50:09.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:09.594 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.248822486000002, 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2181 3.25 3:a4112efc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.915036134000001, 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098076180000000006, 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.600 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2181 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627646+0000", 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7272e-05 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629343+0000", 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016969470000000001 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629378+0000", 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4953999999999998e-05 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629393+0000", 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4956e-05 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629486+0000", 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3129999999999998e-05 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629645+0000", 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015958300000000001 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629784+0000", 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013875199999999999 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.636610+0000", 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068263109999999998 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637298+0000", 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068795100000000001 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637372+0000", 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637436+0000", 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4029999999999995e-05 2024-04-26T07:50:09.605 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.791792221000001, 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.685977834999999, 2024-04-26T07:50:09.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:09.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:09.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:09.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2211 3.4 3:20747335:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.583927147000001, 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012423844999999999, 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2211 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958740+0000", 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.959e-06 2024-04-26T07:50:09.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960929+0000", 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021885730000000001 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960958+0000", 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8711999999999999e-05 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960973+0000", 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5855e-05 2024-04-26T07:50:09.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961069+0000", 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5229000000000006e-05 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961252+0000", 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183573 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961380+0000", 2024-04-26T07:50:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012739699999999999 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970375+0000", 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089949120000000007 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971060+0000", 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068572900000000005 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971112+0000", 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1697000000000003e-05 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971161+0000", 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9209000000000003e-05 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2215 3.0 3:031fd526:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.543797429000001, 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01231753, 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2215 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998870+0000", 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0879999999999999e-06 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000428+0000", 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001558083 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000457+0000", 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.864e-05 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000468+0000", 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1097000000000001e-05 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000538+0000", 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9671000000000004e-05 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000706+0000", 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168417 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000835+0000", 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012877599999999999 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.005328+0000", 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044927129999999997 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011073+0000", 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057450840000000001 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011130+0000", 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6997000000000003e-05 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011185+0000", 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4963999999999998e-05 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2216 3.1a e59/17 3:5801baf3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_105:head v 59'4, mlcod=58'2)", 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.527453442999999, 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011266452, 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0200000000000001e-07 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020123+0000", 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049112399999999999 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020158+0000", 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5015000000000003e-05 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020175+0000", 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7099e-05 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020284+0000", 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010912 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020320+0000", 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6316000000000003e-05 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026418+0000", 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060978500000000001 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026478+0000", 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.961e-05 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2223 3.3e 3:7c169570:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:09.632 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.454549058000001, 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010053697, 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2223 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088119+0000", 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.676e-06 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090038+0000", 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019183690000000001 2024-04-26T07:50:09.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090064+0000", 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6177e-05 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090079+0000", 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4939999999999999e-05 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090147+0000", 2024-04-26T07:50:09.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8480999999999997e-05 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090280+0000", 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013264900000000001 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090396+0000", 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011664599999999999 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.095595+0000", 2024-04-26T07:50:09.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051988010000000003 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098039+0000", 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024432920000000001 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098109+0000", 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0604000000000004e-05 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098169+0000", 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0062000000000002e-05 2024-04-26T07:50:09.637 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2225 3.3e 3:7e14b81a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.433537176000002, 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010006395, 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2225 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109129+0000", 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.643e-06 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110799+0000", 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016698679999999999 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110830+0000", 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0642999999999998e-05 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110842+0000", 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2407e-05 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110918+0000", 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6191000000000003e-05 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.111053+0000", 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013477300000000001 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.111184+0000", 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013110199999999999 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.116228+0000", 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050444180000000002 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119016+0000", 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002787866 2024-04-26T07:50:09.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119075+0000", 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8585999999999998e-05 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119134+0000", 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8897999999999998e-05 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.335216784, 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2235 3.25 3:a5eb05f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.315692001999999, 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010713906, 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:09.649 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2235 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:09.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226976+0000", 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228832+0000", 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001856702 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228861+0000", 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8861999999999999e-05 2024-04-26T07:50:09.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228874+0000", 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228966+0000", 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2201999999999996e-05 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229169+0000", 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020313199999999999 2024-04-26T07:50:09.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229345+0000", 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017556399999999999 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.236963+0000", 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076176789999999996 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237572+0000", 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000609155 2024-04-26T07:50:09.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237632+0000", 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0523000000000003e-05 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237686+0000", 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4150000000000002e-05 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:09.654 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:09.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:09.656 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:09.655+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:09.743 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:50:09.757 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:09.754+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:09.827 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:09.827 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:09.827 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:09.827 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:09.842 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:09.891 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:09.891+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:09.959 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:09.959+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:09.960 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:09.960 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:09.960 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:09.960 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:09.960 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:09.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:10.060 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:10.059+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:10.132 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:10.132 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1840 4.34 4:2d4d6bac:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.614254150000001, 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006653356, 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:10.133 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1840 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515123+0000", 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.652e-06 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515132+0000", 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.884e-06 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515155+0000", 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3323999999999999e-05 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515169+0000", 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3828999999999999e-05 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515237+0000", 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7949999999999998e-05 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515378+0000", 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014126199999999999 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515534+0000", 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155661 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.516132+0000", 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00059858100000000005 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521715+0000", 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055827359999999996 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521748+0000", 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3136000000000003e-05 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521774+0000", 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6341000000000001e-05 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2103 3.3b e58/17 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:10.138 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.862806927000001, 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017139903000000001, 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:10.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266571+0000", 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5859999999999999e-06 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275000+0000", 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084295080000000005 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275062+0000", 2024-04-26T07:50:10.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1579000000000001e-05 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275091+0000", 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8563000000000001e-05 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275209+0000", 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118866 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275240+0000", 2024-04-26T07:50:10.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0372999999999999e-05 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283650+0000", 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084105450000000002 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283708+0000", 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7883000000000001e-05 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2107 3.2d e58/17 3:b4925b2e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_6:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.796044814999998, 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012595189, 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333333+0000", 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2639999999999998e-06 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337333+0000", 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004000605 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337358+0000", 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4241999999999999e-05 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337370+0000", 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2387e-05 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337563+0000", 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000192635 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337602+0000", 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9135999999999999e-05 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.345823+0000", 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082215599999999993 2024-04-26T07:50:10.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.345926+0000", 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010236 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2113 3.2d e58/17 3:b71e74a3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_12:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.686563094, 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012014733, 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.147 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442814+0000", 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8169999999999999e-06 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446730+0000", 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0039164589999999997 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446765+0000", 2024-04-26T07:50:10.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4758999999999997e-05 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446781+0000", 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5733999999999999e-05 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446914+0000", 2024-04-26T07:50:10.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013332200000000001 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446951+0000", 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7104999999999998e-05 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454717+0000", 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077659970000000002 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454827+0000", 2024-04-26T07:50:10.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010954 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2117 3.4 e58/17 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.620444019000001, 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010325226, 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508934+0000", 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7030000000000002e-06 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511870+0000", 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002935736 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511919+0000", 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8962000000000003e-05 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511944+0000", 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5216e-05 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.512056+0000", 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011173 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.512087+0000", 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1256e-05 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519161+0000", 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070740819999999998 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519256+0000", 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5540999999999999e-05 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:10.156 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.162334921999999, 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:10.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:10.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:10.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:10.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2149 3.2e 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.136749597000001, 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016993692000000001, 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:10.162 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2149 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992628+0000", 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5959999999999998e-06 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995727+0000", 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003098506 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995778+0000", 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0868999999999997e-05 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995797+0000", 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9128999999999999e-05 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995958+0000", 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016100199999999999 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996233+0000", 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027535400000000001 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996496+0000", 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026286700000000002 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.007925+0000", 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011428880000000001 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009253+0000", 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013284150000000001 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009433+0000", 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017974500000000001 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009619+0000", 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000186329 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.167 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.061587208999999, 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:10.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:10.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:10.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:10.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.173 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2158 3.1c 3:38bce1b3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.908484133999998, 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015533498, 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2158 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:10.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:10.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220895+0000", 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7929999999999999e-06 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224209+0000", 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033143500000000002 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224260+0000", 2024-04-26T07:50:10.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0515e-05 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224288+0000", 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8189999999999999e-05 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224463+0000", 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174909 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224695+0000", 2024-04-26T07:50:10.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023159799999999999 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224998+0000", 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030391199999999999 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.234190+0000", 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091915550000000006 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236135+0000", 2024-04-26T07:50:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019451430000000001 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236300+0000", 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016472000000000001 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236425+0000", 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012481300000000001 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2161 3.0 e58/17 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.831810128000001, 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016578915999999999, 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297568+0000", 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7999999999999999e-06 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300910+0000", 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033417189999999999 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300956+0000", 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6139e-05 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300975+0000", 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8856e-05 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301137+0000", 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162583 2024-04-26T07:50:10.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301205+0000", 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7627999999999997e-05 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314035+0000", 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012830187 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314144+0000", 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109004 2024-04-26T07:50:10.183 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.759874698000001, 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:10.184 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:10.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:10.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.669115571999999, 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2169 3.3d e58/17 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:10.194 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.659287586000001, 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01191763, 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:10.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470089+0000", 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.798e-06 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474285+0000", 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041955780000000002 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474328+0000", 2024-04-26T07:50:10.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2709000000000001e-05 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474352+0000", 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4273e-05 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474456+0000", 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000103523 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474484+0000", 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8538999999999999e-05 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481924+0000", 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074399030000000003 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482005+0000", 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1306999999999999e-05 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.198 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2194 3.1e 3:79c69c28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.361183621999999, 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013321008000000001, 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2194 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768194+0000", 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209999999999999e-06 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769679+0000", 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014842239999999999 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769715+0000", 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6514000000000003e-05 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769732+0000", 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6935999999999998e-05 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769841+0000", 2024-04-26T07:50:10.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108564 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.770078+0000", 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000237524 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.770234+0000", 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155721 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:10.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.775501+0000", 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00526685 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781386+0000", 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058848950000000002 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781458+0000", 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1898999999999997e-05 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781513+0000", 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.516e-05 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2209 3.4 e59/17 3:22b8f135:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_98:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.191064286, 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0069373619999999999, 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8099999999999998e-07 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940053+0000", 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00174117 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940082+0000", 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9635999999999999e-05 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940097+0000", 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4596000000000001e-05 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940197+0000", 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940232+0000", 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5116000000000001e-05 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.945149+0000", 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049168140000000003 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.945248+0000", 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9257000000000002e-05 2024-04-26T07:50:10.207 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2211 3.4 e59/17 3:20747335:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_100:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.167877663999999, 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093734109999999999, 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961499+0000", 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.855e-06 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963144+0000", 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001644656 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963183+0000", 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8469e-05 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963199+0000", 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6643e-05 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963291+0000", 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1459000000000006e-05 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963321+0000", 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0408000000000001e-05 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970797+0000", 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074760729999999997 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970871+0000", 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3848000000000002e-05 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2215 3.0 e59/17 3:031fd526:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_104:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.128433459, 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098835109999999993, 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000944+0000", 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0540000000000002e-06 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003412+0000", 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024678899999999999 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003434+0000", 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2719000000000001e-05 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003446+0000", 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1798e-05 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003523+0000", 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6240000000000002e-05 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003553+0000", 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0264999999999999e-05 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.010746+0000", 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071935949999999997 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.010825+0000", 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8949999999999995e-05 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2224 3.4 e59/17 3:235f71f4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_113:head v 59'4, mlcod=59'2)", 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.028397545000001, 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071865310000000003, 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100980+0000", 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2670000000000001e-06 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102596+0000", 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00161578 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102625+0000", 2024-04-26T07:50:10.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9043e-05 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102639+0000", 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3935e-05 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102724+0000", 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.564e-05 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102751+0000", 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6361000000000001e-05 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.108094+0000", 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053428759999999999 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.108164+0000", 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0629000000000004e-05 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2231 3.9 e59/17 3:90514a14:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_120:head v 59'1, mlcod=0'0)", 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.944129785000001, 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010909064, 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185246+0000", 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0999999999999999e-07 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189938+0000", 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046919199999999996 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189957+0000", 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9358e-05 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189970+0000", 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2870999999999999e-05 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.190053+0000", 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2515000000000005e-05 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.190079+0000", 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6871000000000001e-05 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196101+0000", 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060217939999999996 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196155+0000", 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3325000000000002e-05 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.223 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2245 3.9 e59/17 3:91913af5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_134:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.771503469999999, 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010257782, 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357874+0000", 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0209999999999998e-06 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361945+0000", 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040714319999999998 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:10.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361977+0000", 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1256e-05 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361991+0000", 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.416e-05 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.362085+0000", 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4073999999999994e-05 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.362120+0000", 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5460000000000003e-05 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.368061+0000", 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059409179999999999 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.368130+0000", 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8460999999999994e-05 2024-04-26T07:50:10.227 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.228 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.228 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.228 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:10.228 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:10.228 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:10.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:10.230 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:10.230+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:10.369 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:10.327+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:10.406 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:10.406 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:10.406 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:10.406 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:10.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:10.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:10.431 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:10.430+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:10.532 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:10.530+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:10.564 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:10.581 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:10.582 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:10.587 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:10.587 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:10.587 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:10.587 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:10.587 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:10.598 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:10.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:10.616 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:10.617 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:10.632 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:10.630+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:10.637 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:10.638 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:10.659 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:10.680 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:10.680 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:10.703 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:10.703 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:10.729 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:10.729 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:10.733 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:10.730+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:10.743 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:10.835 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:10.834+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:10.874 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:10.874 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:10.889 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:50:10.935 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:10.934+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:11.005 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:11.006 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:11.022 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:11.036 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:11.034+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:11.138 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:11.134+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:11.189 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:11.189 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:11.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:11.247 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:11.246+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:11.340 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:11.338+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:11.368 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:11.368 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:11.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:11.441 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:11.438+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:11.501 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:11.501 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:11.515 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:11.559 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:11.558+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:11.643 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:11.638+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:11.679 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:11.679 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:11.692 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:11.743 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:11.742+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:11.843 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:11.844 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:11.844 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:11.842+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:11.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:11.945 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:11.942+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:11.977 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:11.977 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:11.991 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:12.047 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:12.046+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:12.107 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:12.107 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:12.119 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:12.163 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:12.162+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:12.250 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:12.246+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:12.286 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:12.286 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:12.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:12.350 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:12.346+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:12.452 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:12.450+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:12.463 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:12.464 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:12.478 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:12.552 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:12.550+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:12.594 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:12.595 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:12.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:12.655 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:12.654+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:12.727 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:12.747 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:12.748 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:12.756 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:12.754+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:12.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:12.857 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:12.854+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:12.884 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:12.885 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:12.901 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:12.901 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:12.918 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:12.918 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:12.935 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:12.935 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:12.943 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:12.943 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:12.943 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:12.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:50:12.957 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:12.957 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:12.954+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:12.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:12.978 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:12.978 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:12.999 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:13.020 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:13.020 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:13.087 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:13.086+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:13.096 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:13.096 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:13.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1113 3.6 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.828836709999997, 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015424972, 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1113 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.097 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266304+0000", 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6060000000000001e-06 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270480+0000", 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041759689999999999 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270523+0000", 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2908000000000003e-05 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270541+0000", 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8790000000000001e-05 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270636+0000", 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4690000000000003e-05 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270821+0000", 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018512100000000001 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271288+0000", 2024-04-26T07:50:13.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046690099999999998 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.280701+0000", 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0094125839999999999 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281610+0000", 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090926400000000001 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281676+0000", 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5809999999999995e-05 2024-04-26T07:50:13.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281726+0000", 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0328999999999999e-05 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2110 3.23 3:c664601d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.712835234000003, 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017472562000000001, 2024-04-26T07:50:13.102 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2110 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382305+0000", 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6630000000000002e-06 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.384976+0000", 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026707620000000001 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385010+0000", 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.358e-05 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385026+0000", 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6487999999999999e-05 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385180+0000", 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153609 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385551+0000", 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000370971 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385906+0000", 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035550399999999998 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.397683+0000", 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011776426 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399475+0000", 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001792837 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399663+0000", 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018749500000000001 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399775+0000", 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011222699999999999 2024-04-26T07:50:13.107 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2114 3.10 e58/17 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.640238912000001, 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014481571, 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454902+0000", 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7800000000000001e-06 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459802+0000", 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049001319999999998 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459839+0000", 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7055999999999999e-05 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459855+0000", 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6345e-05 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460023+0000", 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167579 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460071+0000", 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8046e-05 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469193+0000", 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091217039999999996 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469380+0000", 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018792900000000001 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2115 3.12 3:48da4f83:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.633694165000001, 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020926337, 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.112 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2115 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461447+0000", 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464785+0000", 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033385540000000001 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464814+0000", 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9167e-05 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464832+0000", 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8097999999999999e-05 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464996+0000", 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016315399999999999 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465292+0000", 2024-04-26T07:50:13.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029592699999999997 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465562+0000", 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027075899999999997 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.477813+0000", 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012250749 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482150+0000", 2024-04-26T07:50:13.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043364340000000001 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482260+0000", 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110204 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482370+0000", 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110234 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2124 3.12 3:48cdd107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.461905539, 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017263152, 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2124 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633237+0000", 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2690000000000001e-06 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637016+0000", 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037793480000000001 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637055+0000", 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9138999999999999e-05 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637073+0000", 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8070000000000001e-05 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637251+0000", 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017822500000000001 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637652+0000", 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040054000000000001 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.638078+0000", 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042600299999999999 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.647434+0000", 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093557510000000007 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650193+0000", 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027596180000000001 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650366+0000", 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017236899999999999 2024-04-26T07:50:13.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650495+0000", 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012982 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2125 3.17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.439110419000002, 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02199247, 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.123 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2125 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656030+0000", 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.658975+0000", 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029456349999999998 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659019+0000", 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3405999999999997e-05 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659046+0000", 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6659e-05 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659219+0000", 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017387300000000001 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659499+0000", 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279926 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659769+0000", 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026926000000000001 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.668218+0000", 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084496710000000006 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677830+0000", 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096117779999999996 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677932+0000", 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010155800000000001 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.678020+0000", 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8211e-05 2024-04-26T07:50:13.128 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2150 3.39 e58/17 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.071233268999997, 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019626325999999999, 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023907+0000", 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.576e-06 2024-04-26T07:50:13.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032657+0000", 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0087502129999999997 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032704+0000", 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7024999999999998e-05 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032725+0000", 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1002999999999999e-05 2024-04-26T07:50:13.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032879+0000", 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015357599999999999 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032924+0000", 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5509000000000001e-05 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043391+0000", 2024-04-26T07:50:13.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010466787 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043531+0000", 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013963699999999999 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2154 3.6 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.973769097999998, 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018109798999999999, 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.133 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2154 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121373+0000", 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8829999999999999e-06 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124488+0000", 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031152179999999999 2024-04-26T07:50:13.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124534+0000", 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6615e-05 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124555+0000", 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0377000000000002e-05 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124721+0000", 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000166226 2024-04-26T07:50:13.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125056+0000", 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033541799999999998 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125363+0000", 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030636900000000002 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.138525+0000", 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013161806 2024-04-26T07:50:13.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139390+0000", 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00086512899999999996 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139439+0000", 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8795000000000003e-05 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139478+0000", 2024-04-26T07:50:13.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9962999999999997e-05 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2156 3.2b 3:d74e6742:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.923322839000001, 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017757953999999999, 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.139 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2156 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171819+0000", 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5159999999999996e-06 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174698+0000", 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028785109999999998 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174739+0000", 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0544999999999999e-05 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174757+0000", 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8267e-05 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174970+0000", 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021284799999999999 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175288+0000", 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031840500000000001 2024-04-26T07:50:13.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175516+0000", 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022821500000000001 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.183262+0000", 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077455629999999996 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189370+0000", 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061082590000000004 2024-04-26T07:50:13.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189505+0000", 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134554 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189573+0000", 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8270999999999997e-05 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2165 3.12 3:48c02635:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.700237832999999, 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021758514999999999, 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2165 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394904+0000", 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398287+0000", 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033835380000000002 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398343+0000", 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5148999999999997e-05 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398365+0000", 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2688999999999999e-05 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398525+0000", 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159801 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398876+0000", 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035097600000000002 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.399237+0000", 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036067100000000002 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.409713+0000", 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010476348 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416491+0000", 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067777569999999997 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416579+0000", 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412000000000007e-05 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416658+0000", 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9231000000000001e-05 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2167 3.23 3:c5a42c94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.659164366999999, 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015687599999999999, 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.150 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2167 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:13.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435977+0000", 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9899999999999999e-06 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439816+0000", 2024-04-26T07:50:13.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038388860000000001 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439841+0000", 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4632000000000001e-05 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439855+0000", 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.415e-05 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440055+0000", 2024-04-26T07:50:13.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019957199999999999 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440486+0000", 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043156999999999999 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440829+0000", 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034250799999999999 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.449821+0000", 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.008992033 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451400+0000", 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001579502 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451504+0000", 2024-04-26T07:50:13.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010365399999999999 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451661+0000", 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015710299999999999 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2169 3.3d 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.629205928000001, 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016653068, 2024-04-26T07:50:13.156 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2169 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465937+0000", 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0359999999999997e-06 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468355+0000", 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024184660000000002 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468411+0000", 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5594000000000003e-05 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468440+0000", 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8683e-05 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468600+0000", 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000160061 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468843+0000", 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000243076 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.469075+0000", 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023207999999999999 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.476674+0000", 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0075994410000000002 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482385+0000", 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057110879999999996 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482521+0000", 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135241 2024-04-26T07:50:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482585+0000", 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4301999999999995e-05 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2170 3.12 3:48f78380:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.615394888000001, 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019689475000000001, 2024-04-26T07:50:13.162 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2170 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479749+0000", 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7130000000000002e-06 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481893+0000", 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002144048 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481950+0000", 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7192999999999999e-05 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481979+0000", 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9414999999999999e-05 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482084+0000", 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105105 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482257+0000", 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173053 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482414+0000", 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000156498 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.489832+0000", 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074180399999999999 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499155+0000", 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093232509999999994 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499312+0000", 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015707899999999999 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499432+0000", 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012008 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2173 3.1b 3:d9c20b7c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.559584954000002, 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014202282, 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.168 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2173 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535556+0000", 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2370000000000001e-06 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537406+0000", 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001850108 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537459+0000", 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2488000000000003e-05 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537483+0000", 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4839000000000001e-05 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537586+0000", 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010207199999999999 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537761+0000", 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000175482 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537909+0000", 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014747499999999999 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.543692+0000", 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057834719999999996 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549614+0000", 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059216779999999997 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549690+0000", 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6682999999999997e-05 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549755+0000", 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4747999999999997e-05 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2190 3.17 3:ea98e33f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.373264993999999, 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017436619, 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2190 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721876+0000", 2024-04-26T07:50:13.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9390000000000002e-06 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724451+0000", 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025750019999999998 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724476+0000", 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4811e-05 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724490+0000", 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4949e-05 2024-04-26T07:50:13.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724564+0000", 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3774000000000002e-05 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724694+0000", 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012977099999999999 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724806+0000", 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011196099999999999 2024-04-26T07:50:13.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.732550+0000", 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077441649999999999 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739171+0000", 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066207799999999997 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739249+0000", 2024-04-26T07:50:13.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8095000000000004e-05 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739309+0000", 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0371999999999997e-05 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2200 3.1 3:80d4e2c6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.261573834, 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015722348000000001, 2024-04-26T07:50:13.179 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2200 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833566+0000", 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7460000000000001e-06 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835679+0000", 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021130960000000001 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835704+0000", 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5194e-05 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835716+0000", 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2326e-05 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835834+0000", 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117939 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835968+0000", 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013391499999999999 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.836142+0000", 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017374600000000001 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.840818+0000", 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046765790000000002 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849134+0000", 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0083158650000000004 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849234+0000", 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9629000000000004e-05 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849286+0000", 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2312999999999999e-05 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2201 3.30 e58/17 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.246008472, 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015421710999999999, 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.185 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849130+0000", 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858099+0000", 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089693169999999992 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858132+0000", 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2573000000000001e-05 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858146+0000", 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3750999999999999e-05 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858247+0000", 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101265 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858271+0000", 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4006e-05 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864493+0000", 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062218079999999997 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864551+0000", 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8408e-05 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2217 3.2b 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:13.189 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.075497794, 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.048883261999999997, 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2217 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019644+0000", 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9729999999999999e-06 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022277+0000", 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026334779999999999 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022312+0000", 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4737000000000003e-05 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022324+0000", 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1770000000000001e-05 2024-04-26T07:50:13.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022410+0000", 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.598e-05 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022601+0000", 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019102100000000001 2024-04-26T07:50:13.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022771+0000", 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017026500000000001 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.029808+0000", 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070363259999999999 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068387+0000", 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.038579667999999998 2024-04-26T07:50:13.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068459+0000", 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1649000000000005e-05 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068523+0000", 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4394999999999996e-05 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.195 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2238 3.12 3:4adae178:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.823716038000001, 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015875822000000001, 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2238 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271425+0000", 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.039e-06 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273472+0000", 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020474669999999999 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273520+0000", 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7289000000000001e-05 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273539+0000", 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9222999999999999e-05 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273640+0000", 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100833 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273805+0000", 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000165854 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273934+0000", 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000128331 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.281376+0000", 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074421349999999999 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287206+0000", 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058303369999999997 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287258+0000", 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1412000000000002e-05 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287298+0000", 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9901999999999998e-05 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2239 3.3 e59/17 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 30.804274234000001, 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015017188000000001, 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290865+0000", 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6759999999999999e-06 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296505+0000", 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00564001 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296547+0000", 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2256000000000003e-05 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296565+0000", 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7856e-05 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296653+0000", 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8113000000000002e-05 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296681+0000", 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7818999999999999e-05 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305803+0000", 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.009121901 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305881+0000", 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7557000000000003e-05 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.205 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:13.207 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:13.207 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:13.202+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:13.308 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:13.306+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:13.369 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:13.369 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:13.369 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:13.369 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:13.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:13.427 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:13.426+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:13.510 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:13.506+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:13.553 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:13.554 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:13.554 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:13.554 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:13.554 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:13.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:13.611 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:13.610+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:13.692 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T07:50:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:13.692 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 101.030859337, 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010163304, 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 219 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657336+0000", 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657338+0000", 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4940000000000002e-06 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657351+0000", 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2612999999999999e-05 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657382+0000", 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1075999999999999e-05 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657401+0000", 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8647e-05 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657564+0000", 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016305200000000001 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.657960+0000", 2024-04-26T07:50:13.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039619999999999998 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.658753+0000", 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00079276300000000004 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.660490+0000", 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017375089999999999 2024-04-26T07:50:13.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667289+0000", 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067992520000000004 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667381+0000", 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1223000000000004e-05 2024-04-26T07:50:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:48:32.667499+0000", 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011847500000000001 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1110 3.25 3:a41b494f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:13.699 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.445098047000002, 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012576264, 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1110 2024-04-26T07:50:13.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243099+0000", 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.091e-06 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245358+0000", 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022582739999999998 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245385+0000", 2024-04-26T07:50:13.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7535999999999999e-05 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245398+0000", 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2965e-05 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245462+0000", 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4150000000000001e-05 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245564+0000", 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101828 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245651+0000", 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7503999999999994e-05 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.252240+0000", 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065883399999999998 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255588+0000", 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00334805 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255640+0000", 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1904000000000003e-05 2024-04-26T07:50:13.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255673+0000", 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3621999999999998e-05 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:1113 3.6 e53/17 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head v 53'1, mlcod=0'0)", 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:13.706 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.416710301000002, 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098513860000000002, 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271485+0000", 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271487+0000", 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.013e-06 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274777+0000", 2024-04-26T07:50:13.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032900289999999999 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274803+0000", 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5765000000000001e-05 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274817+0000", 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4678000000000001e-05 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274943+0000", 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125394 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.274986+0000", 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2759000000000002e-05 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281271+0000", 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062853789999999998 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281336+0000", 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5369000000000004e-05 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.711 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.370528307999997, 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:13.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:13.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:13.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.205869563999997, 2024-04-26T07:50:13.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:13.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:13.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:13.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.183995523, 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.725 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:13.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:13.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.641196536999999, 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:13.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:13.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:13.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:13.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:13.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.589106684000001, 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.737 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:13.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.562618356000002, 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.742 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:13.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:13.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:13.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:13.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:13.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:13.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:13.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:13.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:13.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:13.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:13.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:13.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:13.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:13.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:13.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:13.749 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.749 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.750 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.750 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.750 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:13.750 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.394353144999997, 2024-04-26T07:50:13.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:13.751 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.751 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.751 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.751 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.751 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.752 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:13.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.752 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:13.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:13.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:13.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:13.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:13.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:13.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:13.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:13.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:13.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:13.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:13.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:13.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:13.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:13.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:13.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:13.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:13.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:13.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:13.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:13.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:13.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:13.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:13.761 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.762 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.762 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.762 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2181 3.25 3:a4112efc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:13.762 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:13.762 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.060566793, 2024-04-26T07:50:13.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098076180000000006, 2024-04-26T07:50:13.763 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.763 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.763 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.764 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2181 2024-04-26T07:50:13.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.764 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:13.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627628+0000", 2024-04-26T07:50:13.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.627646+0000", 2024-04-26T07:50:13.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7272e-05 2024-04-26T07:50:13.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629343+0000", 2024-04-26T07:50:13.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016969470000000001 2024-04-26T07:50:13.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629378+0000", 2024-04-26T07:50:13.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4953999999999998e-05 2024-04-26T07:50:13.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629393+0000", 2024-04-26T07:50:13.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4956e-05 2024-04-26T07:50:13.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629486+0000", 2024-04-26T07:50:13.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3129999999999998e-05 2024-04-26T07:50:13.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629645+0000", 2024-04-26T07:50:13.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015958300000000001 2024-04-26T07:50:13.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:13.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.629784+0000", 2024-04-26T07:50:13.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013875199999999999 2024-04-26T07:50:13.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.636610+0000", 2024-04-26T07:50:13.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068263109999999998 2024-04-26T07:50:13.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637298+0000", 2024-04-26T07:50:13.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068795100000000001 2024-04-26T07:50:13.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637372+0000", 2024-04-26T07:50:13.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:13.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.637436+0000", 2024-04-26T07:50:13.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4029999999999995e-05 2024-04-26T07:50:13.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.773 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.93732288, 2024-04-26T07:50:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:13.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.776 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:13.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:13.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:13.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:13.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:13.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:13.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:13.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:13.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:13.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:13.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:13.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:13.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:13.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:13.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:13.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.782 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:13.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:13.782 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.782 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.782 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.783 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.783 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:13.783 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.831508494000001, 2024-04-26T07:50:13.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:13.783 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.784 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.784 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.784 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.784 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:13.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.785 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:13.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:13.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:13.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:13.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:13.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:13.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:13.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:13.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:13.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:13.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:13.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:13.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:13.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:13.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:13.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:13.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:13.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:13.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:13.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:13.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:13.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:13.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:13.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:13.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:13.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:13.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:13.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:13.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:13.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:13.796 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.796 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.796 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.796 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2211 3.4 3:20747335:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.729457805999999, 2024-04-26T07:50:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012423844999999999, 2024-04-26T07:50:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.797 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2211 2024-04-26T07:50:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958740+0000", 2024-04-26T07:50:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.959e-06 2024-04-26T07:50:13.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960929+0000", 2024-04-26T07:50:13.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021885730000000001 2024-04-26T07:50:13.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960958+0000", 2024-04-26T07:50:13.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8711999999999999e-05 2024-04-26T07:50:13.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960973+0000", 2024-04-26T07:50:13.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5855e-05 2024-04-26T07:50:13.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961069+0000", 2024-04-26T07:50:13.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5229000000000006e-05 2024-04-26T07:50:13.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961252+0000", 2024-04-26T07:50:13.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183573 2024-04-26T07:50:13.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:13.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961380+0000", 2024-04-26T07:50:13.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012739699999999999 2024-04-26T07:50:13.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970375+0000", 2024-04-26T07:50:13.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089949120000000007 2024-04-26T07:50:13.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971060+0000", 2024-04-26T07:50:13.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068572900000000005 2024-04-26T07:50:13.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971112+0000", 2024-04-26T07:50:13.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1697000000000003e-05 2024-04-26T07:50:13.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971161+0000", 2024-04-26T07:50:13.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9209000000000003e-05 2024-04-26T07:50:13.808 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.808 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.808 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.809 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2215 3.0 3:031fd526:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.809 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:13.809 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.689328088, 2024-04-26T07:50:13.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01231753, 2024-04-26T07:50:13.809 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.809 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.809 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.810 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.810 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.810 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.810 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2215 2024-04-26T07:50:13.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.810 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:13.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:13.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998870+0000", 2024-04-26T07:50:13.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0879999999999999e-06 2024-04-26T07:50:13.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000428+0000", 2024-04-26T07:50:13.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001558083 2024-04-26T07:50:13.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000457+0000", 2024-04-26T07:50:13.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.864e-05 2024-04-26T07:50:13.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000468+0000", 2024-04-26T07:50:13.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1097000000000001e-05 2024-04-26T07:50:13.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000538+0000", 2024-04-26T07:50:13.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9671000000000004e-05 2024-04-26T07:50:13.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000706+0000", 2024-04-26T07:50:13.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168417 2024-04-26T07:50:13.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000835+0000", 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012877599999999999 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.005328+0000", 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044927129999999997 2024-04-26T07:50:13.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011073+0000", 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057450840000000001 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011130+0000", 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6997000000000003e-05 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011185+0000", 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4963999999999998e-05 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2216 3.1a e59/17 3:5801baf3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_105:head v 59'4, mlcod=58'2)", 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.672984102000001, 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011266452, 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.819 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0200000000000001e-07 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020123+0000", 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049112399999999999 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020158+0000", 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5015000000000003e-05 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020175+0000", 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7099e-05 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020284+0000", 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010912 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020320+0000", 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6316000000000003e-05 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026418+0000", 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060978500000000001 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026478+0000", 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.961e-05 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2223 3.3e 3:7c169570:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.823 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.600079717, 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010053697, 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2223 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:13.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088115+0000", 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.088119+0000", 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.676e-06 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090038+0000", 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019183690000000001 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090064+0000", 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6177e-05 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090079+0000", 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4939999999999999e-05 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090147+0000", 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8480999999999997e-05 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090280+0000", 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013264900000000001 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.090396+0000", 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011664599999999999 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.095595+0000", 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051988010000000003 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098039+0000", 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024432920000000001 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098109+0000", 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0604000000000004e-05 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.098169+0000", 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0062000000000002e-05 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2225 3.3e 3:7e14b81a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.579067835, 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010006395, 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.829 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2225 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109127+0000", 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.109129+0000", 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.643e-06 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110799+0000", 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016698679999999999 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110830+0000", 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0642999999999998e-05 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110842+0000", 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2407e-05 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.110918+0000", 2024-04-26T07:50:13.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6191000000000003e-05 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.111053+0000", 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013477300000000001 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.111184+0000", 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013110199999999999 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.116228+0000", 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050444180000000002 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119016+0000", 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002787866 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119075+0000", 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8585999999999998e-05 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119134+0000", 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8897999999999998e-05 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.480747442999998, 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.835 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.840 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2235 3.25 3:a5eb05f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.461222661000001, 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010713906, 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2235 2024-04-26T07:50:13.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:13.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226976+0000", 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228832+0000", 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001856702 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228861+0000", 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8861999999999999e-05 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:13.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228874+0000", 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228966+0000", 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2201999999999996e-05 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229169+0000", 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020313199999999999 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229345+0000", 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017556399999999999 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.236963+0000", 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076176789999999996 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237572+0000", 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000609155 2024-04-26T07:50:13.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237632+0000", 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0523000000000003e-05 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237686+0000", 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4150000000000002e-05 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:13.846 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:13.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:13.848 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:13.846+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:13.932 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:50:13.949 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:13.946+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:13.986 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:13.986 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:13.986 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:13.986 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:14.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:14.087 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:14.086+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:14.151 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:14.146+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:14.171 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:14.171 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:14.171 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:14.171 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:14.171 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:14.186 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:14.275 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:14.274+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:14.352 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:14.350+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:14.363 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1840 4.34 4:2d4d6bac:::.dir.350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.7.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.845473372000001, 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006653356, 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.364 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1840 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515121+0000", 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515123+0000", 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.652e-06 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515132+0000", 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.884e-06 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515155+0000", 2024-04-26T07:50:14.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3323999999999999e-05 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515169+0000", 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3828999999999999e-05 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515237+0000", 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7949999999999998e-05 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515378+0000", 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014126199999999999 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.515534+0000", 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155661 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.516132+0000", 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00059858100000000005 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521715+0000", 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055827359999999996 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521748+0000", 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3136000000000003e-05 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:31.521774+0000", 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6341000000000001e-05 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.369 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2103 3.3b e58/17 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.094026149000001, 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017139903000000001, 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:14.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266571+0000", 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5859999999999999e-06 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275000+0000", 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084295080000000005 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275062+0000", 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1579000000000001e-05 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275091+0000", 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8563000000000001e-05 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275209+0000", 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118866 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275240+0000", 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0372999999999999e-05 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283650+0000", 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084105450000000002 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.373 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283708+0000", 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7883000000000001e-05 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2107 3.2d e58/17 3:b4925b2e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_6:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.027264037000002, 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012595189, 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333333+0000", 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2639999999999998e-06 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337333+0000", 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004000605 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337358+0000", 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4241999999999999e-05 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337370+0000", 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2387e-05 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337563+0000", 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000192635 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337602+0000", 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9135999999999999e-05 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.345823+0000", 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082215599999999993 2024-04-26T07:50:14.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.345926+0000", 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010236 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2113 3.2d e58/17 3:b71e74a3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_12:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.917782316, 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012014733, 2024-04-26T07:50:14.378 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442814+0000", 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8169999999999999e-06 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446730+0000", 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0039164589999999997 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446765+0000", 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4758999999999997e-05 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446781+0000", 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5733999999999999e-05 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446914+0000", 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013332200000000001 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446951+0000", 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7104999999999998e-05 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454717+0000", 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077659970000000002 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454827+0000", 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010954 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2117 3.4 e58/17 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.851663240999997, 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010325226, 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:14.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508931+0000", 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508934+0000", 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7030000000000002e-06 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511870+0000", 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002935736 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511919+0000", 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8962000000000003e-05 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.511944+0000", 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5216e-05 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.512056+0000", 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011173 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.512087+0000", 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1256e-05 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519161+0000", 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070740819999999998 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519256+0000", 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5540999999999999e-05 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.393554143999999, 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.387 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:14.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:14.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:14.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2149 3.2e 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.367968818999998, 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016993692000000001, 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.393 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2149 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992628+0000", 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5959999999999998e-06 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995727+0000", 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003098506 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995778+0000", 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0868999999999997e-05 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995797+0000", 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9128999999999999e-05 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995958+0000", 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016100199999999999 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996233+0000", 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027535400000000001 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996496+0000", 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026286700000000002 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.007925+0000", 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011428880000000001 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009253+0000", 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013284150000000001 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009433+0000", 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017974500000000001 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009619+0000", 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000186329 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.398 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.292806431000002, 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2158 3.1c 3:38bce1b3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.139703355999998, 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015533498, 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.404 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2158 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220895+0000", 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7929999999999999e-06 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224209+0000", 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033143500000000002 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224260+0000", 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0515e-05 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224288+0000", 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8189999999999999e-05 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224463+0000", 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174909 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224695+0000", 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023159799999999999 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224998+0000", 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030391199999999999 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.234190+0000", 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091915550000000006 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236135+0000", 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019451430000000001 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236300+0000", 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016472000000000001 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236425+0000", 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012481300000000001 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.409 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2161 3.0 e58/17 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.063029350000001, 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016578915999999999, 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:14.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297568+0000", 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7999999999999999e-06 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300910+0000", 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033417189999999999 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300956+0000", 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6139e-05 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300975+0000", 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8856e-05 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301137+0000", 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162583 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301205+0000", 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7627999999999997e-05 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314035+0000", 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012830187 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314144+0000", 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109004 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.991093919999997, 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.414 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:14.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:14.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:14.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.900334794000003, 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:14.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2169 3.3d e58/17 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.890506807999998, 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01191763, 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.424 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470089+0000", 2024-04-26T07:50:14.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.798e-06 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474285+0000", 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041955780000000002 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474328+0000", 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2709000000000001e-05 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474352+0000", 2024-04-26T07:50:14.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4273e-05 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474456+0000", 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000103523 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474484+0000", 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8538999999999999e-05 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481924+0000", 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074399030000000003 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482005+0000", 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1306999999999999e-05 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2194 3.1e 3:79c69c28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.592402843999999, 2024-04-26T07:50:14.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013321008000000001, 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2194 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768194+0000", 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209999999999999e-06 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769679+0000", 2024-04-26T07:50:14.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014842239999999999 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769715+0000", 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6514000000000003e-05 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769732+0000", 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6935999999999998e-05 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769841+0000", 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108564 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.770078+0000", 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000237524 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.770234+0000", 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155721 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.775501+0000", 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00526685 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781386+0000", 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058848950000000002 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781458+0000", 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1898999999999997e-05 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781513+0000", 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.516e-05 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2209 3.4 e59/17 3:22b8f135:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_98:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.422283508, 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0069373619999999999, 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.434 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.938311+0000", 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8099999999999998e-07 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940053+0000", 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00174117 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940082+0000", 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9635999999999999e-05 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940097+0000", 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4596000000000001e-05 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940197+0000", 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.940232+0000", 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5116000000000001e-05 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.945149+0000", 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049168140000000003 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.945248+0000", 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9257000000000002e-05 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2211 3.4 e59/17 3:20747335:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_100:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.399096886000002, 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093734109999999999, 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961498+0000", 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961499+0000", 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.855e-06 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963144+0000", 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001644656 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963183+0000", 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8469e-05 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963199+0000", 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6643e-05 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963291+0000", 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1459000000000006e-05 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963321+0000", 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0408000000000001e-05 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970797+0000", 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074760729999999997 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970871+0000", 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3848000000000002e-05 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.442 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2215 3.0 e59/17 3:031fd526:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_104:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.359652681, 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098835109999999993, 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:14.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000942+0000", 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000944+0000", 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0540000000000002e-06 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003412+0000", 2024-04-26T07:50:14.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024678899999999999 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003434+0000", 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2719000000000001e-05 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003446+0000", 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1798e-05 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003523+0000", 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6240000000000002e-05 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.003553+0000", 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0264999999999999e-05 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.010746+0000", 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071935949999999997 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.010825+0000", 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8949999999999995e-05 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2224 3.4 e59/17 3:235f71f4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_113:head v 59'4, mlcod=59'2)", 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.259616766999997, 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071865310000000003, 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.447 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100978+0000", 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.100980+0000", 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2670000000000001e-06 2024-04-26T07:50:14.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102596+0000", 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00161578 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102625+0000", 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9043e-05 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102639+0000", 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3935e-05 2024-04-26T07:50:14.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102724+0000", 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.564e-05 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.102751+0000", 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6361000000000001e-05 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.108094+0000", 2024-04-26T07:50:14.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053428759999999999 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.108164+0000", 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0629000000000004e-05 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2231 3.9 e59/17 3:90514a14:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_120:head v 59'1, mlcod=0'0)", 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.175349007000001, 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010909064, 2024-04-26T07:50:14.451 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185246+0000", 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0999999999999999e-07 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189938+0000", 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046919199999999996 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189957+0000", 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9358e-05 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189970+0000", 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2870999999999999e-05 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.190053+0000", 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2515000000000005e-05 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.190079+0000", 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6871000000000001e-05 2024-04-26T07:50:14.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196101+0000", 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060217939999999996 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196155+0000", 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3325000000000002e-05 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.455 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2245 3.9 e59/17 3:91913af5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_134:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.002722691999999, 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010257782, 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357872+0000", 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.357874+0000", 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0209999999999998e-06 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361945+0000", 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040714319999999998 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361977+0000", 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1256e-05 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.361991+0000", 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.416e-05 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.362085+0000", 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4073999999999994e-05 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.362120+0000", 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5460000000000003e-05 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.368061+0000", 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059409179999999999 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.368130+0000", 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8460999999999994e-05 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.460 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.460 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:14.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:14.462 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:14.458+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:14.561 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:14.558+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:14.642 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:14.642 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:14.642 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:14.642 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:14.659 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:14.703 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:14.702+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:14.763 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:14.762+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:14.824 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:14.824 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:14.824 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:14.824 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:14.824 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:14.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:14.864 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:14.862+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:14.965 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:14.962+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:14.973 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:14.973 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:14.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:14.973 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:14.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.973 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.973 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.695498721, 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2106 3.19 e58/17 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.322930+0000", 2024-04-26T07:50:14.979 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.646302198000001, 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015653533000000001, 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322930+0000", 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322930+0000", 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322933+0000", 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9299999999999999e-06 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.325515+0000", 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025825079999999999 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.325574+0000", 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8609000000000001e-05 2024-04-26T07:50:14.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.325601+0000", 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7651999999999999e-05 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.325812+0000", 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021025899999999999 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.325875+0000", 2024-04-26T07:50:14.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3781000000000005e-05 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338434+0000", 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012558747 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338583+0000", 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000149047 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2118 3.27 3:e596b969:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.526553+0000", 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.442678766, 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018094086999999998, 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2118 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.526553+0000", 2024-04-26T07:50:14.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.526553+0000", 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.526557+0000", 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5300000000000001e-06 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.530101+0000", 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0035443710000000002 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.530142+0000", 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1264999999999999e-05 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.530162+0000", 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9419000000000002e-05 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.530300+0000", 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000137964 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.530558+0000", 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000257953 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.530779+0000", 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022127200000000001 2024-04-26T07:50:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.543886+0000", 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013107573000000001 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.544498+0000", 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00061169399999999997 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.544576+0000", 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8201999999999994e-05 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.544647+0000", 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0844000000000001e-05 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2122 3.c e58/17 3:33f873c3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_21:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:14.990 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.611615+0000", 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.357616681000003, 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016327458999999999, 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.611615+0000", 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.611615+0000", 2024-04-26T07:50:14.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.611618+0000", 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7630000000000001e-06 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.617686+0000", 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006068487 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.617732+0000", 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5825999999999998e-05 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.617752+0000", 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9415999999999998e-05 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.617915+0000", 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016320899999999999 2024-04-26T07:50:14.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.617955+0000", 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0286e-05 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.627779+0000", 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0098242399999999997 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.627943+0000", 2024-04-26T07:50:14.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163232 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2123 3.24 3:26dd4659:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.619271+0000", 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.349961127, 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017988131000000001, 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:14.995 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2123 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.619271+0000", 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.619271+0000", 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.619275+0000", 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7529999999999999e-06 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.622765+0000", 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0034899919999999999 2024-04-26T07:50:14.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.622836+0000", 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1895000000000002e-05 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.622872+0000", 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5660000000000001e-05 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.623014+0000", 2024-04-26T07:50:14.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014160600000000001 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.623413+0000", 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039919599999999999 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.623823+0000", 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000409804 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:14.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.636180+0000", 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012357218999999999 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.636980+0000", 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000799867 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637118+0000", 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013799 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637259+0000", 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000141149 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2126 3.24 3:26c3d3bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.679352+0000", 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.289879831, 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014577883999999999, 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.001 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2126 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.679352+0000", 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.679352+0000", 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.679355+0000", 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2799999999999999e-06 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.681966+0000", 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026107909999999999 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.682014+0000", 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8001999999999999e-05 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.682035+0000", 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0557e-05 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.682139+0000", 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010437000000000001 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.682302+0000", 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162554 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.682464+0000", 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016191600000000001 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.689067+0000", 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066033259999999996 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.693792+0000", 2024-04-26T07:50:15.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047249479999999996 2024-04-26T07:50:15.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.693866+0000", 2024-04-26T07:50:15.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4122000000000006e-05 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.693930+0000", 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4017999999999996e-05 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2138 3.24 3:27799388:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.242683200000002, 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019291345000000001, 2024-04-26T07:50:15.007 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2138 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726554+0000", 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1070000000000004e-06 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729580+0000", 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030264699999999999 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729630+0000", 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9574999999999999e-05 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729658+0000", 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8079999999999999e-05 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729848+0000", 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000189898 2024-04-26T07:50:15.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730169+0000", 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032129599999999999 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730446+0000", 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027665600000000002 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.739724+0000", 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0092783829999999994 2024-04-26T07:50:15.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745646+0000", 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059214879999999999 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745753+0000", 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107204 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745840+0000", 2024-04-26T07:50:15.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7188000000000006e-05 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.055222028999999, 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.013 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:15.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:15.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:15.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2147 3.38 3:1e705a67:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 34.028375963999999, 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018669917000000001, 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2147 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940859+0000", 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5300000000000001e-06 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943909+0000", 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030493 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943953+0000", 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4712000000000002e-05 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943981+0000", 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7166e-05 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944134+0000", 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015355999999999999 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944461+0000", 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032647500000000001 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944706+0000", 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024554399999999999 2024-04-26T07:50:15.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.952188+0000", 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074813420000000002 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959218+0000", 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070308560000000003 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959399+0000", 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018032599999999999 2024-04-26T07:50:15.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959526+0000", 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012710600000000001 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2155 3.18 3:1be5c340:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.149046+0000", 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.820186278000001, 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015963552999999998, 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.024 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2155 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.149046+0000", 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.149046+0000", 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.149049+0000", 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.354e-06 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.152072+0000", 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030229860000000001 2024-04-26T07:50:15.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.152124+0000", 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1891999999999997e-05 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.152146+0000", 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.232e-05 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.152316+0000", 2024-04-26T07:50:15.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016970200000000001 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.152713+0000", 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000396938 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.153000+0000", 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028708299999999999 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.161220+0000", 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082199449999999993 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.164913+0000", 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036932890000000002 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.164965+0000", 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1931000000000001e-05 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.165009+0000", 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4113000000000003e-05 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2160 3.38 3:1c2379f3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.699200851000001, 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019223560000000001, 2024-04-26T07:50:15.030 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2160 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:15.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270035+0000", 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3229999999999999e-06 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273499+0000", 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003464033 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273551+0000", 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808999999999998e-05 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273572+0000", 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0639e-05 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273714+0000", 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000142051 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273994+0000", 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028034300000000001 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.274248+0000", 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025402999999999998 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.282877+0000", 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0086282249999999998 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289064+0000", 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061877709999999999 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289171+0000", 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106974 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289255+0000", 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3362000000000006e-05 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2166 3.c e58/17 3:3335ddb9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_55:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:15.036 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.428175+0000", 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.541056671, 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016146494000000001, 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.428175+0000", 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.428175+0000", 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.428178+0000", 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8449999999999999e-06 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.433091+0000", 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049129710000000004 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.433129+0000", 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7731999999999997e-05 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.433147+0000", 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8005000000000001e-05 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.433309+0000", 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162029 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.433358+0000", 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8847000000000002e-05 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.444250+0000", 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010892391 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.444322+0000", 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1674000000000005e-05 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2188 3.24 3:25d3ed6a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.699930+0000", 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.269301724999998, 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017646242999999999, 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2188 2024-04-26T07:50:15.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.699930+0000", 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.699930+0000", 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.699933+0000", 2024-04-26T07:50:15.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2119999999999999e-06 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.701799+0000", 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018652829999999999 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.701837+0000", 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8018000000000001e-05 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.701856+0000", 2024-04-26T07:50:15.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9154e-05 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.701952+0000", 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5946000000000006e-05 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.702072+0000", 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120203 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:15.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.702209+0000", 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013735400000000001 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.707208+0000", 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049981979999999997 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.717438+0000", 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010230505000000001 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.717515+0000", 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6489999999999994e-05 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.717576+0000", 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1879999999999997e-05 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2202 3.19 e59/17 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.867570+0000", 2024-04-26T07:50:15.046 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.101661788999998, 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01706044, 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.867570+0000", 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.867570+0000", 2024-04-26T07:50:15.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.867570+0000", 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9200000000000002e-07 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.868895+0000", 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001324394 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.868918+0000", 2024-04-26T07:50:15.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3175000000000001e-05 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.868931+0000", 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3472000000000001e-05 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.869031+0000", 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9426999999999995e-05 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.869064+0000", 2024-04-26T07:50:15.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3311e-05 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.884562+0000", 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015497357999999999 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.884631+0000", 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9010999999999994e-05 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2210 3.27 3:e7927b22:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.948090+0000", 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.021141784000001, 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015863391000000001, 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2210 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.948090+0000", 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.948090+0000", 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.948093+0000", 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5189999999999999e-06 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.949550+0000", 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014569850000000001 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.949587+0000", 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7839000000000001e-05 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.949604+0000", 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6966999999999999e-05 2024-04-26T07:50:15.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.949691+0000", 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6917999999999997e-05 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.949814+0000", 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012273000000000001 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:15.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.949935+0000", 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120736 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.956665+0000", 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067298999999999996 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963830+0000", 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071657719999999999 2024-04-26T07:50:15.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963903+0000", 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2395000000000001e-05 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.963954+0000", 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0630000000000001e-05 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2214 3.24 3:2785dcb3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.988012+0000", 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.981219828, 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014883062000000001, 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2214 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.988012+0000", 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.988012+0000", 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.988016+0000", 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9770000000000002e-06 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.989753+0000", 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001737099 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.989785+0000", 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1812e-05 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.989801+0000", 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6373000000000001e-05 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.989884+0000", 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3141999999999998e-05 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.990057+0000", 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172132 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.990228+0000", 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017146899999999999 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.995156+0000", 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049281849999999999 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.002753+0000", 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0075967270000000002 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.002833+0000", 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0439999999999996e-05 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.002895+0000", 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1705999999999995e-05 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2220 3.24 3:2595c82c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.048787+0000", 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.920445174999998, 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018005604000000001, 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.062 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2220 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.048787+0000", 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.048787+0000", 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.048790+0000", 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6059999999999999e-06 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.050190+0000", 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013991940000000001 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.050228+0000", 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8667000000000001e-05 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.050245+0000", 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7212999999999999e-05 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.050337+0000", 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1581000000000003e-05 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.050475+0000", 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000137661 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.050592+0000", 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117586 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.055277+0000", 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046851849999999997 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.066705+0000", 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011427410000000001 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.066758+0000", 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2932000000000001e-05 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.066792+0000", 2024-04-26T07:50:15.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4569000000000001e-05 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2226 3.24 3:259572e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.119299+0000", 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.849932604999999, 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018555555000000001, 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.068 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2226 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119299+0000", 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119299+0000", 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.119302+0000", 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3520000000000001e-06 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.121393+0000", 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020910680000000002 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.121429+0000", 2024-04-26T07:50:15.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5920000000000002e-05 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.121441+0000", 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2329e-05 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.121521+0000", 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0057999999999998e-05 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.121640+0000", 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118879 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.121773+0000", 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013267500000000001 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.127185+0000", 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054123050000000001 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.137735+0000", 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010550265 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.137800+0000", 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4726000000000003e-05 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.137855+0000", 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4978000000000001e-05 2024-04-26T07:50:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2232 3.29 3:94db006e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.194565+0000", 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.774667334999997, 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015156819, 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2232 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.194565+0000", 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.194565+0000", 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.194567+0000", 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4710000000000001e-06 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196444+0000", 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018772190000000001 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196466+0000", 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1440000000000001e-05 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196476+0000", 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.978e-06 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196589+0000", 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011370300000000001 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196725+0000", 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013546899999999999 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:15.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196833+0000", 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108175 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.201254+0000", 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004421192 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209634+0000", 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0083802860000000007 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209681+0000", 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6078000000000002e-05 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209721+0000", 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0808e-05 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:15.079 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.670402344999999, 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:15.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:15.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:15.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:15.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.085 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:15.085 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:15.085 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:15.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:15.087 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:15.088 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:15.086+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:15.166 INFO:tasks.workunit.client.0.smithi053.stderr:100+0 records in 2024-04-26T07:50:15.166 INFO:tasks.workunit.client.0.smithi053.stderr:100+0 records out 2024-04-26T07:50:15.167 INFO:tasks.workunit.client.0.smithi053.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 6.92009 s, 152 MB/s 2024-04-26T07:50:15.188 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:15.186+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:15.219 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:15.219 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:15.219 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:15.219 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:15.233 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:15.288 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:15.288 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:15.289 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:15.286+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:15.305 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:15.305 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:15.322 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:15.322 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:15.338 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:15.390 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:15.390 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:15.391 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:15.391 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:15.391 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:15.392 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:15.392 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:15.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:15.393 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:15.390+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:15.397 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:15.397 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:15.415 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:15.493 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:15.490+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:15.562 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:15.562 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:15.577 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:15.594 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:15.590+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:15.695 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:15.694+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:15.743 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:15.743 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:15.759 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:15.796 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:15.794+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:15.897 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:15.894+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:15.923 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:15.923 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:15.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:15.954 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:50:16.027 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:16.026+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:16.099 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:16.098+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:16.106 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:16.106 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:16.120 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:16.200 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:16.198+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:16.288 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:16.288 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:16.301 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:16.298+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:16.302 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:16.402 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:16.398+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:16.420 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:16.421 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:16.435 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:16.503 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:16.502+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:16.552 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:16.553 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:16.566 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:16.607 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:16.606+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:16.705 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:16.702+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:16.731 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:16.731 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:16.745 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:16.806 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:16.802+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:16.864 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:16.864 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:16.878 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:16.907 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:16.906+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:16.940 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:50:17.008 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:17.006+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:17.046 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:17.046 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:17.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:17.109 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:17.106+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:17.197 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:17.197 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:17.210 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:17.206+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:17.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:17.311 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:17.310+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:17.413 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:17.410+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:17.420 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:17.420 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:17.432 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:17.437 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:17.524 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:17.522+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:17.599 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:17.599 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:17.615 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:17.614+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:17.619 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:17.643 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:17.643 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:17.662 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:17.662 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:17.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:17.662 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:17.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.663 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1113 3.6 3:615398ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:17.663 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:17.663 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.393500158000002, 2024-04-26T07:50:17.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015424972, 2024-04-26T07:50:17.663 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.663 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.664 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.664 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.664 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.664 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.664 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1113 2024-04-26T07:50:17.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266301+0000", 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.266304+0000", 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6060000000000001e-06 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270480+0000", 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041759689999999999 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270523+0000", 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2908000000000003e-05 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270541+0000", 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8790000000000001e-05 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270636+0000", 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4690000000000003e-05 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.270821+0000", 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018512100000000001 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.271288+0000", 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00046690099999999998 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.280701+0000", 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0094125839999999999 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281610+0000", 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090926400000000001 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281676+0000", 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5809999999999995e-05 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.281726+0000", 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0328999999999999e-05 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2110 3.23 3:c664601d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.277498682000001, 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017472562000000001, 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.670 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2110 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382303+0000", 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.382305+0000", 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6630000000000002e-06 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.384976+0000", 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026707620000000001 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385010+0000", 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.358e-05 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385026+0000", 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6487999999999999e-05 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385180+0000", 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000153609 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385551+0000", 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000370971 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.385906+0000", 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035550399999999998 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.397683+0000", 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011776426 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399475+0000", 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001792837 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399663+0000", 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018749500000000001 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.399775+0000", 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011222699999999999 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.675 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2114 3.10 e58/17 3:0b5a2810:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_13:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.204902359999998, 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014481571, 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454899+0000", 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454902+0000", 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7800000000000001e-06 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459802+0000", 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049001319999999998 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459839+0000", 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7055999999999999e-05 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.459855+0000", 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6345e-05 2024-04-26T07:50:17.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460023+0000", 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167579 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.460071+0000", 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8046e-05 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469193+0000", 2024-04-26T07:50:17.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091217039999999996 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.469380+0000", 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018792900000000001 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2115 3.12 3:48da4f83:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.198357612999999, 2024-04-26T07:50:17.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020926337, 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2115 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461447+0000", 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464785+0000", 2024-04-26T07:50:17.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033385540000000001 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464814+0000", 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9167e-05 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464832+0000", 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8097999999999999e-05 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464996+0000", 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016315399999999999 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465292+0000", 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029592699999999997 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465562+0000", 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027075899999999997 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.477813+0000", 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012250749 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482150+0000", 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043364340000000001 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482260+0000", 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110204 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482370+0000", 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110234 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2124 3.12 3:48cdd107:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.026568986999997, 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017263152, 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.686 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2124 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633232+0000", 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.633237+0000", 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2690000000000001e-06 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637016+0000", 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0037793480000000001 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637055+0000", 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9138999999999999e-05 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637073+0000", 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8070000000000001e-05 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637251+0000", 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017822500000000001 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.637652+0000", 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00040054000000000001 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.638078+0000", 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00042600299999999999 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.647434+0000", 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093557510000000007 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650193+0000", 2024-04-26T07:50:17.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0027596180000000001 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650366+0000", 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017236899999999999 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.650495+0000", 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012982 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2125 3.17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.003773867, 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02199247, 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2125 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656030+0000", 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.658975+0000", 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029456349999999998 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659019+0000", 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3405999999999997e-05 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659046+0000", 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6659e-05 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659219+0000", 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017387300000000001 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659499+0000", 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279926 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659769+0000", 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026926000000000001 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.668218+0000", 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084496710000000006 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677830+0000", 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096117779999999996 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677932+0000", 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010155800000000001 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.678020+0000", 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8211e-05 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2150 3.39 e58/17 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.635896717000001, 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019626325999999999, 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023907+0000", 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.576e-06 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032657+0000", 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0087502129999999997 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032704+0000", 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7024999999999998e-05 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032725+0000", 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1002999999999999e-05 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032879+0000", 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015357599999999999 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032924+0000", 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5509000000000001e-05 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043391+0000", 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010466787 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043531+0000", 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013963699999999999 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2154 3.6 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.538432546000003, 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018109798999999999, 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.701 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2154 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121369+0000", 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.121373+0000", 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8829999999999999e-06 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124488+0000", 2024-04-26T07:50:17.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0031152179999999999 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124534+0000", 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6615e-05 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124555+0000", 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0377000000000002e-05 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.124721+0000", 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000166226 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125056+0000", 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033541799999999998 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125363+0000", 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030636900000000002 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.138525+0000", 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013161806 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139390+0000", 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00086512899999999996 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139439+0000", 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8795000000000003e-05 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139478+0000", 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9962999999999997e-05 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2156 3.2b 3:d74e6742:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.487986286999998, 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017757953999999999, 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.707 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2156 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171815+0000", 2024-04-26T07:50:17.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.171819+0000", 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5159999999999996e-06 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174698+0000", 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0028785109999999998 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174739+0000", 2024-04-26T07:50:17.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0544999999999999e-05 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174757+0000", 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8267e-05 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.174970+0000", 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021284799999999999 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175288+0000", 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031840500000000001 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.175516+0000", 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022821500000000001 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.183262+0000", 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077455629999999996 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189370+0000", 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061082590000000004 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189505+0000", 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000134554 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.189573+0000", 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8270999999999997e-05 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.712 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2165 3.12 3:48c02635:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.264901281, 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021758514999999999, 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2165 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.713 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394904+0000", 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:50:17.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398287+0000", 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033835380000000002 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398343+0000", 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5148999999999997e-05 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398365+0000", 2024-04-26T07:50:17.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2688999999999999e-05 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398525+0000", 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159801 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398876+0000", 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035097600000000002 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.399237+0000", 2024-04-26T07:50:17.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036067100000000002 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.409713+0000", 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010476348 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416491+0000", 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067777569999999997 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416579+0000", 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412000000000007e-05 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416658+0000", 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9231000000000001e-05 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2167 3.23 3:c5a42c94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.718 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.223827815, 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015687599999999999, 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2167 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435973+0000", 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.435977+0000", 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9899999999999999e-06 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439816+0000", 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038388860000000001 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439841+0000", 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4632000000000001e-05 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.439855+0000", 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.415e-05 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440055+0000", 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019957199999999999 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440486+0000", 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00043156999999999999 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.440829+0000", 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034250799999999999 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.722 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.449821+0000", 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.008992033 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451400+0000", 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001579502 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451504+0000", 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010365399999999999 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.451661+0000", 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015710299999999999 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2169 3.3d 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.193869376000002, 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016653068, 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.724 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2169 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465932+0000", 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.465937+0000", 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0359999999999997e-06 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468355+0000", 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024184660000000002 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468411+0000", 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5594000000000003e-05 2024-04-26T07:50:17.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468440+0000", 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8683e-05 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468600+0000", 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000160061 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.468843+0000", 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000243076 2024-04-26T07:50:17.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.469075+0000", 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023207999999999999 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.476674+0000", 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0075994410000000002 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482385+0000", 2024-04-26T07:50:17.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057110879999999996 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482521+0000", 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000135241 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482585+0000", 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4301999999999995e-05 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2170 3.12 3:48f78380:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.180058336000002, 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019689475000000001, 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2170 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479749+0000", 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7130000000000002e-06 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481893+0000", 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002144048 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481950+0000", 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7192999999999999e-05 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481979+0000", 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9414999999999999e-05 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482084+0000", 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105105 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482257+0000", 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173053 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482414+0000", 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000156498 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.489832+0000", 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074180399999999999 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499155+0000", 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093232509999999994 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499312+0000", 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015707899999999999 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499432+0000", 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012008 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2173 3.1b 3:d9c20b7c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.124248401999999, 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014202282, 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.735 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2173 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535553+0000", 2024-04-26T07:50:17.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.535556+0000", 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2370000000000001e-06 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537406+0000", 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001850108 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537459+0000", 2024-04-26T07:50:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2488000000000003e-05 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537483+0000", 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4839000000000001e-05 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537586+0000", 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010207199999999999 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537761+0000", 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000175482 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.537909+0000", 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014747499999999999 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.543692+0000", 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057834719999999996 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549614+0000", 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059216779999999997 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549690+0000", 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6682999999999997e-05 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.549755+0000", 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4747999999999997e-05 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2190 3.17 3:ea98e33f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.937928442, 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017436619, 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2190 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721873+0000", 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.721876+0000", 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9390000000000002e-06 2024-04-26T07:50:17.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724451+0000", 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025750019999999998 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724476+0000", 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4811e-05 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724490+0000", 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4949e-05 2024-04-26T07:50:17.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724564+0000", 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3774000000000002e-05 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724694+0000", 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012977099999999999 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.724806+0000", 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011196099999999999 2024-04-26T07:50:17.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.732550+0000", 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077441649999999999 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739171+0000", 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0066207799999999997 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739249+0000", 2024-04-26T07:50:17.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8095000000000004e-05 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.739309+0000", 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0371999999999997e-05 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2200 3.1 3:80d4e2c6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.826237282000001, 2024-04-26T07:50:17.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015722348000000001, 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2200 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833564+0000", 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.833566+0000", 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7460000000000001e-06 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835679+0000", 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021130960000000001 2024-04-26T07:50:17.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835704+0000", 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5194e-05 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835716+0000", 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2326e-05 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835834+0000", 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000117939 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.835968+0000", 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013391499999999999 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.836142+0000", 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017374600000000001 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.840818+0000", 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046765790000000002 2024-04-26T07:50:17.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849134+0000", 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0083158650000000004 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849234+0000", 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9629000000000004e-05 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849286+0000", 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2312999999999999e-05 2024-04-26T07:50:17.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2201 3.30 e58/17 3:0c9de3a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_90:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.810671919999997, 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015421710999999999, 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.752 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849129+0000", 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.849130+0000", 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858099+0000", 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089693169999999992 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858132+0000", 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2573000000000001e-05 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858146+0000", 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3750999999999999e-05 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858247+0000", 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101265 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.858271+0000", 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4006e-05 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864493+0000", 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062218079999999997 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.864551+0000", 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8408e-05 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2217 3.2b 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.640161241999998, 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.048883261999999997, 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.756 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2217 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019644+0000", 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9729999999999999e-06 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022277+0000", 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026334779999999999 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022312+0000", 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4737000000000003e-05 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022324+0000", 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1770000000000001e-05 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022410+0000", 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.598e-05 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022601+0000", 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019102100000000001 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022771+0000", 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017026500000000001 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.029808+0000", 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070363259999999999 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068387+0000", 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.038579667999999998 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068459+0000", 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1649000000000005e-05 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068523+0000", 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4394999999999996e-05 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.761 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2238 3.12 3:4adae178:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.388379485999998, 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015875822000000001, 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2238 2024-04-26T07:50:17.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271422+0000", 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.271425+0000", 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.039e-06 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273472+0000", 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0020474669999999999 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273520+0000", 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7289000000000001e-05 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273539+0000", 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9222999999999999e-05 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273640+0000", 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100833 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273805+0000", 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000165854 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.273934+0000", 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000128331 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.281376+0000", 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074421349999999999 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287206+0000", 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058303369999999997 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287258+0000", 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1412000000000002e-05 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.287298+0000", 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9901999999999998e-05 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2239 3.3 e59/17 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head v 59'3, mlcod=58'1)", 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:17.767 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.368937682000002, 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015017188000000001, 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290864+0000", 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:17.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.290865+0000", 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6759999999999999e-06 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296505+0000", 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00564001 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296547+0000", 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2256000000000003e-05 2024-04-26T07:50:17.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296565+0000", 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7856e-05 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296653+0000", 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8113000000000002e-05 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.296681+0000", 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7818999999999999e-05 2024-04-26T07:50:17.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305803+0000", 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.009121901 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.305881+0000", 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7557000000000003e-05 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:17.771 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:17.772 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:17.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:17.774 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:17.774 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:17.775 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:17.777 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:17.774+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:17.788 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:17.789 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:17.873 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:17.870+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:17.922 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:17.922 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:17.922 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:17.949 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:17.991 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:17.990+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:18.075 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:18.074+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:18.147 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:18.147 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:18.147 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:18.147 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:18.147 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:18.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:18.207 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:18.206+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:18.276 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:18.274+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:18.377 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:18.374+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:18.378 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:18.378 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:18.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:18.378 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:18.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.378 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:1110 3.25 3:a41b494f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.1__shadow_.i2RV9iMstAkUXEmvGE-HdLHLIyrPrYn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.133055927999997, 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012576264, 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 1110 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243097+0000", 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.243099+0000", 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.091e-06 2024-04-26T07:50:18.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245358+0000", 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022582739999999998 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245385+0000", 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7535999999999999e-05 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245398+0000", 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2965e-05 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245462+0000", 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4150000000000001e-05 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245564+0000", 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000101828 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.245651+0000", 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7503999999999994e-05 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.252240+0000", 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065883399999999998 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255588+0000", 2024-04-26T07:50:18.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00334805 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255640+0000", 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1904000000000003e-05 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:27.255673+0000", 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3621999999999998e-05 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.385 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:18.385 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:18.385 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.058486189, 2024-04-26T07:50:18.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:18.385 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.386 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.386 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.386 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.386 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.386 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.386 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:18.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:18.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:18.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:18.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:18.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.893827444999999, 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.392 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.393 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.393 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.393 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.393 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:18.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:18.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:18.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:18.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.871953404000003, 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.400 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:18.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:18.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:18.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:18.406 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.329154418000002, 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.407 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:18.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:18.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.277064565000003, 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:18.412 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:18.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.418 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.250576236999997, 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:18.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:18.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:18.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:18.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:18.424 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.082311025999999, 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.425 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:18.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:18.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.625280760999999, 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.432 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:18.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:18.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:18.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:18.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:18.438 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.519466375, 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:18.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:18.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:18.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:18.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:18.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2211 3.4 3:20747335:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.417415687000002, 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012423844999999999, 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2211 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958737+0000", 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.958740+0000", 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.959e-06 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960929+0000", 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021885730000000001 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960958+0000", 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8711999999999999e-05 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.960973+0000", 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5855e-05 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961069+0000", 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5229000000000006e-05 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961252+0000", 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183573 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.961380+0000", 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012739699999999999 2024-04-26T07:50:18.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.970375+0000", 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089949120000000007 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971060+0000", 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00068572900000000005 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971112+0000", 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1697000000000003e-05 2024-04-26T07:50:18.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.971161+0000", 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9209000000000003e-05 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2215 3.0 3:031fd526:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.377285968999999, 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01231753, 2024-04-26T07:50:18.450 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2215 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998867+0000", 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.998870+0000", 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0879999999999999e-06 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000428+0000", 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001558083 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000457+0000", 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.864e-05 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000468+0000", 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1097000000000001e-05 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000538+0000", 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9671000000000004e-05 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000706+0000", 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168417 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.000835+0000", 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012877599999999999 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.005328+0000", 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044927129999999997 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011073+0000", 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0057450840000000001 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011130+0000", 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6997000000000003e-05 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.011185+0000", 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4963999999999998e-05 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.455 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2216 3.1a e59/17 3:5801baf3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_105:head v 59'4, mlcod=58'2)", 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.360941983000004, 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011266452, 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:18.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.015211+0000", 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0200000000000001e-07 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020123+0000", 2024-04-26T07:50:18.457 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049112399999999999 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020158+0000", 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5015000000000003e-05 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020175+0000", 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7099e-05 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020284+0000", 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010912 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.020320+0000", 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6316000000000003e-05 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026418+0000", 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060978500000000001 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.026478+0000", 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.961e-05 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.168705324000001, 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.460 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:18.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2235 3.25 3:a5eb05f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.149180542000003, 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010713906, 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2235 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226973+0000", 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.226976+0000", 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228832+0000", 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001856702 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228861+0000", 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8861999999999999e-05 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228874+0000", 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.228966+0000", 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2201999999999996e-05 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229169+0000", 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020313199999999999 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.229345+0000", 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017556399999999999 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.236963+0000", 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076176789999999996 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237572+0000", 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000609155 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237632+0000", 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0523000000000003e-05 2024-04-26T07:50:18.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.237686+0000", 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4150000000000002e-05 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2613 3.31 3:8eaf08fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.65961994700000004, 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016123849999999999, 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.471 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2613 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716535+0000", 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.849e-06 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717876+0000", 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001341084 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717910+0000", 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3575000000000003e-05 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717925+0000", 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5750999999999999e-05 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718012+0000", 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6472999999999997e-05 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718191+0000", 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017946999999999999 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718360+0000", 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000169154 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.722797+0000", 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044362610000000004 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732580+0000", 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097836820000000001 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732624+0000", 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3213000000000001e-05 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732657+0000", 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3337999999999998e-05 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2618 3.31 3:8daa9f80:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.60634178100000002, 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021000648, 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2618 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769814+0000", 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:18.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771227+0000", 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001413428 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771261+0000", 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3244000000000002e-05 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771276+0000", 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5695000000000001e-05 2024-04-26T07:50:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771351+0000", 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4919000000000006e-05 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771510+0000", 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015855900000000001 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771615+0000", 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010500799999999999 2024-04-26T07:50:18.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.776024+0000", 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044095430000000001 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790685+0000", 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014660678999999999 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790755+0000", 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0364000000000006e-05 2024-04-26T07:50:18.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790812+0000", 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6527000000000003e-05 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2622 3.31 3:8e8c5c0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.56123472100000005, 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019283708, 2024-04-26T07:50:18.482 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2622 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814921+0000", 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7379999999999999e-06 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.815980+0000", 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010592729999999999 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.484 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816013+0000", 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2224999999999997e-05 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816027+0000", 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4688000000000001e-05 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816104+0000", 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6922000000000007e-05 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816273+0000", 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016859399999999999 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816446+0000", 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173554 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.821737+0000", 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052907800000000001 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834069+0000", 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012331701 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834141+0000", 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2568e-05 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834202+0000", 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0665000000000003e-05 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.487 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2645 3.25 3:a675e898:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.061931+0000", 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.31422193599999998, 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012650354000000001, 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2645 2024-04-26T07:50:18.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.061931+0000", 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.061931+0000", 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.061934+0000", 2024-04-26T07:50:18.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7429999999999998e-06 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.064362+0000", 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024285880000000002 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.064398+0000", 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5559000000000003e-05 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.064414+0000", 2024-04-26T07:50:18.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5821e-05 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.064510+0000", 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6384000000000004e-05 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.064681+0000", 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000170524 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.064837+0000", 2024-04-26T07:50:18.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015641400000000001 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073955+0000", 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091182079999999992 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.074468+0000", 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00051265399999999997 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.074518+0000", 2024-04-26T07:50:18.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9631e-05 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.074581+0000", 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3827999999999999e-05 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2654 3.25 3:a5688c21:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.160867+0000", 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.215286486, 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010304845999999999, 2024-04-26T07:50:18.493 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2654 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.160867+0000", 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.160867+0000", 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.160870+0000", 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3670000000000001e-06 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.163121+0000", 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022515410000000001 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.163138+0000", 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6220999999999999e-05 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.163148+0000", 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0122000000000001e-05 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.163230+0000", 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1730999999999994e-05 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.163391+0000", 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016171 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.163490+0000", 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8696000000000005e-05 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.170507+0000", 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070169220000000001 2024-04-26T07:50:18.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.171072+0000", 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00056543200000000004 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.171120+0000", 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7289000000000001e-05 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.171171+0000", 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1814999999999998e-05 2024-04-26T07:50:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.499 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.499 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.499 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:18.499 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:18.499 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:18.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:18.501 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:18.498+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:18.601 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:18.598+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:18.690 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:18.691 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:18.691 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:18.702 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:18.698+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:18.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:18.803 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:18.802+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:18.856 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:18.857 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:18.857 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:18.857 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:18.857 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:18.876 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:18.919 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:18.918+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:18.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:50:19.007 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:19.006+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:19.073 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:19.073 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:19.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:19.073 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:19.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.073 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2103 3.3b e58/17 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:19.073 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:19.073 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.804086063, 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017139903000000001, 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.074 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266571+0000", 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5859999999999999e-06 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275000+0000", 2024-04-26T07:50:19.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084295080000000005 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275062+0000", 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1579000000000001e-05 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275091+0000", 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8563000000000001e-05 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275209+0000", 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118866 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275240+0000", 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0372999999999999e-05 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283650+0000", 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084105450000000002 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283708+0000", 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7883000000000001e-05 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2107 3.2d e58/17 3:b4925b2e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_6:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.737323951, 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012595189, 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.078 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333330+0000", 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.333333+0000", 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2639999999999998e-06 2024-04-26T07:50:19.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337333+0000", 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004000605 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337358+0000", 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4241999999999999e-05 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337370+0000", 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2387e-05 2024-04-26T07:50:19.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337563+0000", 2024-04-26T07:50:19.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000192635 2024-04-26T07:50:19.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.337602+0000", 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9135999999999999e-05 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.345823+0000", 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082215599999999993 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.345926+0000", 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010236 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2113 3.2d e58/17 3:b71e74a3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_12:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.627842229999999, 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012014733, 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.083 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:19.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442812+0000", 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.442814+0000", 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8169999999999999e-06 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446730+0000", 2024-04-26T07:50:19.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0039164589999999997 2024-04-26T07:50:19.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446765+0000", 2024-04-26T07:50:19.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4758999999999997e-05 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446781+0000", 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5733999999999999e-05 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446914+0000", 2024-04-26T07:50:19.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013332200000000001 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.446951+0000", 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7104999999999998e-05 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454717+0000", 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077659970000000002 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.454827+0000", 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010954 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.103614057999998, 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:19.089 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:19.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:19.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:19.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:19.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:19.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:19.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:19.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:19.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:19.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:19.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:19.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:19.097 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.097 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.098 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.098 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2149 3.2e 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.098 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:19.098 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.078028732999996, 2024-04-26T07:50:19.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016993692000000001, 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2149 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992628+0000", 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5959999999999998e-06 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995727+0000", 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003098506 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995778+0000", 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0868999999999997e-05 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995797+0000", 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9128999999999999e-05 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995958+0000", 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016100199999999999 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996233+0000", 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027535400000000001 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996496+0000", 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026286700000000002 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.007925+0000", 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011428880000000001 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009253+0000", 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013284150000000001 2024-04-26T07:50:19.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009433+0000", 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017974500000000001 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009619+0000", 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000186329 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.104 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.002866345000001, 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:19.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:19.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:19.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:19.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:19.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:19.112 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.112 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.112 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.113 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2158 3.1c 3:38bce1b3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.113 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:19.113 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.849763269999997, 2024-04-26T07:50:19.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015533498, 2024-04-26T07:50:19.113 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.113 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.113 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.114 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.114 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.114 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.114 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2158 2024-04-26T07:50:19.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.114 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:19.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220891+0000", 2024-04-26T07:50:19.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.220895+0000", 2024-04-26T07:50:19.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7929999999999999e-06 2024-04-26T07:50:19.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224209+0000", 2024-04-26T07:50:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033143500000000002 2024-04-26T07:50:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224260+0000", 2024-04-26T07:50:19.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0515e-05 2024-04-26T07:50:19.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224288+0000", 2024-04-26T07:50:19.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8189999999999999e-05 2024-04-26T07:50:19.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224463+0000", 2024-04-26T07:50:19.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174909 2024-04-26T07:50:19.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224695+0000", 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023159799999999999 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.224998+0000", 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00030391199999999999 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.234190+0000", 2024-04-26T07:50:19.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091915550000000006 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236135+0000", 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019451430000000001 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236300+0000", 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016472000000000001 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.236425+0000", 2024-04-26T07:50:19.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012481300000000001 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2161 3.0 e58/17 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.773089263999999, 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016578915999999999, 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297568+0000", 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7999999999999999e-06 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300910+0000", 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033417189999999999 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300956+0000", 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6139e-05 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300975+0000", 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8856e-05 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301137+0000", 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162583 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301205+0000", 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7627999999999997e-05 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314035+0000", 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012830187 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314144+0000", 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109004 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.701153834000003, 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.126 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.610394708000001, 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:19.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:19.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:19.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.136 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2169 3.3d e58/17 3:bcc7f099:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_58:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.600566722000003, 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01191763, 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470088+0000", 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.470089+0000", 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.798e-06 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474285+0000", 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041955780000000002 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474328+0000", 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2709000000000001e-05 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474352+0000", 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4273e-05 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474456+0000", 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000103523 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.474484+0000", 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8538999999999999e-05 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481924+0000", 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074399030000000003 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482005+0000", 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1306999999999999e-05 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2194 3.1e 3:79c69c28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.302462757999997, 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013321008000000001, 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2194 2024-04-26T07:50:19.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768192+0000", 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.768194+0000", 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209999999999999e-06 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769679+0000", 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014842239999999999 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769715+0000", 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6514000000000003e-05 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769732+0000", 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6935999999999998e-05 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.769841+0000", 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108564 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.770078+0000", 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000237524 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.770234+0000", 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155721 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.775501+0000", 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00526685 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781386+0000", 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058848950000000002 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781458+0000", 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1898999999999997e-05 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.781513+0000", 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.516e-05 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2231 3.9 e59/17 3:90514a14:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_120:head v 59'1, mlcod=0'0)", 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:19.146 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.885408921, 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010909064, 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185245+0000", 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.185246+0000", 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0999999999999999e-07 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189938+0000", 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046919199999999996 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189957+0000", 2024-04-26T07:50:19.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9358e-05 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.189970+0000", 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2870999999999999e-05 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.190053+0000", 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2515000000000005e-05 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.190079+0000", 2024-04-26T07:50:19.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6871000000000001e-05 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196101+0000", 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060217939999999996 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.196155+0000", 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3325000000000002e-05 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2617 3.2e 3:7791bab5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.759033+0000", 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.311621345, 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015981967, 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2617 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.151 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.759033+0000", 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.759033+0000", 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.759036+0000", 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2389999999999998e-06 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.760756+0000", 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001719691 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.760787+0000", 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0757999999999999e-05 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.760801+0000", 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4385e-05 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.760884+0000", 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2485999999999996e-05 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.761045+0000", 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000161175 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.761150+0000", 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105399 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.765261+0000", 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041108480000000003 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.774929+0000", 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096681389999999992 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.774974+0000", 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4805000000000002e-05 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.775015+0000", 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1041999999999998e-05 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.156 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2621 3.2e 3:750f0425:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.802907+0000", 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.2677475629999999, 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014629882, 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2621 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.802907+0000", 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.802907+0000", 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.802910+0000", 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0419999999999998e-06 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.804104+0000", 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001194594 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.804161+0000", 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6609e-05 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.804178+0000", 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7013000000000001e-05 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.804259+0000", 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1236000000000006e-05 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.804391+0000", 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013116500000000001 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.804486+0000", 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5155000000000006e-05 2024-04-26T07:50:19.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.809183+0000", 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046976700000000001 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.817410+0000", 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082265710000000002 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.817481+0000", 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1457000000000004e-05 2024-04-26T07:50:19.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.817537+0000", 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.537e-05 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.163 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2628 3.1e 3:797d1de5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.163 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.875710+0000", 2024-04-26T07:50:19.163 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.194944534, 2024-04-26T07:50:19.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016337087, 2024-04-26T07:50:19.163 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.163 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.164 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.164 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.164 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.164 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.164 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2628 2024-04-26T07:50:19.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.164 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.875710+0000", 2024-04-26T07:50:19.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.875710+0000", 2024-04-26T07:50:19.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.875714+0000", 2024-04-26T07:50:19.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.67e-06 2024-04-26T07:50:19.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.877527+0000", 2024-04-26T07:50:19.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001813521 2024-04-26T07:50:19.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.877556+0000", 2024-04-26T07:50:19.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8856e-05 2024-04-26T07:50:19.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.877573+0000", 2024-04-26T07:50:19.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7523000000000001e-05 2024-04-26T07:50:19.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.877659+0000", 2024-04-26T07:50:19.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5216999999999994e-05 2024-04-26T07:50:19.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.877842+0000", 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018299700000000001 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.878002+0000", 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016073699999999999 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.883702+0000", 2024-04-26T07:50:19.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0056994760000000002 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.891919+0000", 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082173220000000009 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.891991+0000", 2024-04-26T07:50:19.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1934000000000006e-05 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.892047+0000", 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5834000000000001e-05 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2635 3.21 3:859b1c73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.1233544259999999, 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017892425, 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2635 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947303+0000", 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.455e-06 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949508+0000", 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022040969999999999 2024-04-26T07:50:19.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949528+0000", 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0647999999999999e-05 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949537+0000", 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7790000000000001e-06 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949599+0000", 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1570999999999997e-05 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949767+0000", 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016876099999999999 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949931+0000", 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016320399999999999 2024-04-26T07:50:19.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.953952+0000", 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040214059999999999 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965068+0000", 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011116041 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965140+0000", 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1746000000000001e-05 2024-04-26T07:50:19.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965192+0000", 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2716999999999997e-05 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.0606652030000001, 2024-04-26T07:50:19.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:19.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:19.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:19.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2641 3.9 e71/17 3:922f40a3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_76:head v 71'7, mlcod=59'5)", 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.026703+0000", 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.0439516369999999, 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010393431999999999, 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.026703+0000", 2024-04-26T07:50:19.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.026703+0000", 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.026705+0000", 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0829999999999998e-06 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.031452+0000", 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004747294 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.031488+0000", 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5704999999999998e-05 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.031504+0000", 2024-04-26T07:50:19.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6257e-05 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.031598+0000", 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3554999999999995e-05 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.031622+0000", 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4705000000000001e-05 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037036+0000", 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054132859999999998 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037096+0000", 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0547000000000002e-05 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.191 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.225473443, 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:19.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:19.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:19.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.197 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.198 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.198 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.198 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.198 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:19.199 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:19.200 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:19.198+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:19.300 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:19.298+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:19.401 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:19.398+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:50:19.408 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:19.408 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:19.408 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:19.408 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:19.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:19.502 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:19.498+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:19.603 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:19.598+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:19.624 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:19.624 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:19.624 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:19.624 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:19.624 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:19.644 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:19.731 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:19.730+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:19.804 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:19.802+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:19.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:19.833 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:19.833 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.555075487000003, 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:19.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:19.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.840 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2138 3.24 3:27799388:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 39.102259965999998, 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019291345000000001, 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2138 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.841 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726554+0000", 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1070000000000004e-06 2024-04-26T07:50:19.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729580+0000", 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030264699999999999 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729630+0000", 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9574999999999999e-05 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729658+0000", 2024-04-26T07:50:19.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8079999999999999e-05 2024-04-26T07:50:19.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729848+0000", 2024-04-26T07:50:19.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000189898 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730169+0000", 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032129599999999999 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730446+0000", 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027665600000000002 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.739724+0000", 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0092783829999999994 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745646+0000", 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059214879999999999 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745753+0000", 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107204 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745840+0000", 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7188000000000006e-05 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.847 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.914798795000003, 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.848 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:19.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2147 3.38 3:1e705a67:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.854 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.887952730000002, 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018669917000000001, 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2147 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940859+0000", 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5300000000000001e-06 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943909+0000", 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030493 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943953+0000", 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4712000000000002e-05 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943981+0000", 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7166e-05 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944134+0000", 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015355999999999999 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944461+0000", 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032647500000000001 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944706+0000", 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024554399999999999 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.952188+0000", 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074813420000000002 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959218+0000", 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070308560000000003 2024-04-26T07:50:19.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959399+0000", 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018032599999999999 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959526+0000", 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012710600000000001 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2160 3.38 3:1c2379f3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:19.860 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.558777616999997, 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019223560000000001, 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2160 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270035+0000", 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3229999999999999e-06 2024-04-26T07:50:19.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273499+0000", 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003464033 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273551+0000", 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808999999999998e-05 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273572+0000", 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0639e-05 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273714+0000", 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000142051 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273994+0000", 2024-04-26T07:50:19.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028034300000000001 2024-04-26T07:50:19.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.274248+0000", 2024-04-26T07:50:19.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025402999999999998 2024-04-26T07:50:19.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.282877+0000", 2024-04-26T07:50:19.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0086282249999999998 2024-04-26T07:50:19.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289064+0000", 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061877709999999999 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289171+0000", 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106974 2024-04-26T07:50:19.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289255+0000", 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3362000000000006e-05 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.529979111000003, 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:19.868 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:19.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.994904177, 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.875 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:19.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:19.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:19.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:19.881 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.7782216399999999, 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.882 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:19.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:19.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:19.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:19.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:19.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:19.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.888 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.0055019599999999, 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.889 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:19.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:19.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:19.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.895 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.93184900599999998, 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.896 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:19.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:19.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:19.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:19.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.90314377800000001, 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.903 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.87032321199999996, 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.909 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:19.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:19.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:19.914 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2724 3.29 3:976d7661:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.85776892100000002, 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019962855000000002, 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.915 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2724 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971043+0000", 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9220000000000001e-06 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972756+0000", 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001713551 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972791+0000", 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4579999999999998e-05 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972806+0000", 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4849e-05 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972914+0000", 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010813 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973090+0000", 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017668800000000001 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973260+0000", 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016923 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.980034+0000", 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067747650000000003 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990921+0000", 2024-04-26T07:50:19.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010887000000000001 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990967+0000", 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5593999999999997e-05 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.991003+0000", 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5546000000000002e-05 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.83652940799999997, 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:19.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:19.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:19.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:19.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:19.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:19.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:19.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:19.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:19.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:19.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:19.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:19.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:19.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:19.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2735 3.33 3:cc12dc1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.74264256200000001, 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019612998, 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2735 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086169+0000", 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087881+0000", 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017120709999999999 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087907+0000", 2024-04-26T07:50:19.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5701e-05 2024-04-26T07:50:19.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087917+0000", 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0299000000000001e-05 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087987+0000", 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0617000000000005e-05 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088128+0000", 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014068300000000001 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088258+0000", 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013018799999999999 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.093485+0000", 2024-04-26T07:50:19.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005226718 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105701+0000", 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012216385 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105744+0000", 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2938000000000001e-05 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105779+0000", 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4768000000000003e-05 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.938 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:19.939 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.59877748500000005, 2024-04-26T07:50:19.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:19.939 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.939 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.939 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.939 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.54537057200000005, 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:19.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:19.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:19.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:19.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:19.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:19.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:19.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:19.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.953 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.954 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.954 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2788 3.2 3:42019dbc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:19.954 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:19.954 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.18446294399999999, 2024-04-26T07:50:19.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019599115, 2024-04-26T07:50:19.955 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.955 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.955 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.955 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2788 2024-04-26T07:50:19.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.956 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:19.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:19.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644348+0000", 2024-04-26T07:50:19.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.114e-06 2024-04-26T07:50:19.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645604+0000", 2024-04-26T07:50:19.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001256032 2024-04-26T07:50:19.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645637+0000", 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2877999999999999e-05 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645652+0000", 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5688e-05 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645741+0000", 2024-04-26T07:50:19.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8912000000000005e-05 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645863+0000", 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121846 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645963+0000", 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9592999999999993e-05 2024-04-26T07:50:19.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.650283+0000", 2024-04-26T07:50:19.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043205220000000003 2024-04-26T07:50:19.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663810+0000", 2024-04-26T07:50:19.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013526322 2024-04-26T07:50:19.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663883+0000", 2024-04-26T07:50:19.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3586999999999999e-05 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663945+0000", 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1620999999999998e-05 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2792 3.27 3:e547b6ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:19.963 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.145514797, 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018592296000000001, 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2792 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683297+0000", 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684797+0000", 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015003379999999999 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684821+0000", 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4474e-05 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684835+0000", 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3053e-05 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684916+0000", 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1756999999999997e-05 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685075+0000", 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000158388 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685218+0000", 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143141 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.689955+0000", 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00473698 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701742+0000", 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011787445000000001 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701828+0000", 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701886+0000", 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7955000000000003e-05 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.13478474100000001, 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:19.970 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:19.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:19.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:19.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:19.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:19.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:19.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:19.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:19.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:19.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:19.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:19.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:19.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:19.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:19.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:19.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:19.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:19.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:19.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:19.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:19.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:19.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:19.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:19.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:19.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:19.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:19.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:19.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:19.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:19.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:19.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:19.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:19.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:19.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:19.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:19.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:19.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:19.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:19.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:19.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.981 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.982 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:19.982 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:19.982 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:19.985 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:19.985 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 1Gb. 2024-04-26T07:50:19.985 INFO:tasks.workunit.client.0.smithi053.stdout:upload file successful 2024-04-26T07:50:19.986 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:50:19.986 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-04-26T07:50:19.986 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:50:19.987 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:19.987 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:19.988 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:19.988 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:19.989 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:19.982+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:19.998 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:19.998 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:20.018 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:20.018 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:20.038 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:20.038 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:20.059 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:20.059 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:20.077 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:20.084 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:20.082+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:20.097 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:20.097 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:20.127 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:20.127 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:20.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:20.176 INFO:tasks.workunit.client.0.smithi053.stdout:user qa_user deleted 2024-04-26T07:50:20.176 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:50:20.187 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:20.186+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:20.286 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:20.282+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:20.309 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:20.309 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:20.323 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:20.387 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:20.386+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:20.445 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:20.446 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:20.460 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:20.488 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:20.486+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:20.583 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:20.583 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:20.588 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:20.586+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:20.597 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:20.689 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:20.686+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:20.763 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:20.764 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:20.778 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:20.819 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:20.818+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:20.892 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:20.890+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:20.943 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:20.943 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:20.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:20.992 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:20.990+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:21.093 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:21.090+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:21.124 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:21.124 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:21.139 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:21.193 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:21.190+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:21.294 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:21.290+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:21.305 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:21.305 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:21.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:21.407 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:21.406+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:21.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:50:21.488 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:21.489 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:21.496 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:21.494+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:21.503 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:21.597 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:21.594+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:21.674 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:21.675 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:21.688 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:21.731 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:21.730+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:21.798 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:21.794+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:21.819 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:50:21.855 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:21.856 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:21.870 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:21.911 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:21.910+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:22.000 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:21.998+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:22.035 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:22.035 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:22.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:22.101 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:22.098+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:22.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:22.179 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:22.179 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:22.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:22.239 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:22.238+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:22.259 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:22.259 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:22.275 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:22.276 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:22.277 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T07:50:22.277 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T07:50:22.292 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:22.292 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:22.303 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:22.302+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:22.308 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:22.309 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:22.326 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:22.326 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:22.326 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:22.327 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:22.327 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:22.329 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:22.329 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:22.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:22.350 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:22.350 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:22.371 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:22.372 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:22.392 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:22.392 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:22.404 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:22.402+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2115 3.12 3:48da4f83:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.003691551000003, 2024-04-26T07:50:22.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020926337, 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2115 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461447+0000", 2024-04-26T07:50:22.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464785+0000", 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033385540000000001 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464814+0000", 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9167e-05 2024-04-26T07:50:22.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464832+0000", 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8097999999999999e-05 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464996+0000", 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016315399999999999 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465292+0000", 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029592699999999997 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465562+0000", 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027075899999999997 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.477813+0000", 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012250749 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482150+0000", 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043364340000000001 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482260+0000", 2024-04-26T07:50:22.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110204 2024-04-26T07:50:22.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482370+0000", 2024-04-26T07:50:22.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110234 2024-04-26T07:50:22.476 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.476 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2125 3.17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.809107804999996, 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02199247, 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.477 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2125 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656030+0000", 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.658975+0000", 2024-04-26T07:50:22.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029456349999999998 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659019+0000", 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3405999999999997e-05 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659046+0000", 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6659e-05 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659219+0000", 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017387300000000001 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659499+0000", 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279926 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659769+0000", 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026926000000000001 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.668218+0000", 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084496710000000006 2024-04-26T07:50:22.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677830+0000", 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096117779999999996 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677932+0000", 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010155800000000001 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.678020+0000", 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8211e-05 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2150 3.39 e58/17 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.441230654999998, 2024-04-26T07:50:22.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019626325999999999, 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:22.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023907+0000", 2024-04-26T07:50:22.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.576e-06 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032657+0000", 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0087502129999999997 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032704+0000", 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7024999999999998e-05 2024-04-26T07:50:22.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032725+0000", 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1002999999999999e-05 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032879+0000", 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015357599999999999 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032924+0000", 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5509000000000001e-05 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043391+0000", 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010466787 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043531+0000", 2024-04-26T07:50:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013963699999999999 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2165 3.12 3:48c02635:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.070235218999997, 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021758514999999999, 2024-04-26T07:50:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2165 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:22.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394904+0000", 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398287+0000", 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033835380000000002 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398343+0000", 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5148999999999997e-05 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398365+0000", 2024-04-26T07:50:22.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2688999999999999e-05 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398525+0000", 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159801 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398876+0000", 2024-04-26T07:50:22.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035097600000000002 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.399237+0000", 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036067100000000002 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.409713+0000", 2024-04-26T07:50:22.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010476348 2024-04-26T07:50:22.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416491+0000", 2024-04-26T07:50:22.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067777569999999997 2024-04-26T07:50:22.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416579+0000", 2024-04-26T07:50:22.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412000000000007e-05 2024-04-26T07:50:22.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416658+0000", 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9231000000000001e-05 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2170 3.12 3:48f78380:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.985392273999999, 2024-04-26T07:50:22.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019689475000000001, 2024-04-26T07:50:22.499 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.499 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.499 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.499 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.499 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.499 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.499 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2170 2024-04-26T07:50:22.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.500 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.500 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:22.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.501 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:22.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.501 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.501 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.501 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479749+0000", 2024-04-26T07:50:22.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7130000000000002e-06 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481893+0000", 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002144048 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481950+0000", 2024-04-26T07:50:22.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7192999999999999e-05 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481979+0000", 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9414999999999999e-05 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482084+0000", 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105105 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482257+0000", 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173053 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482414+0000", 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000156498 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.489832+0000", 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074180399999999999 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499155+0000", 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093232509999999994 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499312+0000", 2024-04-26T07:50:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015707899999999999 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499432+0000", 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012008 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.506 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2217 3.2b 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.445495180000002, 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.048883261999999997, 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2217 2024-04-26T07:50:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019644+0000", 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9729999999999999e-06 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022277+0000", 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026334779999999999 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022312+0000", 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4737000000000003e-05 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022324+0000", 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1770000000000001e-05 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.510 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022410+0000", 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.598e-05 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022601+0000", 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019102100000000001 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022771+0000", 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017026500000000001 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.029808+0000", 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070363259999999999 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068387+0000", 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.038579667999999998 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068459+0000", 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1649000000000005e-05 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068523+0000", 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4394999999999996e-05 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2629 3.1b 3:d913bab3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.886295+0000", 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.5788402100000001, 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018600816999999999, 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2629 2024-04-26T07:50:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.886295+0000", 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.886295+0000", 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.886297+0000", 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2309999999999999e-06 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888032+0000", 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001734633 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888062+0000", 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0241000000000001e-05 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888077+0000", 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.449e-05 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888167+0000", 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0818999999999999e-05 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888358+0000", 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019062899999999999 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888547+0000", 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018942899999999999 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.894141+0000", 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055935680000000002 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.904766+0000", 2024-04-26T07:50:22.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010625044 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.904837+0000", 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1293999999999999e-05 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.904896+0000", 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8439000000000001e-05 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.520 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2630 3.17 3:e87f5a64:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.897438+0000", 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.5676970800000003, 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01965385, 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.521 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2630 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.897438+0000", 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.897438+0000", 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.897440+0000", 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.035e-06 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.898974+0000", 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533668 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899003+0000", 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9434999999999999e-05 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899017+0000", 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3944000000000001e-05 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899101+0000", 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3850000000000005e-05 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899229+0000", 2024-04-26T07:50:22.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012840799999999999 2024-04-26T07:50:22.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:22.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899343+0000", 2024-04-26T07:50:22.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364100000000001 2024-04-26T07:50:22.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.903927+0000", 2024-04-26T07:50:22.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004583752 2024-04-26T07:50:22.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.916895+0000", 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012968307 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.917012+0000", 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116801 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.917092+0000", 2024-04-26T07:50:22.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0008999999999999e-05 2024-04-26T07:50:22.529 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.529 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.529 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2647 3.2b 3:d540411f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.084182+0000", 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.3809526889999999, 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020986392, 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.530 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2647 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.084182+0000", 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.084182+0000", 2024-04-26T07:50:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.084185+0000", 2024-04-26T07:50:22.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.672e-06 2024-04-26T07:50:22.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.085974+0000", 2024-04-26T07:50:22.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00178879 2024-04-26T07:50:22.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086126+0000", 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015175 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086144+0000", 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7995999999999998e-05 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086225+0000", 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1113999999999996e-05 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086364+0000", 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013927000000000001 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086470+0000", 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106388 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.091752+0000", 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052820080000000004 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.105093+0000", 2024-04-26T07:50:22.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013340588 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.105134+0000", 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1360999999999999e-05 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.105169+0000", 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4455000000000001e-05 2024-04-26T07:50:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2649 3.12 3:48f3a6ed:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.108019+0000", 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.35711621, 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022712999000000001, 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.538 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2649 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.108019+0000", 2024-04-26T07:50:22.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.540 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.540 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.108019+0000", 2024-04-26T07:50:22.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.108023+0000", 2024-04-26T07:50:22.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9360000000000001e-06 2024-04-26T07:50:22.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110631+0000", 2024-04-26T07:50:22.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026085639999999998 2024-04-26T07:50:22.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110655+0000", 2024-04-26T07:50:22.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3127000000000001e-05 2024-04-26T07:50:22.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110668+0000", 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3166999999999999e-05 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110753+0000", 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5315999999999994e-05 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110928+0000", 2024-04-26T07:50:22.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174458 2024-04-26T07:50:22.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.111105+0000", 2024-04-26T07:50:22.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000177176 2024-04-26T07:50:22.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.119709+0000", 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0086047940000000007 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.130569+0000", 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010859405000000001 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.130675+0000", 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010568700000000001 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.130732+0000", 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7368999999999999e-05 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2660 3.1b 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.224493+0000", 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.2406424520000003, 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.030430860000000001, 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.547 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2660 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.224493+0000", 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.224493+0000", 2024-04-26T07:50:22.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.224495+0000", 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3690000000000001e-06 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226364+0000", 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018685010000000001 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226398+0000", 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4309e-05 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226413+0000", 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4744e-05 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226501+0000", 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8752999999999995e-05 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226684+0000", 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000182404 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226809+0000", 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012490299999999999 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.231334+0000", 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045258049999999999 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.254843+0000", 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023508476 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.254890+0000", 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7138000000000002e-05 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.254924+0000", 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3457999999999997e-05 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.553 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2662 3.1 3:833b8d5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.244173+0000", 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.2209619219999999, 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020738194000000001, 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2662 2024-04-26T07:50:22.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.244173+0000", 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.244173+0000", 2024-04-26T07:50:22.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.244176+0000", 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.245883+0000", 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017072879999999999 2024-04-26T07:50:22.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.245917+0000", 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3798999999999999e-05 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.245931+0000", 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4194e-05 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.246013+0000", 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1724000000000006e-05 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.246193+0000", 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018060299999999999 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.246358+0000", 2024-04-26T07:50:22.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016459800000000001 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.251514+0000", 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051561910000000001 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.264797+0000", 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013283410000000001 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.264860+0000", 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3029999999999998e-05 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.264911+0000", 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1073999999999999e-05 2024-04-26T07:50:22.560 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2671 3.2b 3:d4583fbc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.358869+0000", 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.1062658289999998, 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019875152, 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.561 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2671 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.358869+0000", 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.358869+0000", 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.358873+0000", 2024-04-26T07:50:22.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5149999999999998e-06 2024-04-26T07:50:22.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.360739+0000", 2024-04-26T07:50:22.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018658539999999999 2024-04-26T07:50:22.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.360770+0000", 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1646000000000002e-05 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.360785+0000", 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4963999999999999e-05 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.360889+0000", 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010397500000000001 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.361083+0000", 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019397199999999999 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.361305+0000", 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022189399999999999 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.366539+0000", 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052334440000000003 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.378600+0000", 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012061296000000001 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.378695+0000", 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5325e-05 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.378744+0000", 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9267000000000001e-05 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2691 3.17 3:e90e392a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.569 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.620832+0000", 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.8443032160000001, 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019273542000000001, 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.570 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2691 2024-04-26T07:50:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.620832+0000", 2024-04-26T07:50:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.620832+0000", 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.620834+0000", 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2929999999999999e-06 2024-04-26T07:50:22.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622225+0000", 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013904150000000001 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622260+0000", 2024-04-26T07:50:22.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5728000000000001e-05 2024-04-26T07:50:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622277+0000", 2024-04-26T07:50:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6141e-05 2024-04-26T07:50:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622355+0000", 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8233999999999997e-05 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622481+0000", 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012611999999999999 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622609+0000", 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012767400000000001 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.627444+0000", 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0048357000000000001 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.639985+0000", 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012540581 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.640052+0000", 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7052999999999997e-05 2024-04-26T07:50:22.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.640105+0000", 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3603000000000002e-05 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.578 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2705 3.12 3:4a41f3de:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.773678+0000", 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.691456922, 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019953551999999999, 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.579 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2705 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.773678+0000", 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.773678+0000", 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.773681+0000", 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3779999999999999e-06 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775182+0000", 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015017299999999999 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775210+0000", 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7356999999999999e-05 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775220+0000", 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0516000000000001e-05 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775288+0000", 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8275999999999995e-05 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775400+0000", 2024-04-26T07:50:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111697 2024-04-26T07:50:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775492+0000", 2024-04-26T07:50:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1625000000000005e-05 2024-04-26T07:50:22.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.780063+0000", 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045715130000000001 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.793523+0000", 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013460078 2024-04-26T07:50:22.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.793592+0000", 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8586999999999999e-05 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.793632+0000", 2024-04-26T07:50:22.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9795000000000001e-05 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2709 3.1b 3:d991ebe6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.812929+0000", 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.6522066199999998, 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018202975999999999, 2024-04-26T07:50:22.587 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2709 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.812929+0000", 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.812929+0000", 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.812931+0000", 2024-04-26T07:50:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.357e-06 2024-04-26T07:50:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814619+0000", 2024-04-26T07:50:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001687612 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814651+0000", 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2447000000000003e-05 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814665+0000", 2024-04-26T07:50:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3733999999999999e-05 2024-04-26T07:50:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814743+0000", 2024-04-26T07:50:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7820999999999999e-05 2024-04-26T07:50:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814893+0000", 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150505 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814989+0000", 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5594000000000007e-05 2024-04-26T07:50:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.819898+0000", 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049089479999999998 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.831055+0000", 2024-04-26T07:50:22.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011157031 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.831099+0000", 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4849999999999999e-05 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.831132+0000", 2024-04-26T07:50:22.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2076999999999998e-05 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2736 3.1b 3:d8556e1c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.096123+0000", 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.3690123559999998, 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021801480000000002, 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.596 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2736 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096123+0000", 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096123+0000", 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096126+0000", 2024-04-26T07:50:22.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.196e-06 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098121+0000", 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001994642 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098146+0000", 2024-04-26T07:50:22.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5096000000000002e-05 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098156+0000", 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9709999999999999e-06 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098235+0000", 2024-04-26T07:50:22.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8800000000000004e-05 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098372+0000", 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000137429 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098472+0000", 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010026099999999999 2024-04-26T07:50:22.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105286+0000", 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068139200000000002 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.117767+0000", 2024-04-26T07:50:22.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012480415 2024-04-26T07:50:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.117841+0000", 2024-04-26T07:50:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4467000000000004e-05 2024-04-26T07:50:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.117924+0000", 2024-04-26T07:50:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3282999999999995e-05 2024-04-26T07:50:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2757 3.12 3:4ac1b8c0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.319709+0000", 2024-04-26T07:50:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.14542593, 2024-04-26T07:50:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020174963000000001, 2024-04-26T07:50:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.605 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2757 2024-04-26T07:50:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.319709+0000", 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.319709+0000", 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.319713+0000", 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.597e-06 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322276+0000", 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002563058 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322307+0000", 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0660999999999997e-05 2024-04-26T07:50:22.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322323+0000", 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6215999999999999e-05 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322417+0000", 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4327999999999995e-05 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322614+0000", 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019705800000000001 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322802+0000", 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018818700000000001 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.327896+0000", 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050939369999999998 2024-04-26T07:50:22.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.339741+0000", 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011844397 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.339821+0000", 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0396999999999996e-05 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.339884+0000", 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3126999999999994e-05 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2784 3.2b 3:d70e3d8e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.601698+0000", 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 2.863437078, 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022486066999999998, 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.612 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2784 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.601698+0000", 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.601698+0000", 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.601701+0000", 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.785e-06 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603129+0000", 2024-04-26T07:50:22.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014280460000000001 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603163+0000", 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3767999999999999e-05 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603178+0000", 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5758999999999999e-05 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603286+0000", 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010778299999999999 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603539+0000", 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025247300000000002 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:22.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603741+0000", 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020206900000000001 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.609158+0000", 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054172420000000001 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.624046+0000", 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014888083999999999 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.624121+0000", 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4864999999999996e-05 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.624184+0000", 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3193000000000003e-05 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2796 3.1b 3:dbe4e1f9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.725571+0000", 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 2.7395643089999999, 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018832166000000001, 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:22.619 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2796 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.725571+0000", 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.725571+0000", 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.725574+0000", 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3629999999999998e-06 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727097+0000", 2024-04-26T07:50:22.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015227730000000001 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727132+0000", 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5040000000000003e-05 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:22.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727147+0000", 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5410999999999999e-05 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727244+0000", 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6281999999999997e-05 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727404+0000", 2024-04-26T07:50:22.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000160569 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727560+0000", 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015576899999999999 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:22.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.732803+0000", 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052429269999999997 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.744288+0000", 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011485067 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.744329+0000", 2024-04-26T07:50:22.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0856999999999999e-05 2024-04-26T07:50:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.744403+0000", 2024-04-26T07:50:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4108000000000003e-05 2024-04-26T07:50:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.626 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:22.627 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:22.629 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:22.629 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:22.626+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:22.729 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:22.726+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:22.808 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:22.808 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:22.808 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:22.808 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:22.824 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:22.830 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:22.826+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:22.931 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:22.930+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:22.990 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:22.990 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:22.990 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:22.990 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:22.991 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:23.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:23.033 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:23.030+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:23.134 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:23.130+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:23.181 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:23.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.859854411999997, 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.182 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:23.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.695195667999997, 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.188 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:23.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:23.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.673321627, 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:23.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:23.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.200 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.130522640999999, 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:23.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.078432788000001, 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.205 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:23.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:23.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.051944460000001, 2024-04-26T07:50:23.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:23.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.883679248999997, 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:23.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.426648984000003, 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.221 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:23.225 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.320834597999998, 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:23.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.232 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.970073546999998, 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:23.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:23.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.238 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2613 3.31 3:8eaf08fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.4609881700000003, 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016123849999999999, 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.239 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2613 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716535+0000", 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.849e-06 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717876+0000", 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001341084 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717910+0000", 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3575000000000003e-05 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717925+0000", 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5750999999999999e-05 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718012+0000", 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6472999999999997e-05 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718191+0000", 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017946999999999999 2024-04-26T07:50:23.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718360+0000", 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000169154 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.722797+0000", 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044362610000000004 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732580+0000", 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097836820000000001 2024-04-26T07:50:23.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732624+0000", 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3213000000000001e-05 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732657+0000", 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3337999999999998e-05 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.244 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2618 3.31 3:8daa9f80:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.4077100040000001, 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021000648, 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2618 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769814+0000", 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:23.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771227+0000", 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001413428 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771261+0000", 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3244000000000002e-05 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771276+0000", 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5695000000000001e-05 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771351+0000", 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4919000000000006e-05 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771510+0000", 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015855900000000001 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771615+0000", 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010500799999999999 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.776024+0000", 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044095430000000001 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790685+0000", 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014660678999999999 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790755+0000", 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0364000000000006e-05 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790812+0000", 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6527000000000003e-05 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2622 3.31 3:8e8c5c0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:23.250 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.3626029439999998, 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019283708, 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2622 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814921+0000", 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7379999999999999e-06 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.815980+0000", 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010592729999999999 2024-04-26T07:50:23.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816013+0000", 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2224999999999997e-05 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816027+0000", 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4688000000000001e-05 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816104+0000", 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6922000000000007e-05 2024-04-26T07:50:23.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816273+0000", 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016859399999999999 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816446+0000", 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173554 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.821737+0000", 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052907800000000001 2024-04-26T07:50:23.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834069+0000", 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012331701 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834141+0000", 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2568e-05 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834202+0000", 2024-04-26T07:50:23.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0665000000000003e-05 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2688 3.25 3:a6896c0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.6021986970000004, 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013724867, 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.256 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2688 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575325+0000", 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9080000000000002e-06 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576920+0000", 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001595754 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576950+0000", 2024-04-26T07:50:23.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0108999999999999e-05 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576965+0000", 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4632e-05 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577061+0000", 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5629000000000002e-05 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577244+0000", 2024-04-26T07:50:23.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018314500000000001 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577371+0000", 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012685300000000001 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588321+0000", 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010950766000000001 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588646+0000", 2024-04-26T07:50:23.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032420499999999999 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588932+0000", 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028667599999999998 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.589047+0000", 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011519 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2707 3.31 3:8c445c82:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.3867034089999999, 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020245384000000002, 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2707 2024-04-26T07:50:23.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790821+0000", 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4489999999999999e-06 2024-04-26T07:50:23.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792513+0000", 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00169125 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792538+0000", 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5252000000000001e-05 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792552+0000", 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3726999999999999e-05 2024-04-26T07:50:23.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792641+0000", 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9653000000000004e-05 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792813+0000", 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017224499999999999 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792980+0000", 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167023 2024-04-26T07:50:23.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.798223+0000", 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052425789999999998 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.810923+0000", 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012700438 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811000+0000", 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6526000000000006e-05 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811063+0000", 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3242000000000002e-05 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2731 3.1a e71/17 3:5858a56a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_166:head v 71'9, mlcod=59'7)", 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.127070861, 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01359636, 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050452+0000", 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9149999999999999e-06 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056374+0000", 2024-04-26T07:50:23.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059220490000000004 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056474+0000", 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9864000000000005e-05 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056491+0000", 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6982000000000001e-05 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056577+0000", 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5591000000000001e-05 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056606+0000", 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9422000000000001e-05 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.063970+0000", 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073637859999999998 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.064047+0000", 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6750999999999998e-05 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2738 3.31 3:8c882a39:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.0609438730000003, 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017775144, 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2738 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116581+0000", 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9700000000000001e-06 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118803+0000", 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022217349999999999 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118829+0000", 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5596999999999999e-05 2024-04-26T07:50:23.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118841+0000", 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2081e-05 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118923+0000", 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2106000000000003e-05 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119094+0000", 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017146300000000001 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119258+0000", 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016377899999999999 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.126373+0000", 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071146250000000003 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134224+0000", 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078514399999999995 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134297+0000", 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2970000000000001e-05 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134353+0000", 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5377999999999997e-05 2024-04-26T07:50:23.277 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2745 3.31 3:8c638261:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.9892462599999998, 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018680489000000002, 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.278 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2745 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188277+0000", 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8640000000000001e-06 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189907+0000", 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016299159999999999 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189933+0000", 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5853000000000001e-05 2024-04-26T07:50:23.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189943+0000", 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9820000000000003e-06 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190027+0000", 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4330000000000001e-05 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190196+0000", 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016852800000000001 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190345+0000", 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014998400000000001 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.195338+0000", 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049923720000000001 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206878+0000", 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011540323999999999 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206921+0000", 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3034999999999997e-05 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206956+0000", 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4301000000000002e-05 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2776 3.25 3:a7a5804f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.661587419, 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013668700000000001, 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2776 2024-04-26T07:50:23.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515938+0000", 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0940000000000001e-06 2024-04-26T07:50:23.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517635+0000", 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016974589999999999 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517659+0000", 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3862999999999998e-05 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517673+0000", 2024-04-26T07:50:23.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3427999999999999e-05 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517744+0000", 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0921999999999996e-05 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517749+0000", 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3410000000000002e-06 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521369+0000", 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036196499999999999 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521513+0000", 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144776 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521661+0000", 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014765000000000001 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.528887+0000", 2024-04-26T07:50:23.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072261560000000001 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529481+0000", 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00059366900000000001 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529549+0000", 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8368999999999995e-05 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529603+0000", 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3322999999999998e-05 2024-04-26T07:50:23.289 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2789 3.31 3:8feca985:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.523183854, 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017716994999999999, 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.290 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2789 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654339+0000", 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7829999999999999e-06 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655814+0000", 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014750449999999999 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655840+0000", 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5401e-05 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655850+0000", 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0454e-05 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655917+0000", 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7022999999999998e-05 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656068+0000", 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151321 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656189+0000", 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120974 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.660660+0000", 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044709609999999999 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671924+0000", 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011264055 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671999+0000", 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4072000000000005e-05 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.672054+0000", 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5906000000000003e-05 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.295 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:23.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:23.297 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:23.294+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:23.397 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:23.394+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:23.473 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:23.473 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:23.473 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:23.473 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:23.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:23.531 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:23.530+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:23.599 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:23.598+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:23.661 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:23.662 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:23.662 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:23.662 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:23.662 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:23.676 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:23.700 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:23.698+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:23.800 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:23.798+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:23.841 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:50:23.849 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:23.850 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:23.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:23.850 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:23.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.850 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2103 3.3b e58/17 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:23.851 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:23.851 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.580548317999998, 2024-04-26T07:50:23.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017139903000000001, 2024-04-26T07:50:23.851 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.851 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.852 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.852 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:23.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:23.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266571+0000", 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5859999999999999e-06 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275000+0000", 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084295080000000005 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275062+0000", 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1579000000000001e-05 2024-04-26T07:50:23.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275091+0000", 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8563000000000001e-05 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275209+0000", 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118866 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275240+0000", 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0372999999999999e-05 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283650+0000", 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084105450000000002 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283708+0000", 2024-04-26T07:50:23.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7883000000000001e-05 2024-04-26T07:50:23.857 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.857 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.858 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.858 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:23.858 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:23.858 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.880076313000004, 2024-04-26T07:50:23.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:23.859 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.859 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.859 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.859 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.859 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.859 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.860 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:23.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.860 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:23.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:23.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:23.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:23.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:23.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:23.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:23.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:23.867 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2149 3.2e 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.854490988000002, 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016993692000000001, 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2149 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:23.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992628+0000", 2024-04-26T07:50:23.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5959999999999998e-06 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995727+0000", 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003098506 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995778+0000", 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0868999999999997e-05 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995797+0000", 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9128999999999999e-05 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995958+0000", 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016100199999999999 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996233+0000", 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027535400000000001 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996496+0000", 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026286700000000002 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.007925+0000", 2024-04-26T07:50:23.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011428880000000001 2024-04-26T07:50:23.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009253+0000", 2024-04-26T07:50:23.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013284150000000001 2024-04-26T07:50:23.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009433+0000", 2024-04-26T07:50:23.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017974500000000001 2024-04-26T07:50:23.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009619+0000", 2024-04-26T07:50:23.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000186329 2024-04-26T07:50:23.876 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.779328599999999, 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:23.877 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:23.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:23.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:23.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:23.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:23.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:23.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:23.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:23.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:23.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:23.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:23.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:23.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:23.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:23.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:23.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:23.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:23.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:23.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:23.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:23.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:23.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:23.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:23.888 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.888 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.889 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.889 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2161 3.0 e58/17 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:23.889 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:23.889 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.549551518999998, 2024-04-26T07:50:23.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016578915999999999, 2024-04-26T07:50:23.890 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.890 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.890 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.890 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:23.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297568+0000", 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7999999999999999e-06 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300910+0000", 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033417189999999999 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300956+0000", 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6139e-05 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300975+0000", 2024-04-26T07:50:23.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8856e-05 2024-04-26T07:50:23.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301137+0000", 2024-04-26T07:50:23.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162583 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301205+0000", 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7627999999999997e-05 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314035+0000", 2024-04-26T07:50:23.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012830187 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314144+0000", 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109004 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.477616089000001, 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:23.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:23.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:23.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:23.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:23.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:23.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.904 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:23.904 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:23.904 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.386856963, 2024-04-26T07:50:23.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:23.904 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.904 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.904 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.904 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:23.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:23.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:23.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:23.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:23.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:23.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:23.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.909 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2635 3.21 3:859b1c73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.8998166809999999, 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017892425, 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.910 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2635 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947303+0000", 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.455e-06 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949508+0000", 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022040969999999999 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949528+0000", 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0647999999999999e-05 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949537+0000", 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7790000000000001e-06 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949599+0000", 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1570999999999997e-05 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949767+0000", 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016876099999999999 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949931+0000", 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016320399999999999 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.953952+0000", 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040214059999999999 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965068+0000", 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011116041 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965140+0000", 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1746000000000001e-05 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965192+0000", 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2716999999999997e-05 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.8371274580000003, 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:23.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:23.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:23.922 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.922 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.922 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.922 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.0019356979999996, 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:23.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:23.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:23.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:23.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2734 3.1e 3:7bc4dd61:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:23.931 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.7723055629999998, 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022112987000000001, 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2734 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074814+0000", 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8169999999999999e-06 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076636+0000", 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018219670000000001 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076668+0000", 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076684+0000", 2024-04-26T07:50:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5228000000000001e-05 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076777+0000", 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3751000000000004e-05 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076907+0000", 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129899 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.077003+0000", 2024-04-26T07:50:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5314000000000003e-05 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.081365+0000", 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043621709999999998 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096804+0000", 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015438825999999999 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096870+0000", 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6407000000000003e-05 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096924+0000", 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4027999999999998e-05 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2744 3.1e 3:78569fb3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:23.937 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.668418559, 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017953593, 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2744 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:23.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178701+0000", 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180304+0000", 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016031929999999999 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180330+0000", 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5635000000000001e-05 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180341+0000", 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0869999999999999e-05 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180418+0000", 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7293999999999996e-05 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180593+0000", 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017473900000000001 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180741+0000", 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014776700000000001 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.185523+0000", 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047823859999999996 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196576+0000", 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011052674 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196618+0000", 2024-04-26T07:50:23.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2286000000000001e-05 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196652+0000", 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3859000000000002e-05 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2746 3.21 3:86d1a7b8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.6486367230000001, 2024-04-26T07:50:23.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016733074000000001, 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2746 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198482+0000", 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.058e-06 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199898+0000", 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014155540000000001 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199929+0000", 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1108000000000001e-05 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199940+0000", 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1539000000000001e-05 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200021+0000", 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0721000000000002e-05 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200172+0000", 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015134 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200276+0000", 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000103664 2024-04-26T07:50:23.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.205355+0000", 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050790100000000001 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215085+0000", 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097300289999999994 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215160+0000", 2024-04-26T07:50:23.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4981999999999995e-05 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215213+0000", 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3069000000000003e-05 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2756 3.21 3:840e6052:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.5402912200000003, 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016860624000000001, 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2756 2024-04-26T07:50:23.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306829+0000", 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.207e-06 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308004+0000", 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011756620000000001 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308025+0000", 2024-04-26T07:50:23.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1101e-05 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308036+0000", 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0796e-05 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308177+0000", 2024-04-26T07:50:23.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000140445 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308324+0000", 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000147112 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308438+0000", 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114506 2024-04-26T07:50:23.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.316220+0000", 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077820950000000002 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323522+0000", 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073011839999999996 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323607+0000", 2024-04-26T07:50:23.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5148000000000005e-05 2024-04-26T07:50:23.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323686+0000", 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9368000000000003e-05 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2774 3.21 3:85ac5c16:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:23.957 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.3500819970000002, 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022721992, 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2774 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497037+0000", 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2970000000000002e-06 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498369+0000", 2024-04-26T07:50:23.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001332106 2024-04-26T07:50:23.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498402+0000", 2024-04-26T07:50:23.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2490000000000002e-05 2024-04-26T07:50:23.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498416+0000", 2024-04-26T07:50:23.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4922999999999999e-05 2024-04-26T07:50:23.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498506+0000", 2024-04-26T07:50:23.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9040000000000001e-05 2024-04-26T07:50:23.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498514+0000", 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1550000000000007e-06 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500799+0000", 2024-04-26T07:50:23.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002284861 2024-04-26T07:50:23.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500953+0000", 2024-04-26T07:50:23.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015486800000000001 2024-04-26T07:50:23.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.501099+0000", 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014553499999999999 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.505865+0000", 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047655589999999999 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519642+0000", 2024-04-26T07:50:23.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013777608 2024-04-26T07:50:23.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519710+0000", 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7702999999999999e-05 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519757+0000", 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6847000000000001e-05 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.967 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2781 3.2e 3:775249ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.2762840969999996, 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018031374999999999, 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.968 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2781 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:23.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:23.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570835+0000", 2024-04-26T07:50:23.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.667e-06 2024-04-26T07:50:23.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572336+0000", 2024-04-26T07:50:23.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015002940000000001 2024-04-26T07:50:23.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572370+0000", 2024-04-26T07:50:23.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4836000000000003e-05 2024-04-26T07:50:23.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572385+0000", 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4649e-05 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572477+0000", 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2167e-05 2024-04-26T07:50:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572682+0000", 2024-04-26T07:50:23.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000205183 2024-04-26T07:50:23.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572864+0000", 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018175299999999999 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.578265+0000", 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054013330000000003 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588708+0000", 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01044279 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588790+0000", 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2039000000000005e-05 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588864+0000", 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3664000000000005e-05 2024-04-26T07:50:23.976 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2786 3.2e 3:7579d053:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.2238321609999998, 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016821571, 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2786 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623288+0000", 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1039999999999998e-06 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625551+0000", 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022631069999999999 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625580+0000", 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9479999999999999e-05 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625591+0000", 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1029999999999999e-05 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625670+0000", 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8934e-05 2024-04-26T07:50:23.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625816+0000", 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000145377 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625954+0000", 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013862100000000001 2024-04-26T07:50:23.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.631988+0000", 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060342160000000002 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.639972+0000", 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0079834309999999992 2024-04-26T07:50:23.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.640047+0000", 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4746999999999994e-05 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.640106+0000", 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9524000000000001e-05 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.983 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2800 3.1c 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.0826165120000004, 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024565350999999999, 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.984 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2800 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764503+0000", 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766083+0000", 2024-04-26T07:50:23.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015793210000000001 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766113+0000", 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0292999999999999e-05 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766125+0000", 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1575e-05 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766186+0000", 2024-04-26T07:50:23.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1310999999999996e-05 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766357+0000", 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017109199999999999 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766457+0000", 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100144 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.771500+0000", 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050428799999999996 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.788952+0000", 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017451575 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789010+0000", 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8631000000000002e-05 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789066+0000", 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5235000000000002e-05 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2805 3.1e 3:7b43044d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.0300887899999998, 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017797146999999999, 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2805 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817031+0000", 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7599999999999998e-06 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818807+0000", 2024-04-26T07:50:23.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017763169999999999 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818839+0000", 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2487999999999998e-05 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818854+0000", 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4430000000000001e-05 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818961+0000", 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107006 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.819139+0000", 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017809499999999999 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.819307+0000", 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168412 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.824488+0000", 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051808059999999996 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834686+0000", 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010197868000000001 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834761+0000", 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4475999999999996e-05 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834825+0000", 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4488999999999999e-05 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2811 3.1e 3:786cbdae:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.9697772479999998, 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019591179, 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:23.997 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2811 2024-04-26T07:50:23.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.998 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:23.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:23.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:23.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:23.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:23.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:23.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:23.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:23.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877343+0000", 2024-04-26T07:50:24.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8399999999999997e-06 2024-04-26T07:50:24.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879093+0000", 2024-04-26T07:50:24.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001749446 2024-04-26T07:50:24.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879156+0000", 2024-04-26T07:50:24.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3765999999999999e-05 2024-04-26T07:50:24.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879206+0000", 2024-04-26T07:50:24.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.956e-05 2024-04-26T07:50:24.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879283+0000", 2024-04-26T07:50:24.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6602999999999998e-05 2024-04-26T07:50:24.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879427+0000", 2024-04-26T07:50:24.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144232 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879541+0000", 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364199999999999 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.885376+0000", 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058353909999999997 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896847+0000", 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011471212999999999 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896893+0000", 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5797000000000002e-05 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896931+0000", 2024-04-26T07:50:24.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7688999999999998e-05 2024-04-26T07:50:24.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.007 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.007 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.007 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:24.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:24.009 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:24.006+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:24.110 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:24.106+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:24.172 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:24.172 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:24.172 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:24.172 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:24.186 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:24.231 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:24.230+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:24.304 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:24.304 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:24.304 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:24.304 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:24.304 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:24.311 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:24.310+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:24.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:24.410 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:24.412 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:24.410+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:24.494 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:24.495 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:24.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:24.495 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:24.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.495 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:24.496 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:24.496 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 44.21724742, 2024-04-26T07:50:24.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:24.496 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.496 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.496 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.497 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.497 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.497 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.497 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:24.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.498 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:24.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:24.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.500 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.500 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:24.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:24.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.501 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.501 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:24.501 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:24.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.501 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:24.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:24.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:24.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:24.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:24.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:24.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:24.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:24.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:24.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:24.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:24.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:24.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:24.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.507 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:24.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:24.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:24.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:24.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:24.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:24.509 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.509 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.510 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.510 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.510 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2138 3.24 3:27799388:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:24.510 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:24.510 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.764431899000002, 2024-04-26T07:50:24.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019291345000000001, 2024-04-26T07:50:24.511 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.511 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.511 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.511 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.511 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.512 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.512 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2138 2024-04-26T07:50:24.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.512 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:24.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:24.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726554+0000", 2024-04-26T07:50:24.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1070000000000004e-06 2024-04-26T07:50:24.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729580+0000", 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030264699999999999 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729630+0000", 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9574999999999999e-05 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729658+0000", 2024-04-26T07:50:24.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8079999999999999e-05 2024-04-26T07:50:24.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729848+0000", 2024-04-26T07:50:24.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000189898 2024-04-26T07:50:24.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730169+0000", 2024-04-26T07:50:24.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032129599999999999 2024-04-26T07:50:24.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730446+0000", 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027665600000000002 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.739724+0000", 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0092783829999999994 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745646+0000", 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059214879999999999 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745753+0000", 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107204 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745840+0000", 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7188000000000006e-05 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.519 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.576970727999999, 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.520 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:24.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:24.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:24.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2147 3.38 3:1e705a67:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.550124662999998, 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018669917000000001, 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.526 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2147 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940859+0000", 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5300000000000001e-06 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943909+0000", 2024-04-26T07:50:24.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030493 2024-04-26T07:50:24.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943953+0000", 2024-04-26T07:50:24.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4712000000000002e-05 2024-04-26T07:50:24.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943981+0000", 2024-04-26T07:50:24.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7166e-05 2024-04-26T07:50:24.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944134+0000", 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015355999999999999 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944461+0000", 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032647500000000001 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944706+0000", 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024554399999999999 2024-04-26T07:50:24.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.952188+0000", 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074813420000000002 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959218+0000", 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070308560000000003 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959399+0000", 2024-04-26T07:50:24.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018032599999999999 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959526+0000", 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012710600000000001 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2160 3.38 3:1c2379f3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 43.22094955, 2024-04-26T07:50:24.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019223560000000001, 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2160 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:24.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270035+0000", 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3229999999999999e-06 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273499+0000", 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003464033 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273551+0000", 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808999999999998e-05 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273572+0000", 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0639e-05 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273714+0000", 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000142051 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273994+0000", 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028034300000000001 2024-04-26T07:50:24.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.274248+0000", 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025402999999999998 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.282877+0000", 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0086282249999999998 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289064+0000", 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061877709999999999 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289171+0000", 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106974 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289255+0000", 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3362000000000006e-05 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.539 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.192151043999999, 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:24.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:24.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:24.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:24.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:24.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.546 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.546 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.547 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.547 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:24.547 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 6.6570761100000002, 2024-04-26T07:50:24.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:24.548 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.548 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.548 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.548 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.548 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.548 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.548 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:24.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.549 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:24.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:24.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:24.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:24.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:24.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:24.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:24.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:24.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:24.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:24.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:24.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:24.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:24.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 6.4403935729999997, 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.556 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.561 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.6676738929999999, 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.562 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.563 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.563 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:24.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.563 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:24.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:24.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:24.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.568 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.594020939, 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.569 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:24.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:24.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:24.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.5653157110000002, 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.575 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:24.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:24.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.581 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.5324951450000004, 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:24.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:24.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2724 3.29 3:976d7661:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.5199408539999997, 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019962855000000002, 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2724 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971043+0000", 2024-04-26T07:50:24.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9220000000000001e-06 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972756+0000", 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001713551 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972791+0000", 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4579999999999998e-05 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972806+0000", 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4849e-05 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972914+0000", 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010813 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973090+0000", 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017668800000000001 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973260+0000", 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016923 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.980034+0000", 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067747650000000003 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990921+0000", 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010887000000000001 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990967+0000", 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5593999999999997e-05 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.991003+0000", 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5546000000000002e-05 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.594 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.4987013410000003, 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:24.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:24.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:24.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:24.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:24.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:24.601 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.601 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.602 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.602 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2735 3.33 3:cc12dc1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.602 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.4048144950000001, 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019612998, 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2735 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086169+0000", 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087881+0000", 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017120709999999999 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087907+0000", 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5701e-05 2024-04-26T07:50:24.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087917+0000", 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0299000000000001e-05 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087987+0000", 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0617000000000005e-05 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088128+0000", 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014068300000000001 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088258+0000", 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013018799999999999 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.093485+0000", 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005226718 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105701+0000", 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012216385 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105744+0000", 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2938000000000001e-05 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105779+0000", 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4768000000000003e-05 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.608 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.260949418, 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:24.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.2075425050000002, 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:24.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:24.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2788 3.2 3:42019dbc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.8466348769999996, 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019599115, 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.621 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2788 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644348+0000", 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.114e-06 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645604+0000", 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001256032 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645637+0000", 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2877999999999999e-05 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645652+0000", 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5688e-05 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645741+0000", 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8912000000000005e-05 2024-04-26T07:50:24.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645863+0000", 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121846 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645963+0000", 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9592999999999993e-05 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.650283+0000", 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043205220000000003 2024-04-26T07:50:24.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663810+0000", 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013526322 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663883+0000", 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3586999999999999e-05 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663945+0000", 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1620999999999998e-05 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2792 3.27 3:e547b6ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.8076867300000004, 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018592296000000001, 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2792 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683297+0000", 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684797+0000", 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015003379999999999 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684821+0000", 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4474e-05 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684835+0000", 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3053e-05 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684916+0000", 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1756999999999997e-05 2024-04-26T07:50:24.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685075+0000", 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000158388 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685218+0000", 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143141 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.689955+0000", 2024-04-26T07:50:24.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00473698 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701742+0000", 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011787445000000001 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701828+0000", 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701886+0000", 2024-04-26T07:50:24.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7955000000000003e-05 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.7969566740000005, 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:24.633 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:24.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:24.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:24.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:24.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:24.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:24.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:24.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.639 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:24.639 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:24.639 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:24.641 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:24.641 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:24.642 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:24.643 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:24.643 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:24.643 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:24.643 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:24.644 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:24.644 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:24.638+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:24.647 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:24.668 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:24.668 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:24.689 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:24.689 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:24.741 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:24.738+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:24.776 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:24.776 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:24.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:24.849 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:50:24.850 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:24.846+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:24.943 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:24.942+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:24.957 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:24.957 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:24.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:25.044 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:25.042+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:25.145 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:25.145 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:25.145 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:25.142+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:25.160 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:25.247 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:25.242+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:25.333 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:25.333 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:25.348 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:25.348 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:25.346+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:25.448 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:25.446+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:25.515 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:25.515 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:25.530 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:25.571 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:25.570+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:25.650 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:25.646+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:25.693 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:25.694 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:25.709 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:25.751 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:25.750+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:25.852 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:25.850+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:25.876 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:25.876 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:25.890 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:25.979 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:25.978+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:26.054 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:26.050+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:26.056 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:26.056 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:26.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:26.159 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:26.158+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:26.241 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:26.241 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:26.255 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:26.299 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:26.298+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:26.357 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:26.354+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:26.423 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:26.423 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:26.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:26.479 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:26.478+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:26.559 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:26.558+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:26.599 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:26.599 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:26.614 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:26.660 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:26.658+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:26.707 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:26.739 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:26.740 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:26.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:26.760 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:26.758+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:26.861 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:26.858+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:26.864 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:26.865 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:26.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:50:26.881 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:26.888 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:26.888 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:26.888 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:26.888 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:26.910 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:26.913 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:26.932 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:26.952 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:26.952 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:26.962 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:26.958+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:26.973 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:26.974 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:26.996 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:26.998 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:27.016 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:27.017 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:27.055 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:27.055 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:27.055 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:27.055 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:27.055 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:27.063 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:27.062+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:27.075 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:27.164 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:27.162+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:27.237 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:27.238 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:27.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:27.238 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:27.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2115 3.12 3:48da4f83:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.772140327000002, 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020926337, 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2115 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461444+0000", 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.461447+0000", 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464785+0000", 2024-04-26T07:50:27.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033385540000000001 2024-04-26T07:50:27.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464814+0000", 2024-04-26T07:50:27.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9167e-05 2024-04-26T07:50:27.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464832+0000", 2024-04-26T07:50:27.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8097999999999999e-05 2024-04-26T07:50:27.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.464996+0000", 2024-04-26T07:50:27.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016315399999999999 2024-04-26T07:50:27.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465292+0000", 2024-04-26T07:50:27.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029592699999999997 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.465562+0000", 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027075899999999997 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.477813+0000", 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012250749 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482150+0000", 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043364340000000001 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482260+0000", 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110204 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482370+0000", 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000110234 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2125 3.17 3:ebf2ae85:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.577556581000003, 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02199247, 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2125 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.249 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656027+0000", 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.656030+0000", 2024-04-26T07:50:27.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.658975+0000", 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0029456349999999998 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659019+0000", 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3405999999999997e-05 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659046+0000", 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6659e-05 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659219+0000", 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017387300000000001 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659499+0000", 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000279926 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.659769+0000", 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026926000000000001 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.668218+0000", 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084496710000000006 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677830+0000", 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0096117779999999996 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.677932+0000", 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010155800000000001 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.678020+0000", 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8211e-05 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.254 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2150 3.39 e58/17 3:9c78f73b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_39:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.209679430999998, 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019626325999999999, 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023905+0000", 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.023907+0000", 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.576e-06 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032657+0000", 2024-04-26T07:50:27.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0087502129999999997 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032704+0000", 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7024999999999998e-05 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032725+0000", 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1002999999999999e-05 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032879+0000", 2024-04-26T07:50:27.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015357599999999999 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.032924+0000", 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5509000000000001e-05 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043391+0000", 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010466787 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.043531+0000", 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013963699999999999 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2165 3.12 3:48c02635:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.838683994999997, 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021758514999999999, 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.259 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2165 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394900+0000", 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.394904+0000", 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9430000000000002e-06 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398287+0000", 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033835380000000002 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398343+0000", 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5148999999999997e-05 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398365+0000", 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2688999999999999e-05 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398525+0000", 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159801 2024-04-26T07:50:27.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.398876+0000", 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035097600000000002 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.399237+0000", 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00036067100000000002 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.409713+0000", 2024-04-26T07:50:27.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010476348 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416491+0000", 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067777569999999997 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416579+0000", 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8412000000000007e-05 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.416658+0000", 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9231000000000001e-05 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2170 3.12 3:48f78380:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.753841049999998, 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019689475000000001, 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.265 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2170 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479743+0000", 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.479749+0000", 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7130000000000002e-06 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481893+0000", 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002144048 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481950+0000", 2024-04-26T07:50:27.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7192999999999999e-05 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.481979+0000", 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9414999999999999e-05 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482084+0000", 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105105 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482257+0000", 2024-04-26T07:50:27.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173053 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.482414+0000", 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000156498 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.489832+0000", 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074180399999999999 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499155+0000", 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093232509999999994 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499312+0000", 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015707899999999999 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.499432+0000", 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012008 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.270 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2217 3.2b 3:d4095543:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.213943956000001, 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.048883261999999997, 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2217 2024-04-26T07:50:27.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019640+0000", 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.019644+0000", 2024-04-26T07:50:27.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9729999999999999e-06 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022277+0000", 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026334779999999999 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022312+0000", 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4737000000000003e-05 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022324+0000", 2024-04-26T07:50:27.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1770000000000001e-05 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022410+0000", 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.598e-05 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022601+0000", 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019102100000000001 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.022771+0000", 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017026500000000001 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.029808+0000", 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070363259999999999 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068387+0000", 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.038579667999999998 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068459+0000", 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1649000000000005e-05 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.068523+0000", 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4394999999999996e-05 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2629 3.1b 3:d913bab3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.276 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.886295+0000", 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3472889860000006, 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018600816999999999, 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2629 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.886295+0000", 2024-04-26T07:50:27.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.886295+0000", 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.886297+0000", 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2309999999999999e-06 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.278 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888032+0000", 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001734633 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888062+0000", 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0241000000000001e-05 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888077+0000", 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.449e-05 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888167+0000", 2024-04-26T07:50:27.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0818999999999999e-05 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888358+0000", 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019062899999999999 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.888547+0000", 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018942899999999999 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.894141+0000", 2024-04-26T07:50:27.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055935680000000002 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.904766+0000", 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010625044 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.904837+0000", 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1293999999999999e-05 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.904896+0000", 2024-04-26T07:50:27.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8439000000000001e-05 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2630 3.17 3:e87f5a64:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.897438+0000", 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3361458559999999, 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01965385, 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.282 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2630 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.897438+0000", 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.897438+0000", 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.897440+0000", 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.035e-06 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.898974+0000", 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001533668 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899003+0000", 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9434999999999999e-05 2024-04-26T07:50:27.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899017+0000", 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3944000000000001e-05 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899101+0000", 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3850000000000005e-05 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899229+0000", 2024-04-26T07:50:27.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012840799999999999 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.899343+0000", 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364100000000001 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.903927+0000", 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004583752 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.916895+0000", 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012968307 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.917012+0000", 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116801 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.917092+0000", 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0008999999999999e-05 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.287 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2647 3.2b 3:d540411f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.084182+0000", 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.1494014650000004, 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020986392, 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2647 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.288 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.084182+0000", 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.084182+0000", 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.084185+0000", 2024-04-26T07:50:27.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.672e-06 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.085974+0000", 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00178879 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086126+0000", 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015175 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086144+0000", 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7995999999999998e-05 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086225+0000", 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1113999999999996e-05 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086364+0000", 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013927000000000001 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.086470+0000", 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106388 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.091752+0000", 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052820080000000004 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.105093+0000", 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013340588 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.105134+0000", 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1360999999999999e-05 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.105169+0000", 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4455000000000001e-05 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2649 3.12 3:48f3a6ed:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.293 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.108019+0000", 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.1255649860000005, 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022712999000000001, 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2649 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.108019+0000", 2024-04-26T07:50:27.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.108019+0000", 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.108023+0000", 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9360000000000001e-06 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110631+0000", 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0026085639999999998 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110655+0000", 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3127000000000001e-05 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110668+0000", 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3166999999999999e-05 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110753+0000", 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5315999999999994e-05 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.110928+0000", 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174458 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.111105+0000", 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000177176 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.119709+0000", 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0086047940000000007 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.130569+0000", 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010859405000000001 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.130675+0000", 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010568700000000001 2024-04-26T07:50:27.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.130732+0000", 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7368999999999999e-05 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2660 3.1b 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.224493+0000", 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.0090912280000008, 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.030430860000000001, 2024-04-26T07:50:27.299 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2660 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.224493+0000", 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.224493+0000", 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.224495+0000", 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3690000000000001e-06 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226364+0000", 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018685010000000001 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226398+0000", 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4309e-05 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226413+0000", 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4744e-05 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226501+0000", 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8752999999999995e-05 2024-04-26T07:50:27.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226684+0000", 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000182404 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.226809+0000", 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012490299999999999 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.231334+0000", 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045258049999999999 2024-04-26T07:50:27.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.254843+0000", 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023508476 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.254890+0000", 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7138000000000002e-05 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.254924+0000", 2024-04-26T07:50:27.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3457999999999997e-05 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2662 3.1 3:833b8d5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.244173+0000", 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.9894106980000004, 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020738194000000001, 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.305 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2662 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.244173+0000", 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.244173+0000", 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.244176+0000", 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.245883+0000", 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017072879999999999 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.245917+0000", 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3798999999999999e-05 2024-04-26T07:50:27.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.245931+0000", 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4194e-05 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.246013+0000", 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1724000000000006e-05 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.246193+0000", 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018060299999999999 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.246358+0000", 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016459800000000001 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.251514+0000", 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051561910000000001 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.264797+0000", 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013283410000000001 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.264860+0000", 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3029999999999998e-05 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.264911+0000", 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1073999999999999e-05 2024-04-26T07:50:27.310 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2671 3.2b 3:d4583fbc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.358869+0000", 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.8747146049999994, 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019875152, 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.311 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2671 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.358869+0000", 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.358869+0000", 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.358873+0000", 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5149999999999998e-06 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.360739+0000", 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018658539999999999 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.360770+0000", 2024-04-26T07:50:27.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1646000000000002e-05 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.360785+0000", 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4963999999999999e-05 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.360889+0000", 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010397500000000001 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.361083+0000", 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019397199999999999 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.361305+0000", 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00022189399999999999 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.366539+0000", 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052334440000000003 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.378600+0000", 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012061296000000001 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.378695+0000", 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5325e-05 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.378744+0000", 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9267000000000001e-05 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.316 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2691 3.17 3:e90e392a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.620832+0000", 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.6127519919999997, 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019273542000000001, 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2691 2024-04-26T07:50:27.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.620832+0000", 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.620832+0000", 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.620834+0000", 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2929999999999999e-06 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622225+0000", 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013904150000000001 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622260+0000", 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5728000000000001e-05 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622277+0000", 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6141e-05 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622355+0000", 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8233999999999997e-05 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622481+0000", 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012611999999999999 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.320 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.622609+0000", 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012767400000000001 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.627444+0000", 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0048357000000000001 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.639985+0000", 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012540581 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.640052+0000", 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7052999999999997e-05 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.640105+0000", 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3603000000000002e-05 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2705 3.12 3:4a41f3de:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.322 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.773678+0000", 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.459905698, 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019953551999999999, 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2705 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.773678+0000", 2024-04-26T07:50:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.773678+0000", 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.773681+0000", 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3779999999999999e-06 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775182+0000", 2024-04-26T07:50:27.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015017299999999999 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775210+0000", 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7356999999999999e-05 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775220+0000", 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0516000000000001e-05 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775288+0000", 2024-04-26T07:50:27.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8275999999999995e-05 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775400+0000", 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111697 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.775492+0000", 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1625000000000005e-05 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.326 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.780063+0000", 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045715130000000001 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.793523+0000", 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013460078 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.793592+0000", 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8586999999999999e-05 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.793632+0000", 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9795000000000001e-05 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2709 3.1b 3:d991ebe6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.812929+0000", 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.4206553960000008, 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018202975999999999, 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.328 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2709 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.812929+0000", 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.812929+0000", 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.812931+0000", 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.357e-06 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814619+0000", 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001687612 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814651+0000", 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2447000000000003e-05 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814665+0000", 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3733999999999999e-05 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814743+0000", 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7820999999999999e-05 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814893+0000", 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150505 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.814989+0000", 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5594000000000007e-05 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.819898+0000", 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049089479999999998 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.831055+0000", 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011157031 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.332 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.831099+0000", 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4849999999999999e-05 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.831132+0000", 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2076999999999998e-05 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2736 3.1b 3:d8556e1c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.096123+0000", 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.1374611320000003, 2024-04-26T07:50:27.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021801480000000002, 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2736 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096123+0000", 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096123+0000", 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096126+0000", 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.196e-06 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098121+0000", 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001994642 2024-04-26T07:50:27.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098146+0000", 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5096000000000002e-05 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098156+0000", 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9709999999999999e-06 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098235+0000", 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8800000000000004e-05 2024-04-26T07:50:27.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098372+0000", 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000137429 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.098472+0000", 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010026099999999999 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105286+0000", 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068139200000000002 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.117767+0000", 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012480415 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.117841+0000", 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4467000000000004e-05 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.117924+0000", 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3282999999999995e-05 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.338 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2757 3.12 3:4ac1b8c0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.319709+0000", 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 7.9138747059999996, 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020174963000000001, 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2757 2024-04-26T07:50:27.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.319709+0000", 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.319709+0000", 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.319713+0000", 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.597e-06 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322276+0000", 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002563058 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322307+0000", 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0660999999999997e-05 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322323+0000", 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6215999999999999e-05 2024-04-26T07:50:27.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322417+0000", 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4327999999999995e-05 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322614+0000", 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019705800000000001 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.322802+0000", 2024-04-26T07:50:27.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018818700000000001 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.327896+0000", 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050939369999999998 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.339741+0000", 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011844397 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.343 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.339821+0000", 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0396999999999996e-05 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.339884+0000", 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3126999999999994e-05 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2784 3.2b 3:d70e3d8e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:27.344 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.601698+0000", 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 7.6318858540000001, 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022486066999999998, 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2784 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.601698+0000", 2024-04-26T07:50:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.601698+0000", 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.601701+0000", 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.785e-06 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603129+0000", 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014280460000000001 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603163+0000", 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3767999999999999e-05 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603178+0000", 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5758999999999999e-05 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603286+0000", 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010778299999999999 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603539+0000", 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025247300000000002 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.603741+0000", 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020206900000000001 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.609158+0000", 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054172420000000001 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.624046+0000", 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014888083999999999 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.624121+0000", 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4864999999999996e-05 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.624184+0000", 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3193000000000003e-05 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2796 3.1b 3:dbe4e1f9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.725571+0000", 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 7.508013085, 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018832166000000001, 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2796 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.725571+0000", 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.725571+0000", 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.725574+0000", 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3629999999999998e-06 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727097+0000", 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015227730000000001 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727132+0000", 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5040000000000003e-05 2024-04-26T07:50:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727147+0000", 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5410999999999999e-05 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727244+0000", 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6281999999999997e-05 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727404+0000", 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000160569 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.727560+0000", 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015576899999999999 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.732803+0000", 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052429269999999997 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.744288+0000", 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011485067 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.744329+0000", 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0856999999999999e-05 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.744403+0000", 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4108000000000003e-05 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.356 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.356 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:27.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:27.358 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:27.354+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:27.458 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:27.458+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:27.530 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:27.530 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:27.530 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:27.530 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:27.544 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:27.595 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:27.594+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:27.666 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:27.658+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:27.669 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:27.669 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:27.670 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:27.670 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:27.670 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:27.684 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:27.761 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:27.758+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:27.849 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:50:27.852 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:27.852 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:27.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:27.852 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:27.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.531912448, 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:27.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.858 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.367253703999999, 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:27.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:27.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.864 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.345379663000003, 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.865 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:27.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:27.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:27.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:27.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:27.871 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.802580677000002, 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.872 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:27.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:27.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.750490824000003, 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:27.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:27.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:27.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.724002495999997, 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.881 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:27.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.555737284999999, 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.886 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:27.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:27.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.098707019999999, 2024-04-26T07:50:27.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:27.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:27.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.992892634, 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:27.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:27.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.642131583000001, 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.903 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:27.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:27.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:27.909 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.909 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.909 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2613 3.31 3:8eaf08fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.133046206, 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016123849999999999, 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2613 2024-04-26T07:50:27.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716535+0000", 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.849e-06 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717876+0000", 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001341084 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717910+0000", 2024-04-26T07:50:27.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3575000000000003e-05 2024-04-26T07:50:27.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717925+0000", 2024-04-26T07:50:27.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5750999999999999e-05 2024-04-26T07:50:27.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718012+0000", 2024-04-26T07:50:27.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6472999999999997e-05 2024-04-26T07:50:27.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718191+0000", 2024-04-26T07:50:27.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017946999999999999 2024-04-26T07:50:27.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718360+0000", 2024-04-26T07:50:27.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000169154 2024-04-26T07:50:27.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.722797+0000", 2024-04-26T07:50:27.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044362610000000004 2024-04-26T07:50:27.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732580+0000", 2024-04-26T07:50:27.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097836820000000001 2024-04-26T07:50:27.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732624+0000", 2024-04-26T07:50:27.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3213000000000001e-05 2024-04-26T07:50:27.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732657+0000", 2024-04-26T07:50:27.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3337999999999998e-05 2024-04-26T07:50:27.919 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.919 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.919 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.920 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2618 3.31 3:8daa9f80:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.920 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:27.920 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.079768039999999, 2024-04-26T07:50:27.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021000648, 2024-04-26T07:50:27.921 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.921 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.921 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.921 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.922 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2618 2024-04-26T07:50:27.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.922 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:27.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:27.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769814+0000", 2024-04-26T07:50:27.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:27.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771227+0000", 2024-04-26T07:50:27.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001413428 2024-04-26T07:50:27.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771261+0000", 2024-04-26T07:50:27.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3244000000000002e-05 2024-04-26T07:50:27.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771276+0000", 2024-04-26T07:50:27.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5695000000000001e-05 2024-04-26T07:50:27.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771351+0000", 2024-04-26T07:50:27.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4919000000000006e-05 2024-04-26T07:50:27.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771510+0000", 2024-04-26T07:50:27.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015855900000000001 2024-04-26T07:50:27.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771615+0000", 2024-04-26T07:50:27.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010500799999999999 2024-04-26T07:50:27.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.776024+0000", 2024-04-26T07:50:27.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044095430000000001 2024-04-26T07:50:27.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790685+0000", 2024-04-26T07:50:27.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014660678999999999 2024-04-26T07:50:27.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790755+0000", 2024-04-26T07:50:27.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0364000000000006e-05 2024-04-26T07:50:27.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790812+0000", 2024-04-26T07:50:27.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6527000000000003e-05 2024-04-26T07:50:27.932 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.932 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.933 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.933 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2622 3.31 3:8e8c5c0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.933 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:27.933 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.03466098, 2024-04-26T07:50:27.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019283708, 2024-04-26T07:50:27.934 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.934 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.934 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.934 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.934 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.934 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.935 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2622 2024-04-26T07:50:27.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.935 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:27.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:27.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814921+0000", 2024-04-26T07:50:27.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7379999999999999e-06 2024-04-26T07:50:27.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.815980+0000", 2024-04-26T07:50:27.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010592729999999999 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816013+0000", 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2224999999999997e-05 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816027+0000", 2024-04-26T07:50:27.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4688000000000001e-05 2024-04-26T07:50:27.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816104+0000", 2024-04-26T07:50:27.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6922000000000007e-05 2024-04-26T07:50:27.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816273+0000", 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016859399999999999 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816446+0000", 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173554 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.821737+0000", 2024-04-26T07:50:27.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052907800000000001 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834069+0000", 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012331701 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834141+0000", 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2568e-05 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834202+0000", 2024-04-26T07:50:27.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0665000000000003e-05 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2688 3.25 3:a6896c0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.2742567329999996, 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013724867, 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.942 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2688 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575325+0000", 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9080000000000002e-06 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576920+0000", 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001595754 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576950+0000", 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0108999999999999e-05 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576965+0000", 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4632e-05 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577061+0000", 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5629000000000002e-05 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577244+0000", 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018314500000000001 2024-04-26T07:50:27.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577371+0000", 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012685300000000001 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588321+0000", 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010950766000000001 2024-04-26T07:50:27.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588646+0000", 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032420499999999999 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588932+0000", 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028667599999999998 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.589047+0000", 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011519 2024-04-26T07:50:27.947 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2707 3.31 3:8c445c82:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.058761445, 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020245384000000002, 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2707 2024-04-26T07:50:27.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790821+0000", 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4489999999999999e-06 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792513+0000", 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00169125 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792538+0000", 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5252000000000001e-05 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792552+0000", 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3726999999999999e-05 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792641+0000", 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9653000000000004e-05 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792813+0000", 2024-04-26T07:50:27.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017224499999999999 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792980+0000", 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167023 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.798223+0000", 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052425789999999998 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.810923+0000", 2024-04-26T07:50:27.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012700438 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811000+0000", 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6526000000000006e-05 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811063+0000", 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3242000000000002e-05 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.953 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2731 3.1a e71/17 3:5858a56a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_166:head v 71'9, mlcod=59'7)", 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.7991288969999992, 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01359636, 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050452+0000", 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9149999999999999e-06 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056374+0000", 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059220490000000004 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056474+0000", 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9864000000000005e-05 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056491+0000", 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6982000000000001e-05 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056577+0000", 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5591000000000001e-05 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056606+0000", 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9422000000000001e-05 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.063970+0000", 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073637859999999998 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.064047+0000", 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6750999999999998e-05 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2738 3.31 3:8c882a39:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.7330019090000004, 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017775144, 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2738 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.958 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116581+0000", 2024-04-26T07:50:27.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9700000000000001e-06 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118803+0000", 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022217349999999999 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118829+0000", 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5596999999999999e-05 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118841+0000", 2024-04-26T07:50:27.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2081e-05 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118923+0000", 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2106000000000003e-05 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119094+0000", 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017146300000000001 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119258+0000", 2024-04-26T07:50:27.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016377899999999999 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.126373+0000", 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071146250000000003 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134224+0000", 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078514399999999995 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134297+0000", 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2970000000000001e-05 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134353+0000", 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5377999999999997e-05 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2745 3.31 3:8c638261:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:27.963 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.6613042960000008, 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018680489000000002, 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2745 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188277+0000", 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8640000000000001e-06 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189907+0000", 2024-04-26T07:50:27.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016299159999999999 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189933+0000", 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5853000000000001e-05 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189943+0000", 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9820000000000003e-06 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190027+0000", 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4330000000000001e-05 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190196+0000", 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016852800000000001 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190345+0000", 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014998400000000001 2024-04-26T07:50:27.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.195338+0000", 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049923720000000001 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206878+0000", 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011540323999999999 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206921+0000", 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3034999999999997e-05 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206956+0000", 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4301000000000002e-05 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2776 3.25 3:a7a5804f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.3336454549999992, 2024-04-26T07:50:27.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013668700000000001, 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2776 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515938+0000", 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0940000000000001e-06 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517635+0000", 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016974589999999999 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517659+0000", 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3862999999999998e-05 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517673+0000", 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3427999999999999e-05 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517744+0000", 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0921999999999996e-05 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517749+0000", 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3410000000000002e-06 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521369+0000", 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036196499999999999 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521513+0000", 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144776 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521661+0000", 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014765000000000001 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.528887+0000", 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072261560000000001 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529481+0000", 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00059366900000000001 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529549+0000", 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8368999999999995e-05 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529603+0000", 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3322999999999998e-05 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.975 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2789 3.31 3:8feca985:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.1952418900000001, 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017716994999999999, 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:27.976 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2789 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:27.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654339+0000", 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7829999999999999e-06 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655814+0000", 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014750449999999999 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655840+0000", 2024-04-26T07:50:27.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5401e-05 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655850+0000", 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0454e-05 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655917+0000", 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7022999999999998e-05 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:27.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656068+0000", 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151321 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656189+0000", 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120974 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.660660+0000", 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044709609999999999 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:27.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671924+0000", 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011264055 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671999+0000", 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4072000000000005e-05 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.672054+0000", 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5906000000000003e-05 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:27.981 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:27.982 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:27.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:27.984 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:27.982+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:28.084 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:28.082+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:28.161 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:28.161 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:28.161 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:28.161 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:28.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:28.185 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:28.186+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:28.286 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:28.282+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:28.313 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:28.314 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:28.314 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:28.314 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:28.314 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:28.328 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:28.387 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:28.386+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:28.459 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:28.459 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:28.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:28.459 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:28.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.459 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2103 3.3b e58/17 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:28.459 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.188218538999998, 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017139903000000001, 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266571+0000", 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5859999999999999e-06 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275000+0000", 2024-04-26T07:50:28.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084295080000000005 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275062+0000", 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1579000000000001e-05 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275091+0000", 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8563000000000001e-05 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275209+0000", 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118866 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275240+0000", 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0372999999999999e-05 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283650+0000", 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084105450000000002 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.463 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283708+0000", 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7883000000000001e-05 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.487746534000003, 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.464 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:28.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.470 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2149 3.2e 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.462161209000001, 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016993692000000001, 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2149 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992628+0000", 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5959999999999998e-06 2024-04-26T07:50:28.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995727+0000", 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003098506 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995778+0000", 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0868999999999997e-05 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995797+0000", 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9128999999999999e-05 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995958+0000", 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016100199999999999 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996233+0000", 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027535400000000001 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996496+0000", 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026286700000000002 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.007925+0000", 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011428880000000001 2024-04-26T07:50:28.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009253+0000", 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013284150000000001 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009433+0000", 2024-04-26T07:50:28.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017974500000000001 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009619+0000", 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000186329 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.386998820999999, 2024-04-26T07:50:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.478 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:28.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.483 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2161 3.0 e58/17 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.157221739999997, 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016578915999999999, 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:28.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297568+0000", 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7999999999999999e-06 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300910+0000", 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033417189999999999 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300956+0000", 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6139e-05 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300975+0000", 2024-04-26T07:50:28.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8856e-05 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301137+0000", 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162583 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301205+0000", 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7627999999999997e-05 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314035+0000", 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012830187 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314144+0000", 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109004 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.488 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.085286310000001, 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:28.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.491 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:28.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.994527183999999, 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:28.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:28.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.498 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.499 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.500 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.500 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2635 3.21 3:859b1c73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:28.500 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:28.500 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.507486902, 2024-04-26T07:50:28.500 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017892425, 2024-04-26T07:50:28.500 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.500 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2635 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.501 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:28.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.502 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.502 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.502 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:28.502 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947303+0000", 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.455e-06 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949508+0000", 2024-04-26T07:50:28.503 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022040969999999999 2024-04-26T07:50:28.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.504 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949528+0000", 2024-04-26T07:50:28.504 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0647999999999999e-05 2024-04-26T07:50:28.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.504 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.504 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949537+0000", 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7790000000000001e-06 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949599+0000", 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1570999999999997e-05 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.505 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949767+0000", 2024-04-26T07:50:28.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016876099999999999 2024-04-26T07:50:28.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.506 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:28.506 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949931+0000", 2024-04-26T07:50:28.506 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016320399999999999 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.953952+0000", 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040214059999999999 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.507 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965068+0000", 2024-04-26T07:50:28.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011116041 2024-04-26T07:50:28.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.508 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.508 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965140+0000", 2024-04-26T07:50:28.508 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1746000000000001e-05 2024-04-26T07:50:28.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.509 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.509 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965192+0000", 2024-04-26T07:50:28.509 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2716999999999997e-05 2024-04-26T07:50:28.509 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.509 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.509 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.509 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.444797679000001, 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.510 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.511 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.511 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:28.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.511 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.511 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.511 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.511 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:28.511 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.512 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:28.512 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.512 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.512 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.513 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.6096059189999998, 2024-04-26T07:50:28.517 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:28.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:28.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2734 3.1e 3:7bc4dd61:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3799757839999991, 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022112987000000001, 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.524 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2734 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074814+0000", 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8169999999999999e-06 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076636+0000", 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018219670000000001 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076668+0000", 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076684+0000", 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5228000000000001e-05 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076777+0000", 2024-04-26T07:50:28.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3751000000000004e-05 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076907+0000", 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129899 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.077003+0000", 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5314000000000003e-05 2024-04-26T07:50:28.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.081365+0000", 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043621709999999998 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096804+0000", 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015438825999999999 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096870+0000", 2024-04-26T07:50:28.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6407000000000003e-05 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096924+0000", 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4027999999999998e-05 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.530 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2744 3.1e 3:78569fb3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.2760887800000003, 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017953593, 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2744 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178701+0000", 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.532 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180304+0000", 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016031929999999999 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180330+0000", 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5635000000000001e-05 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180341+0000", 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0869999999999999e-05 2024-04-26T07:50:28.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180418+0000", 2024-04-26T07:50:28.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7293999999999996e-05 2024-04-26T07:50:28.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180593+0000", 2024-04-26T07:50:28.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017473900000000001 2024-04-26T07:50:28.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180741+0000", 2024-04-26T07:50:28.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014776700000000001 2024-04-26T07:50:28.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.185523+0000", 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047823859999999996 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196576+0000", 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011052674 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196618+0000", 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2286000000000001e-05 2024-04-26T07:50:28.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196652+0000", 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3859000000000002e-05 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2746 3.21 3:86d1a7b8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.2563069440000003, 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016733074000000001, 2024-04-26T07:50:28.537 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2746 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:28.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.539 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:28.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.540 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.540 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198482+0000", 2024-04-26T07:50:28.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.058e-06 2024-04-26T07:50:28.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.540 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199898+0000", 2024-04-26T07:50:28.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014155540000000001 2024-04-26T07:50:28.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199929+0000", 2024-04-26T07:50:28.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1108000000000001e-05 2024-04-26T07:50:28.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199940+0000", 2024-04-26T07:50:28.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1539000000000001e-05 2024-04-26T07:50:28.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200021+0000", 2024-04-26T07:50:28.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0721000000000002e-05 2024-04-26T07:50:28.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200172+0000", 2024-04-26T07:50:28.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015134 2024-04-26T07:50:28.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:28.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200276+0000", 2024-04-26T07:50:28.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000103664 2024-04-26T07:50:28.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.205355+0000", 2024-04-26T07:50:28.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050790100000000001 2024-04-26T07:50:28.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215085+0000", 2024-04-26T07:50:28.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097300289999999994 2024-04-26T07:50:28.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215160+0000", 2024-04-26T07:50:28.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4981999999999995e-05 2024-04-26T07:50:28.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.548 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.548 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215213+0000", 2024-04-26T07:50:28.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3069000000000003e-05 2024-04-26T07:50:28.549 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.549 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.549 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.549 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2756 3.21 3:840e6052:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:28.549 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:28.550 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.1479614409999996, 2024-04-26T07:50:28.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016860624000000001, 2024-04-26T07:50:28.550 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.550 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.550 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.550 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.550 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.550 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2756 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306829+0000", 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.207e-06 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308004+0000", 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011756620000000001 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308025+0000", 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1101e-05 2024-04-26T07:50:28.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308036+0000", 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0796e-05 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308177+0000", 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000140445 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308324+0000", 2024-04-26T07:50:28.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000147112 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308438+0000", 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114506 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.316220+0000", 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077820950000000002 2024-04-26T07:50:28.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323522+0000", 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073011839999999996 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323607+0000", 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5148000000000005e-05 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323686+0000", 2024-04-26T07:50:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9368000000000003e-05 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2774 3.21 3:85ac5c16:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.9577522179999995, 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022721992, 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.556 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2774 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497037+0000", 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2970000000000002e-06 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498369+0000", 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001332106 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498402+0000", 2024-04-26T07:50:28.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2490000000000002e-05 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498416+0000", 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4922999999999999e-05 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498506+0000", 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9040000000000001e-05 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498514+0000", 2024-04-26T07:50:28.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1550000000000007e-06 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500799+0000", 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002284861 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500953+0000", 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015486800000000001 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:28.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.501099+0000", 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014553499999999999 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.505865+0000", 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047655589999999999 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519642+0000", 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013777608 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519710+0000", 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7702999999999999e-05 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519757+0000", 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6847000000000001e-05 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2781 3.2e 3:775249ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:28.562 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.8839543180000007, 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018031374999999999, 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2781 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570835+0000", 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.667e-06 2024-04-26T07:50:28.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572336+0000", 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015002940000000001 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572370+0000", 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4836000000000003e-05 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572385+0000", 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4649e-05 2024-04-26T07:50:28.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572477+0000", 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2167e-05 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572682+0000", 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000205183 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572864+0000", 2024-04-26T07:50:28.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018175299999999999 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.578265+0000", 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054013330000000003 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588708+0000", 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01044279 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588790+0000", 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2039000000000005e-05 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588864+0000", 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3664000000000005e-05 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2786 3.2e 3:7579d053:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:28.568 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.831502382, 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016821571, 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2786 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.569 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623288+0000", 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1039999999999998e-06 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625551+0000", 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022631069999999999 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625580+0000", 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9479999999999999e-05 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625591+0000", 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1029999999999999e-05 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625670+0000", 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8934e-05 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625816+0000", 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000145377 2024-04-26T07:50:28.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625954+0000", 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013862100000000001 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.631988+0000", 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060342160000000002 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.639972+0000", 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0079834309999999992 2024-04-26T07:50:28.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.640047+0000", 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4746999999999994e-05 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.640106+0000", 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9524000000000001e-05 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2800 3.1c 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.6902867330000007, 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024565350999999999, 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2800 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764503+0000", 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766083+0000", 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015793210000000001 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766113+0000", 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0292999999999999e-05 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766125+0000", 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1575e-05 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766186+0000", 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1310999999999996e-05 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766357+0000", 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017109199999999999 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:28.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766457+0000", 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100144 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.771500+0000", 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050428799999999996 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.788952+0000", 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017451575 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789010+0000", 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8631000000000002e-05 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789066+0000", 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5235000000000002e-05 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2805 3.1e 3:7b43044d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.637759011, 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017797146999999999, 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2805 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.581 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817031+0000", 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7599999999999998e-06 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818807+0000", 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017763169999999999 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818839+0000", 2024-04-26T07:50:28.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2487999999999998e-05 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818854+0000", 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4430000000000001e-05 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818961+0000", 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107006 2024-04-26T07:50:28.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.819139+0000", 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017809499999999999 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.819307+0000", 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168412 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.824488+0000", 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051808059999999996 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834686+0000", 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010197868000000001 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834761+0000", 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4475999999999996e-05 2024-04-26T07:50:28.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834825+0000", 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4488999999999999e-05 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2811 3.1e 3:786cbdae:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:28.587 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.5774474689999991, 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019591179, 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2811 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877343+0000", 2024-04-26T07:50:28.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8399999999999997e-06 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879093+0000", 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001749446 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879156+0000", 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3765999999999999e-05 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:28.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879206+0000", 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.956e-05 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879283+0000", 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6602999999999998e-05 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879427+0000", 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144232 2024-04-26T07:50:28.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879541+0000", 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364199999999999 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.885376+0000", 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058353909999999997 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896847+0000", 2024-04-26T07:50:28.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011471212999999999 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896893+0000", 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5797000000000002e-05 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896931+0000", 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7688999999999998e-05 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.593 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:28.594 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:28.594 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:28.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:28.596 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:28.594+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:28.696 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:28.694+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:28.730 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:28.730 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:28.730 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:28.731 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:28.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:28.796 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:28.794+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:28.872 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:28.873 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:28.873 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:28.873 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:28.873 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:28.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:28.897 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:28.898+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:28.998 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:28.994+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:29.008 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:29.008 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.731577756999997, 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:29.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2138 3.24 3:27799388:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.278762235999999, 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019291345000000001, 2024-04-26T07:50:29.014 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2138 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726554+0000", 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1070000000000004e-06 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729580+0000", 2024-04-26T07:50:29.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030264699999999999 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729630+0000", 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9574999999999999e-05 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729658+0000", 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8079999999999999e-05 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729848+0000", 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000189898 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730169+0000", 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032129599999999999 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730446+0000", 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027665600000000002 2024-04-26T07:50:29.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.739724+0000", 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0092783829999999994 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745646+0000", 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059214879999999999 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745753+0000", 2024-04-26T07:50:29.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107204 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745840+0000", 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7188000000000006e-05 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:29.020 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.091301065000003, 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:29.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:29.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:29.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2147 3.38 3:1e705a67:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 48.064455000000002, 2024-04-26T07:50:29.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018669917000000001, 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2147 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940859+0000", 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5300000000000001e-06 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943909+0000", 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030493 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943953+0000", 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4712000000000002e-05 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943981+0000", 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7166e-05 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944134+0000", 2024-04-26T07:50:29.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015355999999999999 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944461+0000", 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032647500000000001 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944706+0000", 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024554399999999999 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.952188+0000", 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074813420000000002 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959218+0000", 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070308560000000003 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959399+0000", 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018032599999999999 2024-04-26T07:50:29.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959526+0000", 2024-04-26T07:50:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012710600000000001 2024-04-26T07:50:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2160 3.38 3:1c2379f3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.735279886999997, 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019223560000000001, 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2160 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.034 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270035+0000", 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3229999999999999e-06 2024-04-26T07:50:29.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273499+0000", 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003464033 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273551+0000", 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808999999999998e-05 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273572+0000", 2024-04-26T07:50:29.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0639e-05 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273714+0000", 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000142051 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273994+0000", 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028034300000000001 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:29.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.274248+0000", 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025402999999999998 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.282877+0000", 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0086282249999999998 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289064+0000", 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061877709999999999 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289171+0000", 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106974 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289255+0000", 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3362000000000006e-05 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:29.039 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.706481381000003, 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:29.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 11.171406447000001, 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.045 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:29.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:29.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.050 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.95472391, 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:29.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.18200423, 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:29.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:29.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:29.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.108351276, 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.062 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:29.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.079646048000001, 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:29.068 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.073 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.046825481999999, 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.074 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2724 3.29 3:976d7661:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.034271191, 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019962855000000002, 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2724 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971043+0000", 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9220000000000001e-06 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.081 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972756+0000", 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001713551 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972791+0000", 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4579999999999998e-05 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972806+0000", 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4849e-05 2024-04-26T07:50:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972914+0000", 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010813 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973090+0000", 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017668800000000001 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973260+0000", 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016923 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.980034+0000", 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067747650000000003 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990921+0000", 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010887000000000001 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990967+0000", 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5593999999999997e-05 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.991003+0000", 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5546000000000002e-05 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.013031678000001, 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.091 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2735 3.33 3:cc12dc1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.9191448320000006, 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019612998, 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2735 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086169+0000", 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087881+0000", 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017120709999999999 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087907+0000", 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5701e-05 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087917+0000", 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0299000000000001e-05 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087987+0000", 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0617000000000005e-05 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088128+0000", 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014068300000000001 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088258+0000", 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013018799999999999 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.093485+0000", 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005226718 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105701+0000", 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012216385 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105744+0000", 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2938000000000001e-05 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105779+0000", 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4768000000000003e-05 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.7752797549999997, 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.097 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:29.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.7218728419999998, 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:29.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2788 3.2 3:42019dbc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3609652140000001, 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019599115, 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.109 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2788 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644348+0000", 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.114e-06 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645604+0000", 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001256032 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645637+0000", 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2877999999999999e-05 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645652+0000", 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5688e-05 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645741+0000", 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8912000000000005e-05 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645863+0000", 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121846 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645963+0000", 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9592999999999993e-05 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.650283+0000", 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043205220000000003 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663810+0000", 2024-04-26T07:50:29.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013526322 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663883+0000", 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3586999999999999e-05 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663945+0000", 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1620999999999998e-05 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.114 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2792 3.27 3:e547b6ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3220170670000009, 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018592296000000001, 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2792 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.115 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683297+0000", 2024-04-26T07:50:29.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684797+0000", 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015003379999999999 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684821+0000", 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4474e-05 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684835+0000", 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3053e-05 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684916+0000", 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1756999999999997e-05 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685075+0000", 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000158388 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685218+0000", 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143141 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.689955+0000", 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00473698 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701742+0000", 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011787445000000001 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701828+0000", 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701886+0000", 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7955000000000003e-05 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:29.120 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3112870109999992, 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.125 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.126 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:29.126 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:29.126 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:29.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:29.128 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:29.128 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:29.126+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:29.228 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:29.226+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:29.258 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:29.258 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:29.259 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:29.259 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:29.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:29.328 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:29.329 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:29.329 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:29.326+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:29.348 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:29.365 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:29.382 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:29.382 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:29.398 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:29.398 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:29.398 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:29.398 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:29.398 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:29.404 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:29.404 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:29.413 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:29.424 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:29.424 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:29.430 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:29.426+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:29.442 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:29.442 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:29.460 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:29.460 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:29.530 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:29.526+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:29.579 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:29.580 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:29.594 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:29.631 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:29.630+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:29.732 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:29.730+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:29.759 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:29.759 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:29.773 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:29.863 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:29.862+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:29.934 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:29.930+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:29.937 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:29.938 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:29.952 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:29.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:50:30.034 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:30.030+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:30.120 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:30.120 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:30.135 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:30.136 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:30.134+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:30.236 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:30.234+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:30.305 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:30.305 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:30.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:30.337 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:30.334+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:30.438 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:30.434+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:30.486 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:30.487 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:30.502 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:30.538 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:30.534+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:30.626 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:30.627 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:30.639 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:30.638+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:30.640 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:30.740 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:30.738+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:30.764 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:30.764 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:30.779 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:30.867 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:30.866+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:30.878 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:50:30.947 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:30.947 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:30.951 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:30.950+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:30.961 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:31.047 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:31.046+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:31.125 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:31.126 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:31.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:31.183 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:31.182+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:31.245 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:31.242+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:31.276 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:31.276 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:31.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:31.346 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:31.346+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:31.447 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:31.446+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:31.466 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:31.466 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:31.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:31.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:31.567 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:31.566+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:31.648 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:31.646+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:31.655 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:31.655 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:31.671 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:31.676 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:31.676 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:31.694 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:31.711 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:31.729 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:31.729 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:31.750 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:31.750 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:31.750 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:31.746+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:31.771 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:31.771 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:31.791 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:31.791 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:31.794 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:31.794 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:31.794 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:31.794 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:31.808 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:31.812 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:31.813 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:31.879 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:31.878+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:31.945 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:31.946 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:31.946 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:31.946 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:31.946 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:31.952 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:31.950+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:31.960 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:32.053 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:32.050+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.811263938000003, 2024-04-26T07:50:32.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:32.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:32.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.646605194000003, 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.139 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:32.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.144 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.624731152999999, 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.145 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:32.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.081932166999998, 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:32.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.029842314, 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.155 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:32.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.003353986, 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:32.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:32.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.835088775000003, 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.164 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:32.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:32.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.378058510000002, 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.170 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:32.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 50.272244123999997, 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:32.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:32.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:32.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 49.921483072999997, 2024-04-26T07:50:32.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:32.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2613 3.31 3:8eaf08fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.412397695999999, 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016123849999999999, 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.187 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2613 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716535+0000", 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.849e-06 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717876+0000", 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001341084 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717910+0000", 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3575000000000003e-05 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717925+0000", 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5750999999999999e-05 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718012+0000", 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6472999999999997e-05 2024-04-26T07:50:32.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718191+0000", 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017946999999999999 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718360+0000", 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000169154 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.722797+0000", 2024-04-26T07:50:32.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044362610000000004 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732580+0000", 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097836820000000001 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732624+0000", 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3213000000000001e-05 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732657+0000", 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3337999999999998e-05 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2618 3.31 3:8daa9f80:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.359119529999999, 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021000648, 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.193 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2618 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769814+0000", 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771227+0000", 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001413428 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771261+0000", 2024-04-26T07:50:32.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3244000000000002e-05 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771276+0000", 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5695000000000001e-05 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771351+0000", 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4919000000000006e-05 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771510+0000", 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015855900000000001 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771615+0000", 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010500799999999999 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.776024+0000", 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044095430000000001 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790685+0000", 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014660678999999999 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790755+0000", 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0364000000000006e-05 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790812+0000", 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6527000000000003e-05 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.198 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2622 3.31 3:8e8c5c0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.31401247, 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019283708, 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2622 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.199 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814921+0000", 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7379999999999999e-06 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.815980+0000", 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010592729999999999 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816013+0000", 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2224999999999997e-05 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816027+0000", 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4688000000000001e-05 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816104+0000", 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6922000000000007e-05 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816273+0000", 2024-04-26T07:50:32.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016859399999999999 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816446+0000", 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173554 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.821737+0000", 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052907800000000001 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834069+0000", 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012331701 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834141+0000", 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2568e-05 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834202+0000", 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0665000000000003e-05 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2688 3.25 3:a6896c0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.553608222999999, 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013724867, 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2688 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.205 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575325+0000", 2024-04-26T07:50:32.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9080000000000002e-06 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576920+0000", 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001595754 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576950+0000", 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0108999999999999e-05 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576965+0000", 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4632e-05 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577061+0000", 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5629000000000002e-05 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577244+0000", 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018314500000000001 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577371+0000", 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012685300000000001 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588321+0000", 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010950766000000001 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588646+0000", 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032420499999999999 2024-04-26T07:50:32.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588932+0000", 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028667599999999998 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.589047+0000", 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011519 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2707 3.31 3:8c445c82:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.338112935, 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020245384000000002, 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2707 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.211 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790821+0000", 2024-04-26T07:50:32.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4489999999999999e-06 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792513+0000", 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00169125 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792538+0000", 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5252000000000001e-05 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792552+0000", 2024-04-26T07:50:32.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3726999999999999e-05 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792641+0000", 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9653000000000004e-05 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792813+0000", 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017224499999999999 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792980+0000", 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167023 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.798223+0000", 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052425789999999998 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.810923+0000", 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012700438 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811000+0000", 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6526000000000006e-05 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811063+0000", 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3242000000000002e-05 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2731 3.1a e71/17 3:5858a56a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_166:head v 71'9, mlcod=59'7)", 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.078480387000001, 2024-04-26T07:50:32.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01359636, 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050452+0000", 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9149999999999999e-06 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056374+0000", 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059220490000000004 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056474+0000", 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9864000000000005e-05 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056491+0000", 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6982000000000001e-05 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056577+0000", 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5591000000000001e-05 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056606+0000", 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9422000000000001e-05 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.063970+0000", 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073637859999999998 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.064047+0000", 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6750999999999998e-05 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2738 3.31 3:8c882a39:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.220 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.012353399, 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017775144, 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2738 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.221 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116581+0000", 2024-04-26T07:50:32.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9700000000000001e-06 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118803+0000", 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022217349999999999 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118829+0000", 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5596999999999999e-05 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118841+0000", 2024-04-26T07:50:32.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2081e-05 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118923+0000", 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2106000000000003e-05 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119094+0000", 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017146300000000001 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119258+0000", 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016377899999999999 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.126373+0000", 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071146250000000003 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134224+0000", 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078514399999999995 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134297+0000", 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2970000000000001e-05 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134353+0000", 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5377999999999997e-05 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.226 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2745 3.31 3:8c638261:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.940655786000001, 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018680489000000002, 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2745 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188277+0000", 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8640000000000001e-06 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189907+0000", 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016299159999999999 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189933+0000", 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5853000000000001e-05 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189943+0000", 2024-04-26T07:50:32.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9820000000000003e-06 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190027+0000", 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4330000000000001e-05 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190196+0000", 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016852800000000001 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190345+0000", 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014998400000000001 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.195338+0000", 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049923720000000001 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206878+0000", 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011540323999999999 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206921+0000", 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3034999999999997e-05 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206956+0000", 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4301000000000002e-05 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2776 3.25 3:a7a5804f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.612996945000001, 2024-04-26T07:50:32.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013668700000000001, 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2776 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515938+0000", 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0940000000000001e-06 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517635+0000", 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016974589999999999 2024-04-26T07:50:32.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517659+0000", 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3862999999999998e-05 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517673+0000", 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3427999999999999e-05 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517744+0000", 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0921999999999996e-05 2024-04-26T07:50:32.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517749+0000", 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3410000000000002e-06 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521369+0000", 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036196499999999999 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521513+0000", 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144776 2024-04-26T07:50:32.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521661+0000", 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014765000000000001 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.528887+0000", 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072261560000000001 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529481+0000", 2024-04-26T07:50:32.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00059366900000000001 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529549+0000", 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8368999999999995e-05 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529603+0000", 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3322999999999998e-05 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2789 3.31 3:8feca985:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.47459338, 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017716994999999999, 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2789 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654339+0000", 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7829999999999999e-06 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655814+0000", 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014750449999999999 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655840+0000", 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5401e-05 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655850+0000", 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0454e-05 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655917+0000", 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7022999999999998e-05 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656068+0000", 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151321 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656189+0000", 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120974 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.660660+0000", 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044709609999999999 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671924+0000", 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011264055 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671999+0000", 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4072000000000005e-05 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.672054+0000", 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5906000000000003e-05 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.244 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:32.246 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:32.246 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:32.242+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:32.347 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:32.346+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:32.423 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:32.423 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:32.423 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:32.423 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:32.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:32.447 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:32.446+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:32.548 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:32.546+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:32.565 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:32.565 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:32.565 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:32.565 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:32.565 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:32.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:32.650 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:32.646+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:32.751 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:32.750+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:32.755 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:32.755 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:32.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:32.755 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:32.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2103 3.3b e58/17 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.484591379000001, 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017139903000000001, 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266571+0000", 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5859999999999999e-06 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275000+0000", 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084295080000000005 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275062+0000", 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1579000000000001e-05 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275091+0000", 2024-04-26T07:50:32.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8563000000000001e-05 2024-04-26T07:50:32.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275209+0000", 2024-04-26T07:50:32.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118866 2024-04-26T07:50:32.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275240+0000", 2024-04-26T07:50:32.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0372999999999999e-05 2024-04-26T07:50:32.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283650+0000", 2024-04-26T07:50:32.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084105450000000002 2024-04-26T07:50:32.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283708+0000", 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7883000000000001e-05 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:32.762 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.784119373999999, 2024-04-26T07:50:32.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:32.763 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.763 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.763 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.763 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.764 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:32.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.764 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.764 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.764 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:32.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:32.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2149 3.2e 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.758534048999998, 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016993692000000001, 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2149 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992628+0000", 2024-04-26T07:50:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5959999999999998e-06 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995727+0000", 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003098506 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995778+0000", 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0868999999999997e-05 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995797+0000", 2024-04-26T07:50:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9128999999999999e-05 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995958+0000", 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016100199999999999 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996233+0000", 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027535400000000001 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996496+0000", 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026286700000000002 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.007925+0000", 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011428880000000001 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009253+0000", 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013284150000000001 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009433+0000", 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017974500000000001 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009619+0000", 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000186329 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.683371661000002, 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.776 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2161 3.0 e58/17 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.453594580000001, 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016578915999999999, 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.782 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297568+0000", 2024-04-26T07:50:32.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7999999999999999e-06 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300910+0000", 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033417189999999999 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300956+0000", 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6139e-05 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300975+0000", 2024-04-26T07:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8856e-05 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301137+0000", 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162583 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301205+0000", 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7627999999999997e-05 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314035+0000", 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012830187 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314144+0000", 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109004 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:32.786 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.381659149999997, 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:32.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:32.792 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.290900024000003, 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:32.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.796 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2635 3.21 3:859b1c73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.803859742, 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017892425, 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.797 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2635 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947303+0000", 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.455e-06 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949508+0000", 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022040969999999999 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949528+0000", 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0647999999999999e-05 2024-04-26T07:50:32.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949537+0000", 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7790000000000001e-06 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949599+0000", 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1570999999999997e-05 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949767+0000", 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016876099999999999 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949931+0000", 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016320399999999999 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.953952+0000", 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040214059999999999 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965068+0000", 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011116041 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965140+0000", 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1746000000000001e-05 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965192+0000", 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2716999999999997e-05 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.741170519000001, 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.803 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:32.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.905978759, 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.809 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2734 3.1e 3:7bc4dd61:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.676348623999999, 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022112987000000001, 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.815 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2734 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074814+0000", 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8169999999999999e-06 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076636+0000", 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018219670000000001 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076668+0000", 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076684+0000", 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5228000000000001e-05 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076777+0000", 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3751000000000004e-05 2024-04-26T07:50:32.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076907+0000", 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129899 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.077003+0000", 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5314000000000003e-05 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.081365+0000", 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043621709999999998 2024-04-26T07:50:32.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096804+0000", 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015438825999999999 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096870+0000", 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6407000000000003e-05 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096924+0000", 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4027999999999998e-05 2024-04-26T07:50:32.820 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2744 3.1e 3:78569fb3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.57246162, 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017953593, 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.821 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2744 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178701+0000", 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180304+0000", 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016031929999999999 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180330+0000", 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5635000000000001e-05 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180341+0000", 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0869999999999999e-05 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180418+0000", 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7293999999999996e-05 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.824 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180593+0000", 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017473900000000001 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180741+0000", 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014776700000000001 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.185523+0000", 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047823859999999996 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196576+0000", 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011052674 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196618+0000", 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2286000000000001e-05 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196652+0000", 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3859000000000002e-05 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2746 3.21 3:86d1a7b8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.552679784, 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016733074000000001, 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.827 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2746 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198482+0000", 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.058e-06 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199898+0000", 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014155540000000001 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199929+0000", 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1108000000000001e-05 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199940+0000", 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1539000000000001e-05 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200021+0000", 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0721000000000002e-05 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200172+0000", 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015134 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200276+0000", 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000103664 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.205355+0000", 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050790100000000001 2024-04-26T07:50:32.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215085+0000", 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097300289999999994 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215160+0000", 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4981999999999995e-05 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215213+0000", 2024-04-26T07:50:32.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3069000000000003e-05 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2756 3.21 3:840e6052:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.444334281, 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016860624000000001, 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.833 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2756 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306829+0000", 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.207e-06 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308004+0000", 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011756620000000001 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308025+0000", 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1101e-05 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308036+0000", 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0796e-05 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308177+0000", 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000140445 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308324+0000", 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000147112 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308438+0000", 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114506 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.316220+0000", 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077820950000000002 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323522+0000", 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073011839999999996 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323607+0000", 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5148000000000005e-05 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323686+0000", 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9368000000000003e-05 2024-04-26T07:50:32.838 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2774 3.21 3:85ac5c16:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.254125058, 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022721992, 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.839 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2774 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497037+0000", 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2970000000000002e-06 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498369+0000", 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001332106 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498402+0000", 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2490000000000002e-05 2024-04-26T07:50:32.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498416+0000", 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4922999999999999e-05 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498506+0000", 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9040000000000001e-05 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498514+0000", 2024-04-26T07:50:32.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1550000000000007e-06 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500799+0000", 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002284861 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500953+0000", 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015486800000000001 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.501099+0000", 2024-04-26T07:50:32.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014553499999999999 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.505865+0000", 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047655589999999999 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519642+0000", 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013777608 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519710+0000", 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7702999999999999e-05 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519757+0000", 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6847000000000001e-05 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2781 3.2e 3:775249ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:32.845 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.180327158000001, 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018031374999999999, 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2781 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570835+0000", 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.667e-06 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572336+0000", 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015002940000000001 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572370+0000", 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4836000000000003e-05 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572385+0000", 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4649e-05 2024-04-26T07:50:32.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572477+0000", 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2167e-05 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572682+0000", 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000205183 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572864+0000", 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018175299999999999 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.578265+0000", 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054013330000000003 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588708+0000", 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01044279 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588790+0000", 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2039000000000005e-05 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588864+0000", 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3664000000000005e-05 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.851 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2786 3.2e 3:7579d053:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.127875222, 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016821571, 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2786 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.852 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623288+0000", 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1039999999999998e-06 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625551+0000", 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022631069999999999 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625580+0000", 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9479999999999999e-05 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625591+0000", 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1029999999999999e-05 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625670+0000", 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8934e-05 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625816+0000", 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000145377 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625954+0000", 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013862100000000001 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.631988+0000", 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060342160000000002 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.639972+0000", 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0079834309999999992 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.640047+0000", 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4746999999999994e-05 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.640106+0000", 2024-04-26T07:50:32.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9524000000000001e-05 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2800 3.1c 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.986659573000001, 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024565350999999999, 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.858 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2800 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764503+0000", 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766083+0000", 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015793210000000001 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766113+0000", 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0292999999999999e-05 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766125+0000", 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1575e-05 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766186+0000", 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1310999999999996e-05 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766357+0000", 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017109199999999999 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766457+0000", 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100144 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.771500+0000", 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050428799999999996 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.788952+0000", 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017451575 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789010+0000", 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8631000000000002e-05 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789066+0000", 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5235000000000002e-05 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.863 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2805 3.1e 3:7b43044d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.934131851, 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017797146999999999, 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2805 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817031+0000", 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7599999999999998e-06 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818807+0000", 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017763169999999999 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818839+0000", 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2487999999999998e-05 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818854+0000", 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4430000000000001e-05 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818961+0000", 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107006 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.819139+0000", 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017809499999999999 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.819307+0000", 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168412 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.824488+0000", 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051808059999999996 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834686+0000", 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010197868000000001 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834761+0000", 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4475999999999996e-05 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834825+0000", 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4488999999999999e-05 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2811 3.1e 3:786cbdae:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.873820308999999, 2024-04-26T07:50:32.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019591179, 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2811 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877343+0000", 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8399999999999997e-06 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879093+0000", 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001749446 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879156+0000", 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3765999999999999e-05 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879206+0000", 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.956e-05 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879283+0000", 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6602999999999998e-05 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879427+0000", 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144232 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879541+0000", 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364199999999999 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.885376+0000", 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058353909999999997 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896847+0000", 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011471212999999999 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896893+0000", 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5797000000000002e-05 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896931+0000", 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7688999999999998e-05 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:32.875 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:32.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:32.877 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:32.874+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:32.910 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:50:32.977 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:32.978+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:33.014 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:33.014 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:33.014 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:33.014 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:33.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:33.078 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:33.074+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:33.164 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:33.164 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:33.164 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:33.164 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:33.165 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:33.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:33.179 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:33.174+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:33.279 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:33.278+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:50:33.357 INFO:tasks.workunit.client.0.smithi053.stderr:200+0 records in 2024-04-26T07:50:33.357 INFO:tasks.workunit.client.0.smithi053.stderr:200+0 records out 2024-04-26T07:50:33.357 INFO:tasks.workunit.client.0.smithi053.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 12.9742 s, 162 MB/s 2024-04-26T07:50:33.359 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:33.359 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 53.081745998000002, 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:33.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:33.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:33.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2138 3.24 3:27799388:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.628930476999997, 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019291345000000001, 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.366 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2138 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:33.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726554+0000", 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1070000000000004e-06 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729580+0000", 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030264699999999999 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729630+0000", 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9574999999999999e-05 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729658+0000", 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8079999999999999e-05 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729848+0000", 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000189898 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730169+0000", 2024-04-26T07:50:33.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032129599999999999 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730446+0000", 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027665600000000002 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.739724+0000", 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0092783829999999994 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745646+0000", 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059214879999999999 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745753+0000", 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107204 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745840+0000", 2024-04-26T07:50:33.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7188000000000006e-05 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.441469306000002, 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.373 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:33.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2147 3.38 3:1e705a67:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.414623241000001, 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018669917000000001, 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.380 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2147 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940859+0000", 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5300000000000001e-06 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943909+0000", 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030493 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943953+0000", 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4712000000000002e-05 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943981+0000", 2024-04-26T07:50:33.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7166e-05 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944134+0000", 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015355999999999999 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944461+0000", 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032647500000000001 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944706+0000", 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024554399999999999 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.952188+0000", 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074813420000000002 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.385 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959218+0000", 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070308560000000003 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959399+0000", 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018032599999999999 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959526+0000", 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012710600000000001 2024-04-26T07:50:33.386 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2160 3.38 3:1c2379f3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 52.085448128000003, 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019223560000000001, 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.387 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2160 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270035+0000", 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3229999999999999e-06 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273499+0000", 2024-04-26T07:50:33.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003464033 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273551+0000", 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808999999999998e-05 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273572+0000", 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0639e-05 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273714+0000", 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000142051 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273994+0000", 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028034300000000001 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:33.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.274248+0000", 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025402999999999998 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.282877+0000", 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0086282249999999998 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289064+0000", 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061877709999999999 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289171+0000", 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106974 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289255+0000", 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3362000000000006e-05 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.393 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 51.056649622000002, 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.394 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:33.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:33.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 15.521574687999999, 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:33.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:33.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 15.304892151000001, 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.408 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:33.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:33.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.414 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.532172470999999, 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.415 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:33.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:33.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:33.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:33.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.458519516999999, 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:33.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.429814288999999, 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.429 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.396993723, 2024-04-26T07:50:33.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:33.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:33.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:33.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2724 3.29 3:976d7661:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.384439432000001, 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019962855000000002, 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.442 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2724 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971043+0000", 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9220000000000001e-06 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972756+0000", 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001713551 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972791+0000", 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4579999999999998e-05 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972806+0000", 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4849e-05 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972914+0000", 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010813 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973090+0000", 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017668800000000001 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973260+0000", 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016923 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.980034+0000", 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067747650000000003 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990921+0000", 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010887000000000001 2024-04-26T07:50:33.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990967+0000", 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5593999999999997e-05 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.991003+0000", 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5546000000000002e-05 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.363199918999999, 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.449 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:33.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:33.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2735 3.33 3:cc12dc1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.269313072999999, 2024-04-26T07:50:33.456 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019612998, 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2735 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.457 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086169+0000", 2024-04-26T07:50:33.458 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087881+0000", 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017120709999999999 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087907+0000", 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5701e-05 2024-04-26T07:50:33.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087917+0000", 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0299000000000001e-05 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087987+0000", 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0617000000000005e-05 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.460 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088128+0000", 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014068300000000001 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088258+0000", 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013018799999999999 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.093485+0000", 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005226718 2024-04-26T07:50:33.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105701+0000", 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012216385 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105744+0000", 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2938000000000001e-05 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.462 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105779+0000", 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4768000000000003e-05 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.125447996, 2024-04-26T07:50:33.463 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.464 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:33.465 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.466 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.467 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.469 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.072041083, 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:33.470 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:33.471 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.472 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.473 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:33.474 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:33.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.476 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2788 3.2 3:42019dbc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:33.477 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.711133455000001, 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019599115, 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2788 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.478 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.479 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644348+0000", 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.114e-06 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645604+0000", 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001256032 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645637+0000", 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2877999999999999e-05 2024-04-26T07:50:33.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645652+0000", 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5688e-05 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645741+0000", 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8912000000000005e-05 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.481 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645863+0000", 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121846 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645963+0000", 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9592999999999993e-05 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.650283+0000", 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043205220000000003 2024-04-26T07:50:33.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663810+0000", 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013526322 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663883+0000", 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3586999999999999e-05 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.483 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663945+0000", 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1620999999999998e-05 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2792 3.27 3:e547b6ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.672185308, 2024-04-26T07:50:33.484 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018592296000000001, 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2792 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683297+0000", 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:50:33.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684797+0000", 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015003379999999999 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684821+0000", 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4474e-05 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.487 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684835+0000", 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3053e-05 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684916+0000", 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1756999999999997e-05 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685075+0000", 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000158388 2024-04-26T07:50:33.488 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685218+0000", 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143141 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.689955+0000", 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00473698 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.489 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701742+0000", 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011787445000000001 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701828+0000", 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701886+0000", 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7955000000000003e-05 2024-04-26T07:50:33.490 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.661455252, 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:33.491 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.492 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:33.493 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.494 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:33.495 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.496 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:33.497 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:33.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:33.500 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:33.498+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:33.541 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_50_33 2024-04-26T07:50:33.600 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:33.598+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:33.640 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:33.641 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:33.641 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:33.641 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:33.656 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:33.670 INFO:tasks.workunit.client.0.smithi053.stdout:quota set for the bucket: buck_2024_03_26_07_50_33 2024-04-26T07:50:33.703 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:33.702+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:33.782 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:33.782 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:33.783 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:33.783 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:33.783 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:33.797 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:33.802 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:33.798+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:33.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:33.903 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:33.902+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:33.964 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:33.964 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 65.747198819000005, 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:33.965 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:50:33.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:33.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:33.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.919770483000001, 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.971 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:50:33.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:50:33.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:50:33.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:33.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2159 3.14 3:29380a3b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:33.976 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.715678556, 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019870071, 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2159 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:50:33.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246925+0000", 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.246928+0000", 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7719999999999999e-06 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:33.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250722+0000", 2024-04-26T07:50:33.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003794791 2024-04-26T07:50:33.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:33.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250751+0000", 2024-04-26T07:50:33.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.887e-05 2024-04-26T07:50:33.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250763+0000", 2024-04-26T07:50:33.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2167999999999999e-05 2024-04-26T07:50:33.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.250866+0000", 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102704 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.251140+0000", 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027415300000000002 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.251537+0000", 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039718099999999998 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266022+0000", 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014485071 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266638+0000", 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00061538200000000004 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266729+0000", 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1434000000000006e-05 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.266795+0000", 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5544999999999997e-05 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:33.983 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.069188574000002, 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:33.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:50:33.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:50:33.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:33.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:33.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:33.989 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.932616000000003, 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:33.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:33.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:33.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:33.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:33.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:50:33.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:33.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:33.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2237 3.14 3:2a3bf868:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.701417161999998, 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021268025999999999, 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:33.996 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2237 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:33.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261188+0000", 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.748e-06 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264952+0000", 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037645809999999999 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264975+0000", 2024-04-26T07:50:33.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2918999999999999e-05 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264986+0000", 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0373e-05 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265083+0000", 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7298000000000003e-05 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265313+0000", 2024-04-26T07:50:33.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022968700000000001 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265529+0000", 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021579800000000001 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.279284+0000", 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013755276 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282361+0000", 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003077144 2024-04-26T07:50:34.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282413+0000", 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2447000000000001e-05 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282454+0000", 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0754999999999999e-05 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2239 3.3 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.676028191, 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020185307, 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2239 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286577+0000", 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7579999999999999e-06 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290701+0000", 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041239379999999997 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290726+0000", 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5312000000000001e-05 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290737+0000", 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1129e-05 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290809+0000", 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1500000000000003e-05 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290943+0000", 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013438999999999999 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.291063+0000", 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119926 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.297286+0000", 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062232440000000002 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306608+0000", 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093216859999999992 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306693+0000", 2024-04-26T07:50:34.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5278000000000006e-05 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306760+0000", 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7145999999999997e-05 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.589150912000001, 2024-04-26T07:50:34.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2644 3.24 e71/17 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head v 71'12, mlcod=59'10)", 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.054741+0000", 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.907861896, 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019934468, 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.013 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054741+0000", 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054741+0000", 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054744+0000", 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.059736+0000", 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049917620000000003 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.059785+0000", 2024-04-26T07:50:34.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9184000000000002e-05 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.059811+0000", 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5706000000000001e-05 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.059957+0000", 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014604200000000001 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060013+0000", 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6496000000000003e-05 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074535+0000", 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014521925999999999 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074676+0000", 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014054200000000001 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2650 3.9 3:910fae93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.842157507, 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026997720999999999, 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2650 2024-04-26T07:50:34.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120449+0000", 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.213e-06 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126814+0000", 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063646370000000002 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126859+0000", 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5769999999999997e-05 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126881+0000", 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1226999999999999e-05 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127062+0000", 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018148799999999999 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127473+0000", 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041101799999999997 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127939+0000", 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046579999999999999 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.142532+0000", 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014592818 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147212+0000", 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046805379999999997 2024-04-26T07:50:34.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147317+0000", 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104706 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147444+0000", 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126506 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2651 3.34 3:2e652162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.830005256, 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026435427000000001, 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2651 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.024 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132621+0000", 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2677e-05 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140045+0000", 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074240269999999997 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140075+0000", 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0159999999999999e-05 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140090+0000", 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.485e-05 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140253+0000", 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162752 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140492+0000", 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023908800000000001 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140712+0000", 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022059900000000001 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.156194+0000", 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015481818 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158759+0000", 2024-04-26T07:50:34.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025644750000000001 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158920+0000", 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016169000000000001 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159033+0000", 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113291 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2652 3.f e71/17 3:f0cf4464:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_87:head v 71'6, mlcod=59'4)", 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.807972078000001, 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025327902999999999, 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154635+0000", 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4199999999999999e-06 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159003+0000", 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043688370000000004 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159072+0000", 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8546000000000004e-05 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159104+0000", 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2283999999999998e-05 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159252+0000", 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014761200000000001 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159318+0000", 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6248999999999995e-05 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179858+0000", 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020539973 2024-04-26T07:50:34.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179959+0000", 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100982 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2660 3.1b e71/17 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head v 71'5, mlcod=59'3)", 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.733829965, 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023049618000000001, 2024-04-26T07:50:34.034 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228775+0000", 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.75e-06 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236455+0000", 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076795539999999999 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236485+0000", 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9923000000000001e-05 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236501+0000", 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6317e-05 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236642+0000", 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014074899999999999 2024-04-26T07:50:34.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236688+0000", 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6106000000000002e-05 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251724+0000", 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015035935 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251823+0000", 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9283999999999993e-05 2024-04-26T07:50:34.038 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2717 3.24 e71/17 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head v 71'14, mlcod=71'12)", 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.061706749000001, 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024784816000000001, 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:34.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900899+0000", 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907332+0000", 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064328529999999997 2024-04-26T07:50:34.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907367+0000", 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4966999999999999e-05 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907397+0000", 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0392999999999999e-05 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907551+0000", 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015379900000000001 2024-04-26T07:50:34.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907597+0000", 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639000000000001e-05 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925587+0000", 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017990055000000001 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925681+0000", 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4696000000000003e-05 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2731 3.1a 3:5858a56a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.045858+0000", 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.916745535, 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020661364000000002, 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.043 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2731 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.045858+0000", 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.045858+0000", 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.045863+0000", 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2100000000000001e-06 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.050883+0000", 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050198100000000004 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.050930+0000", 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7233e-05 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.050950+0000", 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0023000000000001e-05 2024-04-26T07:50:34.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.051138+0000", 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018797799999999999 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.051551+0000", 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041250100000000001 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.051964+0000", 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041318099999999999 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.066271+0000", 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014307376 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.066342+0000", 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0469999999999994e-05 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.066443+0000", 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101613 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.066519+0000", 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5969000000000004e-05 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2759 3.9 3:90241583:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:34.049 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.342029+0000", 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.620574426999999, 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022274193000000001, 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2759 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.342029+0000", 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.342029+0000", 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.342049+0000", 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0407e-05 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349362+0000", 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073123570000000002 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349403+0000", 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.159e-05 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349424+0000", 2024-04-26T07:50:34.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0302999999999999e-05 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349608+0000", 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018433800000000001 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349887+0000", 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027927799999999999 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:34.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.350133+0000", 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024618200000000001 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.360625+0000", 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010491179 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.363990+0000", 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033658939999999999 2024-04-26T07:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.364172+0000", 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000181409 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.364303+0000", 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013125600000000001 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.055 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2764 3.34 3:2e573a11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.568172907999999, 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031072567999999998, 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:34.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2764 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394434+0000", 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4240000000000002e-06 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400673+0000", 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062394210000000002 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400724+0000", 2024-04-26T07:50:34.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1175999999999999e-05 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400760+0000", 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5123000000000002e-05 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400955+0000", 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019514900000000001 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401423+0000", 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046833999999999998 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401840+0000", 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041720800000000002 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.423203+0000", 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021362641000000002 2024-04-26T07:50:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425243+0000", 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020403420000000001 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425403+0000", 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015975599999999999 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425503+0000", 2024-04-26T07:50:34.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9988000000000006e-05 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2794 3.1a 3:5a28d935:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.706387+0000", 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.256216733, 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019516123999999999, 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:34.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2794 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.706387+0000", 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.706387+0000", 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.706390+0000", 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4529999999999998e-06 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.711911+0000", 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0055214369999999997 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.711954+0000", 2024-04-26T07:50:34.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2901999999999997e-05 2024-04-26T07:50:34.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.711976+0000", 2024-04-26T07:50:34.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1480000000000001e-05 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.712127+0000", 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015078199999999999 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.712392+0000", 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026564900000000002 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.712626+0000", 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000233322 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.723565+0000", 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010939839 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:34.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.725583+0000", 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020170729999999999 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.725754+0000", 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000171628 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.725903+0000", 2024-04-26T07:50:34.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014855900000000001 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2800 3.1c e72/46 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head v 72'5, mlcod=59'3)", 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.768507+0000", 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.194096713, 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021987217999999999, 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.768507+0000", 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.768507+0000", 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.768510+0000", 2024-04-26T07:50:34.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1700000000000001e-06 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775340+0000", 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006829847 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775375+0000", 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5110000000000001e-05 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775393+0000", 2024-04-26T07:50:34.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7790000000000001e-05 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775558+0000", 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016586800000000001 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775625+0000", 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6717000000000005e-05 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.790347+0000", 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014721517 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.790494+0000", 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014719900000000001 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2809 3.f e72/17 3:f01baf1e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_244:head v 72'10, mlcod=71'8)", 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.870197+0000", 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.092406247, 2024-04-26T07:50:34.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022195194000000001, 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.870197+0000", 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.870197+0000", 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:34.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.870200+0000", 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874023+0000", 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038227080000000002 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874066+0000", 2024-04-26T07:50:34.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3819000000000002e-05 2024-04-26T07:50:34.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:34.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874092+0000", 2024-04-26T07:50:34.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5412999999999999e-05 2024-04-26T07:50:34.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:34.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874274+0000", 2024-04-26T07:50:34.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018186600000000001 2024-04-26T07:50:34.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:34.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874343+0000", 2024-04-26T07:50:34.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8916000000000002e-05 2024-04-26T07:50:34.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:34.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.892245+0000", 2024-04-26T07:50:34.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017902056 2024-04-26T07:50:34.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:34.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:34.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:34.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.892392+0000", 2024-04-26T07:50:34.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014752600000000001 2024-04-26T07:50:34.080 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.080 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.080 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.080 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:34.080 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:34.080 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:34.082 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:34.083 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:34.084 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:34.084 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:34.085 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:34.085 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:34.086 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:34.086 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:34.087 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:34.087 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:34.088 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:34.090 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:34.078+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:34.090 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:34.091 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:34.110 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:34.110 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:34.183 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:34.182+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:34.221 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:34.221 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:34.236 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:34.285 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:34.282+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:34.354 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:34.354 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:34.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:34.415 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:34.414+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:34.486 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:34.482+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:34.489 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:34.490 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:34.505 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:34.595 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:34.594+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:34.674 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:34.674 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:34.688 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:34.686+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:34.689 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:34.789 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:34.786+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:34.856 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:34.856 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:34.870 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:34.919 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:34.918+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:34.991 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:34.986+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:34.994 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:34.994 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:35.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:35.092 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:35.090+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:35.173 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:35.174 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:35.188 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:35.193 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:35.190+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:35.293 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:35.290+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:35.305 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:35.305 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:35.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:35.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:50:35.411 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:35.410+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:35.487 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:35.487 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:35.494 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:35.490+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:35.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:35.596 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:35.594+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:35.624 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:35.625 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:35.638 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:35.702 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:50:35.703 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:35.698+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:35.798 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:35.794+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:35.798 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:35.799 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:35.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:35.939 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:35.938+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:35.999 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:35.998+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:36.018 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:36.018 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:36.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:36.119 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:36.118+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:36.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:36.197 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:36.198 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:36.201 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:36.198+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:36.212 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:36.264 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:36.264 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:36.282 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:36.282 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:36.298 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:36.299 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:36.302 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:36.298+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:36.315 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:36.315 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:36.336 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:36.336 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:36.356 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:36.357 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:36.366 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:36.367 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:36.367 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:36.367 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:36.367 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:36.377 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:36.380 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:36.397 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:36.398 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:36.415 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:36.410+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:36.504 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:36.502+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:36.515 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:36.515 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:36.515 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:36.515 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:36.515 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.516 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:36.516 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:36.516 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.192992001, 2024-04-26T07:50:36.516 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:36.516 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.516 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.516 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.516 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.517 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.518 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:36.519 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:36.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.519 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.519 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.519 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:36.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:36.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.522 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.523 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.523 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:36.523 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:36.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.523 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.524 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.524 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:36.524 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:36.524 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.524 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.524 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.525 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.525 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:36.525 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:36.525 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.028333257, 2024-04-26T07:50:36.525 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:36.525 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.525 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.527 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.527 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:36.527 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.527 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:36.528 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:36.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.530 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.531 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.006459216000003, 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.532 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.535 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:36.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:36.536 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.536 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.536 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:36.536 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:36.536 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.537 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.538 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.539 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.463660230000002, 2024-04-26T07:50:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.540 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.541 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.542 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:36.543 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.544 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:36.545 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.546 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.547 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2153 3.1a e58/17 3:5b8188a7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_42:head v 58'2, mlcod=0'0)", 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.411570376999997, 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013464619000000001, 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.548 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099089+0000", 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.549 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.099091+0000", 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5969999999999999e-06 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104287+0000", 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005195809 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104338+0000", 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1360999999999998e-05 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.550 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104363+0000", 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4309000000000001e-05 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104503+0000", 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014009999999999999 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.104561+0000", 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8471000000000003e-05 2024-04-26T07:50:36.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112453+0000", 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078915800000000005 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.112553+0000", 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100392 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.552 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.385082048999998, 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.553 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.554 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:36.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.556 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.557 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.216816838, 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.558 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:36.559 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.560 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.561 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:36.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.563 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2192 3.1a e58/17 3:585679e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_81:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.759786573, 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012810456, 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750872+0000", 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.750874+0000", 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.891e-06 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.565 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755121+0000", 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042465009999999997 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755151+0000", 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0599000000000003e-05 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755165+0000", 2024-04-26T07:50:36.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3814e-05 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755264+0000", 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8766999999999998e-05 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.755301+0000", 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6980000000000002e-05 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763571+0000", 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082699239999999997 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.763683+0000", 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011198 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:36.568 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.653972187000001, 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:36.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:36.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:36.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:36.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:36.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:36.576 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 54.303211136000002, 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:36.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:36.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2613 3.31 3:8eaf08fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.794125759, 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016123849999999999, 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2613 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716535+0000", 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.849e-06 2024-04-26T07:50:36.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717876+0000", 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001341084 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717910+0000", 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3575000000000003e-05 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717925+0000", 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5750999999999999e-05 2024-04-26T07:50:36.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718012+0000", 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6472999999999997e-05 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718191+0000", 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017946999999999999 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718360+0000", 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000169154 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.722797+0000", 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044362610000000004 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732580+0000", 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097836820000000001 2024-04-26T07:50:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732624+0000", 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3213000000000001e-05 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732657+0000", 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3337999999999998e-05 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2618 3.31 3:8daa9f80:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.740847593000002, 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021000648, 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2618 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769814+0000", 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771227+0000", 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001413428 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771261+0000", 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3244000000000002e-05 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771276+0000", 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5695000000000001e-05 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771351+0000", 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4919000000000006e-05 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771510+0000", 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015855900000000001 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771615+0000", 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010500799999999999 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.776024+0000", 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044095430000000001 2024-04-26T07:50:36.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790685+0000", 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014660678999999999 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790755+0000", 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0364000000000006e-05 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790812+0000", 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6527000000000003e-05 2024-04-26T07:50:36.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2622 3.31 3:8e8c5c0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.695740532999999, 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019283708, 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.595 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2622 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814921+0000", 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7379999999999999e-06 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.815980+0000", 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010592729999999999 2024-04-26T07:50:36.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816013+0000", 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2224999999999997e-05 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816027+0000", 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4688000000000001e-05 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816104+0000", 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6922000000000007e-05 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816273+0000", 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016859399999999999 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816446+0000", 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173554 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.821737+0000", 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052907800000000001 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834069+0000", 2024-04-26T07:50:36.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012331701 2024-04-26T07:50:36.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834141+0000", 2024-04-26T07:50:36.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2568e-05 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834202+0000", 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0665000000000003e-05 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2688 3.25 3:a6896c0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.935336285999998, 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013724867, 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2688 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.603 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575325+0000", 2024-04-26T07:50:36.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9080000000000002e-06 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576920+0000", 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001595754 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576950+0000", 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0108999999999999e-05 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576965+0000", 2024-04-26T07:50:36.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4632e-05 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577061+0000", 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5629000000000002e-05 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577244+0000", 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018314500000000001 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577371+0000", 2024-04-26T07:50:36.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012685300000000001 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588321+0000", 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010950766000000001 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588646+0000", 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032420499999999999 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588932+0000", 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028667599999999998 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.589047+0000", 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011519 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2707 3.31 3:8c445c82:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.719840997999999, 2024-04-26T07:50:36.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020245384000000002, 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2707 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790821+0000", 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4489999999999999e-06 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792513+0000", 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00169125 2024-04-26T07:50:36.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792538+0000", 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5252000000000001e-05 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792552+0000", 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3726999999999999e-05 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792641+0000", 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9653000000000004e-05 2024-04-26T07:50:36.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792813+0000", 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017224499999999999 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792980+0000", 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167023 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.798223+0000", 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052425789999999998 2024-04-26T07:50:36.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.810923+0000", 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012700438 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811000+0000", 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6526000000000006e-05 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811063+0000", 2024-04-26T07:50:36.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3242000000000002e-05 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2731 3.1a e71/17 3:5858a56a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_166:head v 71'9, mlcod=59'7)", 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.46020845, 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01359636, 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050452+0000", 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9149999999999999e-06 2024-04-26T07:50:36.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056374+0000", 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059220490000000004 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056474+0000", 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9864000000000005e-05 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056491+0000", 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6982000000000001e-05 2024-04-26T07:50:36.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056577+0000", 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5591000000000001e-05 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056606+0000", 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9422000000000001e-05 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.063970+0000", 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073637859999999998 2024-04-26T07:50:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.064047+0000", 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6750999999999998e-05 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2738 3.31 3:8c882a39:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.394081461999999, 2024-04-26T07:50:36.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017775144, 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2738 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116581+0000", 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9700000000000001e-06 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118803+0000", 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022217349999999999 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118829+0000", 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5596999999999999e-05 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118841+0000", 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2081e-05 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118923+0000", 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2106000000000003e-05 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119094+0000", 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017146300000000001 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119258+0000", 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016377899999999999 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.126373+0000", 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071146250000000003 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134224+0000", 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078514399999999995 2024-04-26T07:50:36.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134297+0000", 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2970000000000001e-05 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134353+0000", 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5377999999999997e-05 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2745 3.31 3:8c638261:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.322383849000001, 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018680489000000002, 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2745 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188277+0000", 2024-04-26T07:50:36.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8640000000000001e-06 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189907+0000", 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016299159999999999 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189933+0000", 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5853000000000001e-05 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189943+0000", 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9820000000000003e-06 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190027+0000", 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4330000000000001e-05 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190196+0000", 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016852800000000001 2024-04-26T07:50:36.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190345+0000", 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014998400000000001 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.195338+0000", 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049923720000000001 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206878+0000", 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011540323999999999 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206921+0000", 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3034999999999997e-05 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206956+0000", 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4301000000000002e-05 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.630 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2776 3.25 3:a7a5804f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.994725008, 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013668700000000001, 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.631 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2776 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515938+0000", 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0940000000000001e-06 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517635+0000", 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016974589999999999 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517659+0000", 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3862999999999998e-05 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517673+0000", 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3427999999999999e-05 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517744+0000", 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0921999999999996e-05 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517749+0000", 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3410000000000002e-06 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521369+0000", 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036196499999999999 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521513+0000", 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144776 2024-04-26T07:50:36.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521661+0000", 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014765000000000001 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.528887+0000", 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072261560000000001 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529481+0000", 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00059366900000000001 2024-04-26T07:50:36.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529549+0000", 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8368999999999995e-05 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529603+0000", 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3322999999999998e-05 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2789 3.31 3:8feca985:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.856321442999999, 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017716994999999999, 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:36.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2789 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654339+0000", 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7829999999999999e-06 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655814+0000", 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014750449999999999 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655840+0000", 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5401e-05 2024-04-26T07:50:36.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655850+0000", 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0454e-05 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655917+0000", 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7022999999999998e-05 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656068+0000", 2024-04-26T07:50:36.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151321 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656189+0000", 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120974 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.660660+0000", 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044709609999999999 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671924+0000", 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011264055 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671999+0000", 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4072000000000005e-05 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.672054+0000", 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5906000000000003e-05 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.643 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:36.644 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:36.644 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:36.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:36.646 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:36.642+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:36.746 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:36.742+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:36.811 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:36.811 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:36.811 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:36.811 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:36.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:36.847 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:36.846+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:36.947 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:36.947 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:36.948 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:36.948 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:36.948 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:36.948 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:36.946+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:36.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:37.049 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:37.046+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:37.083 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:37.083 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:37.083 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:37.083 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:37.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.083 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2103 3.3b e58/17 3:decf2197:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_2:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.814467088000001, 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017139903000000001, 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266568+0000", 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.266571+0000", 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5859999999999999e-06 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.085 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275000+0000", 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084295080000000005 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275062+0000", 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1579000000000001e-05 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275091+0000", 2024-04-26T07:50:37.086 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8563000000000001e-05 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275209+0000", 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118866 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.275240+0000", 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0372999999999999e-05 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283650+0000", 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0084105450000000002 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.283708+0000", 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7883000000000001e-05 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.113995082999999, 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.089 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:37.092 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.093 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:37.094 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2149 3.2e 3:75d1c83a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.095 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.088409757999997, 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016993692000000001, 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2149 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992626+0000", 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.992628+0000", 2024-04-26T07:50:37.097 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5959999999999998e-06 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995727+0000", 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003098506 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995778+0000", 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0868999999999997e-05 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.098 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995797+0000", 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9128999999999999e-05 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.995958+0000", 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016100199999999999 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.099 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996233+0000", 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027535400000000001 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.996496+0000", 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026286700000000002 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.100 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.007925+0000", 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011428880000000001 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009253+0000", 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0013284150000000001 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009433+0000", 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017974500000000001 2024-04-26T07:50:37.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.009619+0000", 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000186329 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.102 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.013247370000002, 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.103 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:37.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.109 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2161 3.0 e58/17 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.783470289, 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016578915999999999, 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297565+0000", 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297568+0000", 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7999999999999999e-06 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300910+0000", 2024-04-26T07:50:37.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033417189999999999 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300956+0000", 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6139e-05 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.300975+0000", 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8856e-05 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301137+0000", 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162583 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.301205+0000", 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7627999999999997e-05 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314035+0000", 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012830187 2024-04-26T07:50:37.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314144+0000", 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109004 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.711534858999997, 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.115 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:37.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.620775733000002, 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:37.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:37.126 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2635 3.21 3:859b1c73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.133735451, 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017892425, 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.127 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2635 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947303+0000", 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.455e-06 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949508+0000", 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022040969999999999 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949528+0000", 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0647999999999999e-05 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949537+0000", 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7790000000000001e-06 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949599+0000", 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1570999999999997e-05 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949767+0000", 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016876099999999999 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949931+0000", 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016320399999999999 2024-04-26T07:50:37.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.953952+0000", 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040214059999999999 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965068+0000", 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011116041 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965140+0000", 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1746000000000001e-05 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965192+0000", 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2716999999999997e-05 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.071046228, 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.134 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:37.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:37.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.140 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.235854467999999, 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.141 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:37.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.147 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2734 3.1e 3:7bc4dd61:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.006224332999999, 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022112987000000001, 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2734 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074814+0000", 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8169999999999999e-06 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076636+0000", 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018219670000000001 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076668+0000", 2024-04-26T07:50:37.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076684+0000", 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5228000000000001e-05 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076777+0000", 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3751000000000004e-05 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076907+0000", 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129899 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.077003+0000", 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5314000000000003e-05 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.081365+0000", 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043621709999999998 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096804+0000", 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015438825999999999 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096870+0000", 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6407000000000003e-05 2024-04-26T07:50:37.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096924+0000", 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4027999999999998e-05 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2744 3.1e 3:78569fb3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:37.154 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.902337329000002, 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017953593, 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2744 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178701+0000", 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180304+0000", 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016031929999999999 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180330+0000", 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5635000000000001e-05 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180341+0000", 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0869999999999999e-05 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180418+0000", 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7293999999999996e-05 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180593+0000", 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017473900000000001 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180741+0000", 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014776700000000001 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.185523+0000", 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047823859999999996 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196576+0000", 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011052674 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196618+0000", 2024-04-26T07:50:37.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2286000000000001e-05 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196652+0000", 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3859000000000002e-05 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2746 3.21 3:86d1a7b8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.161 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.882555493000002, 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016733074000000001, 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2746 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198480+0000", 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.198482+0000", 2024-04-26T07:50:37.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.058e-06 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199898+0000", 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014155540000000001 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199929+0000", 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1108000000000001e-05 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.199940+0000", 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1539000000000001e-05 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200021+0000", 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0721000000000002e-05 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200172+0000", 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015134 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.200276+0000", 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000103664 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.205355+0000", 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050790100000000001 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215085+0000", 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097300289999999994 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215160+0000", 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4981999999999995e-05 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.215213+0000", 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3069000000000003e-05 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2756 3.21 3:840e6052:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.774209989999999, 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016860624000000001, 2024-04-26T07:50:37.168 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2756 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:37.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306825+0000", 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.306829+0000", 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.207e-06 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308004+0000", 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0011756620000000001 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308025+0000", 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1101e-05 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308036+0000", 2024-04-26T07:50:37.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0796e-05 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308177+0000", 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000140445 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308324+0000", 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000147112 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.308438+0000", 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000114506 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.316220+0000", 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077820950000000002 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323522+0000", 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073011839999999996 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323607+0000", 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5148000000000005e-05 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.323686+0000", 2024-04-26T07:50:37.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.9368000000000003e-05 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2774 3.21 3:85ac5c16:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.584000766999999, 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022721992, 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2774 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497037+0000", 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2970000000000002e-06 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498369+0000", 2024-04-26T07:50:37.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001332106 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498402+0000", 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2490000000000002e-05 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498416+0000", 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4922999999999999e-05 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498506+0000", 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9040000000000001e-05 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498514+0000", 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1550000000000007e-06 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500799+0000", 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002284861 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500953+0000", 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015486800000000001 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.501099+0000", 2024-04-26T07:50:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014553499999999999 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.505865+0000", 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047655589999999999 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519642+0000", 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013777608 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519710+0000", 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7702999999999999e-05 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519757+0000", 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6847000000000001e-05 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.182 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2781 3.2e 3:775249ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.510202867, 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018031374999999999, 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2781 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570835+0000", 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.667e-06 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572336+0000", 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015002940000000001 2024-04-26T07:50:37.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572370+0000", 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4836000000000003e-05 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572385+0000", 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4649e-05 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572477+0000", 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2167e-05 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572682+0000", 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000205183 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572864+0000", 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018175299999999999 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.578265+0000", 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054013330000000003 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588708+0000", 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01044279 2024-04-26T07:50:37.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588790+0000", 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2039000000000005e-05 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588864+0000", 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3664000000000005e-05 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.189 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2786 3.2e 3:7579d053:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.457750931, 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016821571, 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.190 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2786 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623285+0000", 2024-04-26T07:50:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.623288+0000", 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1039999999999998e-06 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625551+0000", 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022631069999999999 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625580+0000", 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9479999999999999e-05 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625591+0000", 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1029999999999999e-05 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625670+0000", 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8934e-05 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625816+0000", 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000145377 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.625954+0000", 2024-04-26T07:50:37.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013862100000000001 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.631988+0000", 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060342160000000002 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.639972+0000", 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0079834309999999992 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.640047+0000", 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4746999999999994e-05 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.640106+0000", 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9524000000000001e-05 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2800 3.1c 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.316535282, 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024565350999999999, 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.197 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2800 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:37.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764503+0000", 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766083+0000", 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015793210000000001 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766113+0000", 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0292999999999999e-05 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766125+0000", 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1575e-05 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766186+0000", 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1310999999999996e-05 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766357+0000", 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017109199999999999 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766457+0000", 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100144 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.771500+0000", 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050428799999999996 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.788952+0000", 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017451575 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789010+0000", 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8631000000000002e-05 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789066+0000", 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5235000000000002e-05 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2805 3.1e 3:7b43044d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.203 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.26400756, 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017797146999999999, 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2805 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817028+0000", 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.817031+0000", 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7599999999999998e-06 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818807+0000", 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017763169999999999 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818839+0000", 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2487999999999998e-05 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818854+0000", 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4430000000000001e-05 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.818961+0000", 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107006 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.819139+0000", 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017809499999999999 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.819307+0000", 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168412 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.824488+0000", 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0051808059999999996 2024-04-26T07:50:37.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834686+0000", 2024-04-26T07:50:37.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010197868000000001 2024-04-26T07:50:37.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834761+0000", 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4475999999999996e-05 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.834825+0000", 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4488999999999999e-05 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2811 3.1e 3:786cbdae:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.203696017999999, 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019591179, 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2811 2024-04-26T07:50:37.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877343+0000", 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8399999999999997e-06 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879093+0000", 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001749446 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879156+0000", 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3765999999999999e-05 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879206+0000", 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.956e-05 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879283+0000", 2024-04-26T07:50:37.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6602999999999998e-05 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879427+0000", 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144232 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879541+0000", 2024-04-26T07:50:37.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364199999999999 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.885376+0000", 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058353909999999997 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896847+0000", 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011471212999999999 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896893+0000", 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5797000000000002e-05 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896931+0000", 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7688999999999998e-05 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.217 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.218 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:37.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:37.220 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:37.218+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:37.320 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:37.318+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:37.379 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:37.380 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:37.380 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:37.380 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:37.393 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:37.421 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:37.418+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:37.522 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:37.518+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:37.558 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:37.558 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:37.559 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:37.559 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:37.559 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:37.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:37.623 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:37.622+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:37.693 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:37.693 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:37.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:37.693 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:37.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 57.417544364999998, 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:37.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.696 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.697 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2138 3.24 3:27799388:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:37.699 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.964728844, 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019291345000000001, 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2138 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726549+0000", 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.726554+0000", 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1070000000000004e-06 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729580+0000", 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030264699999999999 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.701 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729630+0000", 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9574999999999999e-05 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729658+0000", 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8079999999999999e-05 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.729848+0000", 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000189898 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.702 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730169+0000", 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032129599999999999 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.730446+0000", 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027665600000000002 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.739724+0000", 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0092783829999999994 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.703 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745646+0000", 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059214879999999999 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745753+0000", 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000107204 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.745840+0000", 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7188000000000006e-05 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.704 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.777267672999997, 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.705 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:37.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:37.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2147 3.38 3:1e705a67:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.750421608000003, 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018669917000000001, 2024-04-26T07:50:37.710 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2147 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.711 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940856+0000", 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.940859+0000", 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5300000000000001e-06 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943909+0000", 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0030493 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.712 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943953+0000", 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4712000000000002e-05 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.943981+0000", 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7166e-05 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944134+0000", 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015355999999999999 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.713 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944461+0000", 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032647500000000001 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.944706+0000", 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024554399999999999 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.952188+0000", 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074813420000000002 2024-04-26T07:50:37.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959218+0000", 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070308560000000003 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959399+0000", 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018032599999999999 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.959526+0000", 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012710600000000001 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2160 3.38 3:1c2379f3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 56.421246494999998, 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019223560000000001, 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.716 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2160 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.717 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270031+0000", 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.270035+0000", 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3229999999999999e-06 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273499+0000", 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003464033 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.718 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273551+0000", 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808999999999998e-05 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273572+0000", 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0639e-05 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273714+0000", 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000142051 2024-04-26T07:50:37.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.273994+0000", 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028034300000000001 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.274248+0000", 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025402999999999998 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.282877+0000", 2024-04-26T07:50:37.720 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0086282249999999998 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289064+0000", 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061877709999999999 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289171+0000", 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106974 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.721 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.289255+0000", 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3362000000000006e-05 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 55.392447988999997, 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.722 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.723 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:37.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:37.726 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.727 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.857373055, 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.728 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:37.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.731 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.733 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 19.640690518, 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.734 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.736 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.737 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:37.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:37.739 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.867970838000002, 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.740 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.741 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.742 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.745 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.794317884000002, 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.746 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.749 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.765612655999998, 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.752 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.753 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:37.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.755 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:37.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:37.757 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.73279209, 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.758 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:37.760 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:37.761 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:37.763 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2724 3.29 3:976d7661:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.720237799, 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019962855000000002, 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.764 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2724 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971040+0000", 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.971043+0000", 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9220000000000001e-06 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972756+0000", 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001713551 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972791+0000", 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4579999999999998e-05 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972806+0000", 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4849e-05 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.972914+0000", 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010813 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973090+0000", 2024-04-26T07:50:37.767 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017668800000000001 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.973260+0000", 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016923 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.980034+0000", 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0067747650000000003 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.768 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990921+0000", 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010887000000000001 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.990967+0000", 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5593999999999997e-05 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.991003+0000", 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5546000000000002e-05 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.698998285999998, 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.770 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:37.771 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:37.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.773 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.774 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.775 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2735 3.33 3:cc12dc1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.605111440000002, 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019612998, 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2735 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.776 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086166+0000", 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.086169+0000", 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6299999999999998e-06 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087881+0000", 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017120709999999999 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087907+0000", 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5701e-05 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087917+0000", 2024-04-26T07:50:37.778 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0299000000000001e-05 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.087987+0000", 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0617000000000005e-05 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088128+0000", 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014068300000000001 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:37.779 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.088258+0000", 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013018799999999999 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.093485+0000", 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005226718 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105701+0000", 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012216385 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.780 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105744+0000", 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2938000000000001e-05 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.105779+0000", 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4768000000000003e-05 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:37.781 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.461246363000001, 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.784 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.785 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.786 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.407839450000001, 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:37.787 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.789 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:37.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2788 3.2 3:42019dbc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.046931822000001, 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019599115, 2024-04-26T07:50:37.793 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2788 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644346+0000", 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.644348+0000", 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.114e-06 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645604+0000", 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001256032 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645637+0000", 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2877999999999999e-05 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645652+0000", 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5688e-05 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645741+0000", 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8912000000000005e-05 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645863+0000", 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000121846 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.645963+0000", 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9592999999999993e-05 2024-04-26T07:50:37.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.650283+0000", 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043205220000000003 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663810+0000", 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013526322 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663883+0000", 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3586999999999999e-05 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.663945+0000", 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1620999999999998e-05 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2792 3.27 3:e547b6ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.007983674999998, 2024-04-26T07:50:37.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018592296000000001, 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2792 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683294+0000", 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.683297+0000", 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8100000000000002e-06 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684797+0000", 2024-04-26T07:50:37.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015003379999999999 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684821+0000", 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4474e-05 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684835+0000", 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3053e-05 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.684916+0000", 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1756999999999997e-05 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685075+0000", 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000158388 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.685218+0000", 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000143141 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.689955+0000", 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00473698 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701742+0000", 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011787445000000001 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701828+0000", 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.701886+0000", 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7955000000000003e-05 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.997253618999999, 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:37.805 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:37.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:37.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:37.810 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.811 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.811 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.811 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:37.811 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:37.811 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:37.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:50:37.813 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:37.813 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:37.810+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:37.914 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:37.910+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:37.962 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:37.963 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:37.963 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:37.963 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:37.983 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:38.015 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:38.014+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:38.116 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:38.114+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:38.157 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:38.157 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:38.157 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:38.157 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:38.157 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:38.173 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:38.217 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:38.214+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:38.317 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:38.314+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.142601972999998, 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.359 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:38.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:50:38.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:50:38.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:50:38.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:50:38.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.365 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 57.315173637000001, 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.366 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:50:38.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:50:38.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.464591728000002, 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:38.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:38.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.328019154000003, 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:38.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:50:38.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:50:38.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:50:38.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2237 3.14 3:2a3bf868:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.096820315999999, 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021268025999999999, 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2237 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261186+0000", 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.261188+0000", 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.748e-06 2024-04-26T07:50:38.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264952+0000", 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037645809999999999 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264975+0000", 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2918999999999999e-05 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.264986+0000", 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0373e-05 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265083+0000", 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7298000000000003e-05 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265313+0000", 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022968700000000001 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.265529+0000", 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021579800000000001 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.279284+0000", 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013755276 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282361+0000", 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003077144 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282413+0000", 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2447000000000001e-05 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.282454+0000", 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0754999999999999e-05 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2239 3.3 3:c1b31baa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.071431345000001, 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020185307, 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2239 2024-04-26T07:50:38.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286575+0000", 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.286577+0000", 2024-04-26T07:50:38.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7579999999999999e-06 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290701+0000", 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041239379999999997 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290726+0000", 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5312000000000001e-05 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290737+0000", 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1129e-05 2024-04-26T07:50:38.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290809+0000", 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1500000000000003e-05 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.290943+0000", 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013438999999999999 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.291063+0000", 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119926 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.297286+0000", 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062232440000000002 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306608+0000", 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093216859999999992 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306693+0000", 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5278000000000006e-05 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.306760+0000", 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7145999999999997e-05 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:38.395 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.984554066000001, 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:50:38.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2650 3.9 3:910fae93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.237560661, 2024-04-26T07:50:38.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026997720999999999, 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2650 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120449+0000", 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.213e-06 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126814+0000", 2024-04-26T07:50:38.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063646370000000002 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126859+0000", 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5769999999999997e-05 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126881+0000", 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1226999999999999e-05 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127062+0000", 2024-04-26T07:50:38.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018148799999999999 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127473+0000", 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041101799999999997 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127939+0000", 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046579999999999999 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.142532+0000", 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014592818 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147212+0000", 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046805379999999997 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147317+0000", 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104706 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147444+0000", 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126506 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2651 3.34 3:2e652162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.22540841, 2024-04-26T07:50:38.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026435427000000001, 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2651 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:38.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132621+0000", 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2677e-05 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140045+0000", 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074240269999999997 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140075+0000", 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0159999999999999e-05 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140090+0000", 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.485e-05 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140253+0000", 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162752 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140492+0000", 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023908800000000001 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140712+0000", 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022059900000000001 2024-04-26T07:50:38.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.156194+0000", 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015481818 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158759+0000", 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025644750000000001 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158920+0000", 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016169000000000001 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159033+0000", 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113291 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2652 3.f e71/17 3:f0cf4464:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_87:head v 71'6, mlcod=59'4)", 2024-04-26T07:50:38.413 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.203375231999999, 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025327902999999999, 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154635+0000", 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4199999999999999e-06 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159003+0000", 2024-04-26T07:50:38.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043688370000000004 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159072+0000", 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8546000000000004e-05 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159104+0000", 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2283999999999998e-05 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159252+0000", 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014761200000000001 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159318+0000", 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6248999999999995e-05 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179858+0000", 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020539973 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179959+0000", 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100982 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2660 3.1b e71/17 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head v 71'5, mlcod=59'3)", 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.129233118999998, 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023049618000000001, 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.418 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228775+0000", 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.75e-06 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236455+0000", 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076795539999999999 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236485+0000", 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9923000000000001e-05 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236501+0000", 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6317e-05 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236642+0000", 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014074899999999999 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236688+0000", 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6106000000000002e-05 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251724+0000", 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015035935 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251823+0000", 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9283999999999993e-05 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2717 3.24 e71/17 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head v 71'14, mlcod=71'12)", 2024-04-26T07:50:38.422 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.457109902999999, 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024784816000000001, 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900899+0000", 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907332+0000", 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064328529999999997 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907367+0000", 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4966999999999999e-05 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907397+0000", 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0392999999999999e-05 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907551+0000", 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015379900000000001 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907597+0000", 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639000000000001e-05 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925587+0000", 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017990055000000001 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925681+0000", 2024-04-26T07:50:38.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4696000000000003e-05 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2731 3.1a 3:5858a56a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.045858+0000", 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.312148689000001, 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020661364000000002, 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.427 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2731 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.045858+0000", 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.045858+0000", 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.045863+0000", 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2100000000000001e-06 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.050883+0000", 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050198100000000004 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.050930+0000", 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7233e-05 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.050950+0000", 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0023000000000001e-05 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.051138+0000", 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018797799999999999 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.051551+0000", 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041250100000000001 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.051964+0000", 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041318099999999999 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.066271+0000", 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014307376 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.066342+0000", 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0469999999999994e-05 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.066443+0000", 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101613 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.066519+0000", 2024-04-26T07:50:38.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5969000000000004e-05 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2759 3.9 3:90241583:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.342029+0000", 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.015977581000001, 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022274193000000001, 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.433 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2759 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.342029+0000", 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.342029+0000", 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.342049+0000", 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0407e-05 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349362+0000", 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073123570000000002 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349403+0000", 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.159e-05 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349424+0000", 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0302999999999999e-05 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349608+0000", 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018433800000000001 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.349887+0000", 2024-04-26T07:50:38.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027927799999999999 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.350133+0000", 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024618200000000001 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.360625+0000", 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010491179 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.363990+0000", 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0033658939999999999 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.364172+0000", 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000181409 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.364303+0000", 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013125600000000001 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2764 3.34 3:2e573a11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.963576062000001, 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031072567999999998, 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2764 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394434+0000", 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4240000000000002e-06 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400673+0000", 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062394210000000002 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400724+0000", 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1175999999999999e-05 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400760+0000", 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5123000000000002e-05 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400955+0000", 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019514900000000001 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401423+0000", 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046833999999999998 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401840+0000", 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041720800000000002 2024-04-26T07:50:38.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.423203+0000", 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021362641000000002 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425243+0000", 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020403420000000001 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425403+0000", 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015975599999999999 2024-04-26T07:50:38.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425503+0000", 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9988000000000006e-05 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2800 3.1c e72/46 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head v 72'5, mlcod=59'3)", 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.768507+0000", 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.589499867000001, 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021987217999999999, 2024-04-26T07:50:38.444 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.768507+0000", 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.768507+0000", 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.768510+0000", 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1700000000000001e-06 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775340+0000", 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006829847 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775375+0000", 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5110000000000001e-05 2024-04-26T07:50:38.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775393+0000", 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7790000000000001e-05 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775558+0000", 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016586800000000001 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.775625+0000", 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6717000000000005e-05 2024-04-26T07:50:38.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.790347+0000", 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014721517 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.790494+0000", 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014719900000000001 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.448 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2809 3.f e72/17 3:f01baf1e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_244:head v 72'10, mlcod=71'8)", 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.870197+0000", 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.487809401, 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022195194000000001, 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.870197+0000", 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.870197+0000", 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.870200+0000", 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874023+0000", 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038227080000000002 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874066+0000", 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3819000000000002e-05 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874092+0000", 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5412999999999999e-05 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874274+0000", 2024-04-26T07:50:38.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018186600000000001 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.874343+0000", 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8916000000000002e-05 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.892245+0000", 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017902056 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.892392+0000", 2024-04-26T07:50:38.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014752600000000001 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2980 3.34 3:2c27af06:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.54396289099999995, 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023940217999999999, 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.453 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2980 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814047+0000", 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.49e-06 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820559+0000", 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065114609999999996 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820595+0000", 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6919999999999999e-05 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820614+0000", 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9017000000000001e-05 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820759+0000", 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014448600000000001 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821025+0000", 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026618799999999999 2024-04-26T07:50:38.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821281+0000", 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000255388 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837756+0000", 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016475019 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837825+0000", 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9529999999999993e-05 2024-04-26T07:50:38.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837913+0000", 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8418000000000006e-05 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837984+0000", 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0301000000000003e-05 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2988 3.f e78/17 3:f2e60fa8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_13:head v 78'11, mlcod=72'9)", 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.428451633, 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025247141000000001, 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929557+0000", 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.812e-06 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932701+0000", 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031440909999999999 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932727+0000", 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6485000000000001e-05 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932740+0000", 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2899e-05 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932846+0000", 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106261 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932884+0000", 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7150000000000002e-05 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954658+0000", 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021774803999999998 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954802+0000", 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014363900000000001 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.462 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2989 3.34 3:2fe38c4b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.934738+0000", 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.42326885199999997, 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020774132000000001, 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2989 2024-04-26T07:50:38.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.934738+0000", 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.934738+0000", 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.934741+0000", 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8070000000000001e-06 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938692+0000", 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039509430000000002 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938711+0000", 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9134e-05 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938722+0000", 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.083e-05 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938863+0000", 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000140512 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.939091+0000", 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022856100000000001 2024-04-26T07:50:38.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.939303+0000", 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021127900000000001 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.953390+0000", 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014087507000000001 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.955355+0000", 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019643759999999999 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.955447+0000", 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2229000000000001e-05 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.955512+0000", 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4954000000000002e-05 2024-04-26T07:50:38.468 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.469 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.469 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.469 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.469 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.469 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:38.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:38.471 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:38.466+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:38.472 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:38.572 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:38.570+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:38.621 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:38.621 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:38.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.621 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3047 3.3a 3:5d265fa9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:38.610541+0000", 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.012812174000000001, 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01286555, 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "waiting for sub ops", 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:38.622 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3047 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.610541+0000", 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.610541+0000", 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:38.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.610544+0000", 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.92e-06 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.614336+0000", 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037927149999999999 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.614360+0000", 2024-04-26T07:50:38.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3163000000000002e-05 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.614371+0000", 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1634000000000001e-05 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.614448+0000", 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7058000000000007e-05 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:38.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.614606+0000", 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015762 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.614737+0000", 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000131292 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.620603+0000", 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058657939999999997 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.626 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:38.627 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.627 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:38.627 INFO:teuthology.orchestra.run.smithi191.stdout: ], 2024-04-26T07:50:38.627 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 1 2024-04-26T07:50:38.627 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:38.633 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:38.634 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:38.640 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:38.656 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:38.656 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:38.673 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:38.670+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:38.677 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:38.678 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:38.701 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:38.701 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:38.722 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:38.722 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:38.747 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:38.747 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:38.773 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:38.774 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:38.770+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:38.807 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:38.807 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:38.822 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:38.822 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:38.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:38.891 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:38.890+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:38.914 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:50:38.976 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:38.974+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:38.998 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:38.999 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:39.013 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:39.076 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:39.074+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:39.177 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:39.174+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:39.186 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:39.187 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:39.208 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:39.278 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:39.274+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:39.349 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:39.349 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:39.365 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:39.379 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:39.378+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:39.480 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:39.478+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:39.539 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:39.539 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:39.561 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:39.607 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:39.606+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:39.681 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:39.678+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:39.702 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:39.702 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:39.721 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:39.783 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:39.778+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:39.884 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:39.882+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:39.896 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:39.896 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:39.914 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:39.984 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:39.982+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:40.054 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:40.054 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:40.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:40.085 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:40.082+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:40.186 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:40.182+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:40.230 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:40.230 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:40.258 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:40.287 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:40.286+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:40.388 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:40.386+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:40.465 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:40.465 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:40.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:40.489 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:40.486+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:40.590 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:40.586+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:40.680 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:40.680 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:40.691 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:40.690+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:40.707 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:40.795 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:40.794+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:40.842 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:40.893 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:40.890+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:40.918 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:40.918 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:40.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:40.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:50:40.994 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:40.990+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:41.029 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:41.029 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:41.053 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:41.076 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:41.076 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:41.091 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:41.091 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:41.091 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:41.091 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:41.091 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:41.095 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:41.094+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:41.107 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:41.107 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:41.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:41.140 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:41.169 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:41.193 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:41.193 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:41.196 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:41.194+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:41.231 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:41.232 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:41.308 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:41.306+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:41.347 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:41.347 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:41.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:41.347 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:41.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.347 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 61.026459604000003, 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.349 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:41.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:41.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.861800860000002, 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.353 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.355 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.356 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.357 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.839926818999999, 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.359 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:41.360 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:41.361 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:41.362 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.363 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.297127832999998, 2024-04-26T07:50:41.364 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:41.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:41.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.368 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2154 3.6 e58/17 3:632a9e6f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_43:head v 58'3, mlcod=53'1)", 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.218549652, 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013561083999999999, 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.369 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125577+0000", 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.125579+0000", 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5119999999999998e-06 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128808+0000", 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032290349999999999 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.370 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128852+0000", 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.128873+0000", 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0528000000000001e-05 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129041+0000", 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016766900000000001 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.371 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.129110+0000", 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9017999999999995e-05 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139080+0000", 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099705739999999994 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.139138+0000", 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7809000000000002e-05 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.372 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.050284441000002, 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:41.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.374 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.375 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:41.376 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.377 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:41.378 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 59.487439790000003, 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:41.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:41.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:41.382 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:41.383 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2233 3.31 3:8de12f46:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 59.136678738999997, 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01503113, 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2233 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.385 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207448+0000", 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.207452+0000", 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8530000000000002e-06 2024-04-26T07:50:41.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209348+0000", 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001896532 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209387+0000", 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8476000000000002e-05 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209403+0000", 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6223e-05 2024-04-26T07:50:41.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209508+0000", 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105486 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209697+0000", 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018858500000000001 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.209861+0000", 2024-04-26T07:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163821 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.215255+0000", 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053943330000000003 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222377+0000", 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071220900000000002 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222426+0000", 2024-04-26T07:50:41.389 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8538000000000002e-05 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.222479+0000", 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3192999999999997e-05 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2613 3.31 3:8eaf08fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.627593361999999, 2024-04-26T07:50:41.390 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016123849999999999, 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2613 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.391 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716535+0000", 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.849e-06 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717876+0000", 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001341084 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.392 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717910+0000", 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3575000000000003e-05 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717925+0000", 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5750999999999999e-05 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718012+0000", 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6472999999999997e-05 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718191+0000", 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017946999999999999 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718360+0000", 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000169154 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.722797+0000", 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044362610000000004 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732580+0000", 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097836820000000001 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732624+0000", 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3213000000000001e-05 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732657+0000", 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3337999999999998e-05 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2618 3.31 3:8daa9f80:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.574315196000001, 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021000648, 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2618 2024-04-26T07:50:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769814+0000", 2024-04-26T07:50:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771227+0000", 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001413428 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771261+0000", 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3244000000000002e-05 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771276+0000", 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5695000000000001e-05 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771351+0000", 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4919000000000006e-05 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771510+0000", 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015855900000000001 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.399 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771615+0000", 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010500799999999999 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.776024+0000", 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044095430000000001 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790685+0000", 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014660678999999999 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.400 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790755+0000", 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0364000000000006e-05 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790812+0000", 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6527000000000003e-05 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2622 3.31 3:8e8c5c0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:41.401 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.529208136000001, 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019283708, 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2622 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:41.402 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814921+0000", 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7379999999999999e-06 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.815980+0000", 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010592729999999999 2024-04-26T07:50:41.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816013+0000", 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2224999999999997e-05 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816027+0000", 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4688000000000001e-05 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816104+0000", 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6922000000000007e-05 2024-04-26T07:50:41.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816273+0000", 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016859399999999999 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816446+0000", 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173554 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.821737+0000", 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052907800000000001 2024-04-26T07:50:41.405 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834069+0000", 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012331701 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834141+0000", 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2568e-05 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834202+0000", 2024-04-26T07:50:41.406 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0665000000000003e-05 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2688 3.25 3:a6896c0d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.768803889000001, 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013724867, 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.407 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2688 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575323+0000", 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.408 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.575325+0000", 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9080000000000002e-06 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576920+0000", 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001595754 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576950+0000", 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0108999999999999e-05 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.409 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.576965+0000", 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4632e-05 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577061+0000", 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5629000000000002e-05 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577244+0000", 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018314500000000001 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.410 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.577371+0000", 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012685300000000001 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588321+0000", 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010950766000000001 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588646+0000", 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00032420499999999999 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.411 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.588932+0000", 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028667599999999998 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.589047+0000", 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011519 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2707 3.31 3:8c445c82:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:41.412 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.553308601000001, 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020245384000000002, 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2707 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:41.413 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790821+0000", 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4489999999999999e-06 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.414 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792513+0000", 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00169125 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792538+0000", 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5252000000000001e-05 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792552+0000", 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3726999999999999e-05 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.415 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792641+0000", 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9653000000000004e-05 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792813+0000", 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017224499999999999 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792980+0000", 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167023 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.416 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.798223+0000", 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052425789999999998 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.810923+0000", 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012700438 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811000+0000", 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6526000000000006e-05 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.417 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811063+0000", 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3242000000000002e-05 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2731 3.1a e71/17 3:5858a56a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_166:head v 71'9, mlcod=59'7)", 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.293676052999999, 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01359636, 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050450+0000", 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.050452+0000", 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9149999999999999e-06 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056374+0000", 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059220490000000004 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056474+0000", 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9864000000000005e-05 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056491+0000", 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6982000000000001e-05 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056577+0000", 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5591000000000001e-05 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.056606+0000", 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9422000000000001e-05 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.063970+0000", 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073637859999999998 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.064047+0000", 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6750999999999998e-05 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2738 3.31 3:8c882a39:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.227549065000002, 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017775144, 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.422 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2738 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.423 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116581+0000", 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9700000000000001e-06 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118803+0000", 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022217349999999999 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.424 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118829+0000", 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5596999999999999e-05 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118841+0000", 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2081e-05 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118923+0000", 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2106000000000003e-05 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.425 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119094+0000", 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017146300000000001 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119258+0000", 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016377899999999999 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.126373+0000", 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071146250000000003 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.426 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134224+0000", 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078514399999999995 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134297+0000", 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2970000000000001e-05 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134353+0000", 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5377999999999997e-05 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.427 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2745 3.31 3:8c638261:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.155851452, 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018680489000000002, 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2745 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188277+0000", 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8640000000000001e-06 2024-04-26T07:50:41.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189907+0000", 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016299159999999999 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189933+0000", 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5853000000000001e-05 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189943+0000", 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9820000000000003e-06 2024-04-26T07:50:41.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190027+0000", 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4330000000000001e-05 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190196+0000", 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016852800000000001 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190345+0000", 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014998400000000001 2024-04-26T07:50:41.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.195338+0000", 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049923720000000001 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206878+0000", 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011540323999999999 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206921+0000", 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3034999999999997e-05 2024-04-26T07:50:41.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206956+0000", 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4301000000000002e-05 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2776 3.25 3:a7a5804f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.828192610999999, 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013668700000000001, 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.433 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2776 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.434 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515934+0000", 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.515938+0000", 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0940000000000001e-06 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517635+0000", 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016974589999999999 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.435 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517659+0000", 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3862999999999998e-05 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517673+0000", 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3427999999999999e-05 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517744+0000", 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0921999999999996e-05 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.436 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.517749+0000", 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3410000000000002e-06 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521369+0000", 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0036196499999999999 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521513+0000", 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144776 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.437 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.521661+0000", 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014765000000000001 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.528887+0000", 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072261560000000001 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529481+0000", 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00059366900000000001 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.438 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529549+0000", 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8368999999999995e-05 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.529603+0000", 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3322999999999998e-05 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2789 3.31 3:8feca985:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:41.439 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.689789046000001, 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017716994999999999, 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2789 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:41.440 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654339+0000", 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7829999999999999e-06 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655814+0000", 2024-04-26T07:50:41.441 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014750449999999999 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655840+0000", 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5401e-05 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655850+0000", 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0454e-05 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655917+0000", 2024-04-26T07:50:41.442 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7022999999999998e-05 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656068+0000", 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151321 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656189+0000", 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120974 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.660660+0000", 2024-04-26T07:50:41.443 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044709609999999999 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671924+0000", 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011264055 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671999+0000", 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4072000000000005e-05 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.672054+0000", 2024-04-26T07:50:41.444 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5906000000000003e-05 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3266 3.19 3:9b9e875e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_281:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.080338+0000", 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.26378816100000002, 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01839029, 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.445 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3266 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.080338+0000", 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.080338+0000", 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.446 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.080342+0000", 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4460000000000001e-06 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082520+0000", 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021783140000000002 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082554+0000", 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3741000000000001e-05 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.447 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082569+0000", 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5095e-05 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082659+0000", 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9777000000000005e-05 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082842+0000", 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183587 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.448 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.083001+0000", 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015840299999999999 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.089006+0000", 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060051949999999996 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.098567+0000", 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0095612630000000004 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.449 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.098653+0000", 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5554000000000001e-05 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.098729+0000", 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5914999999999994e-05 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3273 3.4 3:212239d2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_288:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:41.450 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.162757+0000", 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.18136965399999999, 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015197756999999999, 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3273 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.162757+0000", 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.162757+0000", 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.162760+0000", 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2830000000000002e-06 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.165350+0000", 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025902870000000001 2024-04-26T07:50:41.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.165378+0000", 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7889999999999999e-05 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.165389+0000", 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0947999999999999e-05 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.165470+0000", 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0634000000000001e-05 2024-04-26T07:50:41.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.165592+0000", 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000122015 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.165695+0000", 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000102802 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.173629+0000", 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0079346339999999994 2024-04-26T07:50:41.454 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.177823+0000", 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0041940340000000001 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.177898+0000", 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5059000000000001e-05 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.177955+0000", 2024-04-26T07:50:41.455 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6171000000000001e-05 2024-04-26T07:50:41.456 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.456 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.456 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.456 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:41.456 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:41.456 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:41.457 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:41.458 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:41.454+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:41.560 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:41.558+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:41.647 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:41.648 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:41.648 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:41.648 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:41.659 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:41.658+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:41.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:41.760 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:41.758+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:41.861 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:41.858+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:41.889 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:41.889 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:41.889 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:41.889 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:41.890 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:41.911 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:41.962 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:41.958+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:42.058 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:50:42.064 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:42.062+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:42.102 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:42.102 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:42.102 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 61.133586395999998, 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.103 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:42.104 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.105 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.106 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:42.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 61.032838683000001, 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:42.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.110 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.111 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.112 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.113 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.114 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.731126172000003, 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.115 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.116 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:42.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:42.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.640367046000001, 2024-04-26T07:50:42.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:42.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2635 3.21 3:859b1c73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.153326763999999, 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017892425, 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2635 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947300+0000", 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.947303+0000", 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.455e-06 2024-04-26T07:50:42.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949508+0000", 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022040969999999999 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949528+0000", 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0647999999999999e-05 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949537+0000", 2024-04-26T07:50:42.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7790000000000001e-06 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949599+0000", 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1570999999999997e-05 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949767+0000", 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016876099999999999 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:42.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.949931+0000", 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016320399999999999 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.953952+0000", 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0040214059999999999 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965068+0000", 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011116041 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965140+0000", 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1746000000000001e-05 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.965192+0000", 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2716999999999997e-05 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.090637541, 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.131 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:42.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.136 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.255445780999999, 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:42.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:42.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2734 3.1e 3:7bc4dd61:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.025815646000002, 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022112987000000001, 2024-04-26T07:50:42.142 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2734 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074814+0000", 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8169999999999999e-06 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076636+0000", 2024-04-26T07:50:42.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018219670000000001 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076668+0000", 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076684+0000", 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5228000000000001e-05 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076777+0000", 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3751000000000004e-05 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076907+0000", 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129899 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.077003+0000", 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5314000000000003e-05 2024-04-26T07:50:42.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.081365+0000", 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043621709999999998 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096804+0000", 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015438825999999999 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096870+0000", 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6407000000000003e-05 2024-04-26T07:50:42.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096924+0000", 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4027999999999998e-05 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2744 3.1e 3:78569fb3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.921928642000001, 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017953593, 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.148 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2744 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178698+0000", 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.178701+0000", 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8899999999999999e-06 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180304+0000", 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016031929999999999 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180330+0000", 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5635000000000001e-05 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180341+0000", 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0869999999999999e-05 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180418+0000", 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7293999999999996e-05 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180593+0000", 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017473900000000001 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.180741+0000", 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014776700000000001 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.185523+0000", 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047823859999999996 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196576+0000", 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011052674 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196618+0000", 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2286000000000001e-05 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.196652+0000", 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3859000000000002e-05 2024-04-26T07:50:42.153 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2774 3.21 3:85ac5c16:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.603592079999999, 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022721992, 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2774 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497037+0000", 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2970000000000002e-06 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498369+0000", 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001332106 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498402+0000", 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2490000000000002e-05 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498416+0000", 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4922999999999999e-05 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498506+0000", 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9040000000000001e-05 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:42.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498514+0000", 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1550000000000007e-06 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500799+0000", 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002284861 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500953+0000", 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015486800000000001 2024-04-26T07:50:42.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.501099+0000", 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014553499999999999 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.505865+0000", 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047655589999999999 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519642+0000", 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013777608 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519710+0000", 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7702999999999999e-05 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519757+0000", 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6847000000000001e-05 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2781 3.2e 3:775249ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.52979418, 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018031374999999999, 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2781 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.161 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570833+0000", 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.570835+0000", 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.667e-06 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572336+0000", 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015002940000000001 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572370+0000", 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4836000000000003e-05 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572385+0000", 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4649e-05 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572477+0000", 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.2167e-05 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572682+0000", 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000205183 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.572864+0000", 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018175299999999999 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.578265+0000", 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054013330000000003 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588708+0000", 2024-04-26T07:50:42.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01044279 2024-04-26T07:50:42.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588790+0000", 2024-04-26T07:50:42.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2039000000000005e-05 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.588864+0000", 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3664000000000005e-05 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2800 3.1c 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.336126595, 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024565350999999999, 2024-04-26T07:50:42.167 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2800 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764503+0000", 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766083+0000", 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015793210000000001 2024-04-26T07:50:42.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766113+0000", 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0292999999999999e-05 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766125+0000", 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1575e-05 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766186+0000", 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1310999999999996e-05 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766357+0000", 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017109199999999999 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766457+0000", 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100144 2024-04-26T07:50:42.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.771500+0000", 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050428799999999996 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.788952+0000", 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017451575 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789010+0000", 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8631000000000002e-05 2024-04-26T07:50:42.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789066+0000", 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5235000000000002e-05 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.173 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2811 3.1e 3:786cbdae:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:42.174 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:42.174 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.223287331000002, 2024-04-26T07:50:42.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019591179, 2024-04-26T07:50:42.174 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.174 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.174 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.174 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2811 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877343+0000", 2024-04-26T07:50:42.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8399999999999997e-06 2024-04-26T07:50:42.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879093+0000", 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001749446 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879156+0000", 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3765999999999999e-05 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879206+0000", 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.956e-05 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879283+0000", 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6602999999999998e-05 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879427+0000", 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144232 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879541+0000", 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364199999999999 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.885376+0000", 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058353909999999997 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896847+0000", 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011471212999999999 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896893+0000", 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5797000000000002e-05 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896931+0000", 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7688999999999998e-05 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2978 3.21 3:84d7aea2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.3303118009999997, 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024469095999999999, 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.182 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2978 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.183 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770317+0000", 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1260000000000001e-06 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774236+0000", 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003919278 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774265+0000", 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8198999999999999e-05 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774277+0000", 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2021000000000001e-05 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774358+0000", 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1125999999999995e-05 2024-04-26T07:50:42.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774536+0000", 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017878699999999999 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774699+0000", 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016269900000000001 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.780749+0000", 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060501970000000002 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794544+0000", 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013794376000000001 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794674+0000", 2024-04-26T07:50:42.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013040999999999999 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794784+0000", 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010987700000000001 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3035 3.13 3:cb4a1b57:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.62505012, 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020272116, 2024-04-26T07:50:42.188 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3035 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.189 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:42.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475580+0000", 2024-04-26T07:50:42.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.472e-06 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477288+0000", 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017077629999999999 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477325+0000", 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7159000000000001e-05 2024-04-26T07:50:42.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477343+0000", 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7864e-05 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477436+0000", 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3573999999999996e-05 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477619+0000", 2024-04-26T07:50:42.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018206 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477782+0000", 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163716 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.483623+0000", 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058409680000000002 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495713+0000", 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012089322 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495789+0000", 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6039999999999997e-05 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495849+0000", 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0177999999999999e-05 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3283 3.2e 3:75378d11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.82465202100000001, 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.026000832000000001, 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3283 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.195 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275978+0000", 2024-04-26T07:50:42.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9900000000000002e-06 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278413+0000", 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002435071 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278435+0000", 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2376999999999999e-05 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278445+0000", 2024-04-26T07:50:42.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6539999999999994e-06 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278553+0000", 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010861000000000001 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278713+0000", 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015921800000000001 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278866+0000", 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015332599999999999 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.286023+0000", 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071569349999999997 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301857+0000", 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015834379999999999 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301925+0000", 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7508999999999993e-05 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301976+0000", 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0762e-05 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3302 3.2e 3:7731d88a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_317:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:42.200 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.62170903099999997, 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021970494, 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3302 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478921+0000", 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2349999999999999e-06 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480764+0000", 2024-04-26T07:50:42.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001843019 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480803+0000", 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8591999999999999e-05 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480822+0000", 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9250999999999999e-05 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480906+0000", 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4450000000000006e-05 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481064+0000", 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015772099999999999 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481217+0000", 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015252899999999999 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.487388+0000", 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061710719999999997 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500776+0000", 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013388436 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500843+0000", 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6528999999999999e-05 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500888+0000", 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.566e-05 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3307 3.2e 3:777059e0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_322:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.56563704000000004, 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018291400999999999, 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.206 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3307 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:42.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534993+0000", 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2219999999999998e-06 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535923+0000", 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093030599999999999 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535949+0000", 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5834e-05 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535959+0000", 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0373e-05 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536027+0000", 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7719999999999995e-05 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536148+0000", 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120658 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536238+0000", 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9808000000000005e-05 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.540751+0000", 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045132879999999998 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553187+0000", 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012436189 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553229+0000", 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2194999999999998e-05 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553281+0000", 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808000000000003e-05 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.211 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3341 3.2e 3:7651510b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.18208365000000001, 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021327268999999999, 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3341 2024-04-26T07:50:42.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918546+0000", 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7879999999999998e-06 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920222+0000", 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016760919999999999 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920249+0000", 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6619999999999999e-05 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920261+0000", 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1959e-05 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920326+0000", 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5759000000000005e-05 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920471+0000", 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014433299999999999 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920579+0000", 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108208 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.924822+0000", 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042434919999999998 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939736+0000", 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014913932 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939811+0000", 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4449999999999994e-05 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939870+0000", 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9636000000000003e-05 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3348 3.1e 3:7b679b6a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_363:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:42.217 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.109441621, 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018635565, 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3348 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991188+0000", 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992865+0000", 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676975 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992892+0000", 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6631999999999998e-05 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992904+0000", 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2629000000000001e-05 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992973+0000", 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8226999999999996e-05 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.993097+0000", 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012449499999999999 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.993214+0000", 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116859 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.998594+0000", 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053799060000000003 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009690+0000", 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011095743 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009765+0000", 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5737999999999999e-05 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009821+0000", 2024-04-26T07:50:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5303999999999998e-05 2024-04-26T07:50:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.223 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.223 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:42.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:42.225 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:42.222+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:42.325 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:42.322+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:42.411 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:42.411 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:42.411 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:42.411 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:42.426 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:42.422+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:42.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:42.527 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:42.526+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:42.578 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:42.578 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:42.578 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:42.578 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:42.578 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:42.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:42.643 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:42.642+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:42.729 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:42.726+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:42.789 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:42.789 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 62.511909031999998, 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.791 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:42.792 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.793 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.794 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.795 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 61.871632339999998, 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.796 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.797 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.798 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.799 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.800 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:42.801 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 60.486812655999998, 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.802 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.803 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.804 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:42.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:42.806 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.951737722000001, 2024-04-26T07:50:42.807 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.808 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.809 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:42.810 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.811 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.812 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 24.735055185, 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.813 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.815 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.816 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:42.817 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.962335504999999, 2024-04-26T07:50:42.818 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.819 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.820 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.821 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:42.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:42.823 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.888682550999999, 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.824 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.827 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:42.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.829 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.859977322999999, 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.830 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.831 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.832 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:42.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:42.834 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.827156757000001, 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.836 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:42.838 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:42.839 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:42.840 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.793362952999999, 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.841 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.842 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:42.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:42.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:42.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.846 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.555611030000001, 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.847 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:42.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:42.850 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.851 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.502204117000002, 2024-04-26T07:50:42.852 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:42.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:42.857 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.091618285999999, 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.858 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.863 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:3279 3.5 e79/17 3:a273d8b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_294:head v 79'16, mlcod=79'14)", 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.236749+0000", 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.548892782, 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020316097000000002, 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.236749+0000", 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.236749+0000", 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.236752+0000", 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6120000000000001e-06 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.241590+0000", 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0048377180000000004 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.241622+0000", 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1859000000000001e-05 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.241637+0000", 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5270000000000001e-05 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.241733+0000", 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6469000000000001e-05 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.241762+0000", 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8456e-05 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.257024+0000", 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015262672999999999 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.257066+0000", 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.104e-05 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3300 3.33 3:cd50c5f5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_315:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.3273776310000001, 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022987548999999999, 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3300 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458268+0000", 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.021e-06 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459957+0000", 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016889120000000001 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459981+0000", 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4406e-05 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459994+0000", 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2680000000000001e-05 2024-04-26T07:50:42.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460079+0000", 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5614999999999999e-05 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460283+0000", 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000204172 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460467+0000", 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183919 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.465999+0000", 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055315850000000003 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481141+0000", 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015142375 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481204+0000", 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3048999999999999e-05 2024-04-26T07:50:42.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481252+0000", 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7815000000000002e-05 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3305 3.27 3:e71354e7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_320:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.513299+0000", 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 1.2723432370000001, 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020000844, 2024-04-26T07:50:42.873 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3305 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.513299+0000", 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.513299+0000", 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.513301+0000", 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.402e-06 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.515013+0000", 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001711583 2024-04-26T07:50:42.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.515040+0000", 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7155999999999999e-05 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.515054+0000", 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4103e-05 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.515142+0000", 2024-04-26T07:50:42.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.7923000000000005e-05 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.515348+0000", 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020612899999999999 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.515531+0000", 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018310200000000001 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.521036+0000", 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055045019999999997 2024-04-26T07:50:42.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.533163+0000", 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012127389000000001 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.533242+0000", 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8916000000000001e-05 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.533300+0000", 2024-04-26T07:50:42.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7639000000000002e-05 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3365 3.33 3:cf6f73fa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_380:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.60545481199999995, 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022536079000000001, 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.879 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3365 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180191+0000", 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0860000000000004e-06 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182593+0000", 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024014539999999999 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182622+0000", 2024-04-26T07:50:42.881 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9111e-05 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182634+0000", 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2149e-05 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182715+0000", 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0945999999999994e-05 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182913+0000", 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019779300000000001 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.183094+0000", 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018092999999999999 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.190830+0000", 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077362419999999999 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202632+0000", 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011801416 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202669+0000", 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7394000000000001e-05 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202723+0000", 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4558000000000002e-05 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3372 3.29 3:97c5a4e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.53305041099999995, 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020672864999999999, 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3372 2024-04-26T07:50:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252596+0000", 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2989999999999998e-06 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253876+0000", 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001279493 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253904+0000", 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8022999999999999e-05 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253915+0000", 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1878e-05 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254002+0000", 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6528999999999998e-05 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254171+0000", 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168486 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254325+0000", 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000154821 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.258909+0000", 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045840589999999997 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273124+0000", 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014214536 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273179+0000", 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4598000000000001e-05 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273265+0000", 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6143000000000005e-05 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3401 3.29 3:94e99a5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:42.890 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.23404598900000001, 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022448046999999999, 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3401 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551599+0000", 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1999999999999999e-06 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553183+0000", 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015834829999999999 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553216+0000", 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2663000000000002e-05 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553232+0000", 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6612999999999998e-05 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553321+0000", 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8941000000000001e-05 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553484+0000", 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162554 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553616+0000", 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013222700000000001 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.558023+0000", 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044068570000000001 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573919+0000", 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015896100999999999 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573991+0000", 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1950000000000001e-05 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.574044+0000", 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3458000000000002e-05 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3406 3.27 3:e585af2f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_421:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 0.18273547500000001, 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020601642999999999, 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:42.896 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3406 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:42.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602909+0000", 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604530+0000", 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016205550000000001 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:42.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604555+0000", 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5392999999999999e-05 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604566+0000", 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0400999999999999e-05 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604634+0000", 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7762999999999995e-05 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:42.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604752+0000", 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118268 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604888+0000", 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000136601 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.609679+0000", 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047901300000000001 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623360+0000", 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013681125000000001 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623442+0000", 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2208999999999998e-05 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623508+0000", 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6515999999999998e-05 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.901 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.902 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.902 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:42.902 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:42.902 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:42.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:42.904 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:42.902+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:43.004 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:43.002+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:43.050 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:43.050 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:43.050 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:43.050 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:43.068 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:43.105 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:43.102+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:43.194 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:43.194 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:43.194 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:43.194 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:43.194 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:43.206 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:43.202+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:43.212 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:43.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:43.307 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:43.306+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:43.347 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 75.127352662000007, 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.348 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:50:43.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:50:43.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:43.354 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 62.299924326000003, 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:50:43.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:50:43.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:50:43.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 61.449342416999997, 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:50:43.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:50:43.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:50:43.366 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 61.312769842999998, 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.367 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.368 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.368 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.368 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:50:43.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.368 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:43.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:43.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:50:43.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:50:43.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:50:43.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:50:43.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:50:43.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:50:43.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:50:43.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:50:43.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:50:43.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:50:43.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:50:43.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:50:43.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:43.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:50:43.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:50:43.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:50:43.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:50:43.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:50:43.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:50:43.378 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.378 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.378 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.379 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:43.379 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:43.379 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.969304755000003, 2024-04-26T07:50:43.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:50:43.379 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.380 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.380 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.380 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.380 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.380 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.380 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:50:43.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.381 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:43.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:43.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:50:43.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:50:43.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:50:43.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:50:43.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:50:43.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:50:43.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:50:43.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:50:43.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:50:43.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:50:43.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:50:43.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:50:43.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:43.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:50:43.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:50:43.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:50:43.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:50:43.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:50:43.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:50:43.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:50:43.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:50:43.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:50:43.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:50:43.392 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.392 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.392 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.393 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2650 3.9 3:910fae93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:43.393 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:43.393 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.222311349999998, 2024-04-26T07:50:43.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026997720999999999, 2024-04-26T07:50:43.393 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.394 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.394 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.394 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.394 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.394 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.395 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2650 2024-04-26T07:50:43.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.395 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:43.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:43.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120449+0000", 2024-04-26T07:50:43.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.213e-06 2024-04-26T07:50:43.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126814+0000", 2024-04-26T07:50:43.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063646370000000002 2024-04-26T07:50:43.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126859+0000", 2024-04-26T07:50:43.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5769999999999997e-05 2024-04-26T07:50:43.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126881+0000", 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1226999999999999e-05 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127062+0000", 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018148799999999999 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127473+0000", 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041101799999999997 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127939+0000", 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046579999999999999 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.142532+0000", 2024-04-26T07:50:43.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014592818 2024-04-26T07:50:43.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147212+0000", 2024-04-26T07:50:43.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046805379999999997 2024-04-26T07:50:43.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147317+0000", 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104706 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147444+0000", 2024-04-26T07:50:43.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126506 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2651 3.34 3:2e652162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.210159098999998, 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026435427000000001, 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.404 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2651 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132621+0000", 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2677e-05 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140045+0000", 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074240269999999997 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140075+0000", 2024-04-26T07:50:43.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0159999999999999e-05 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140090+0000", 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.485e-05 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140253+0000", 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162752 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140492+0000", 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023908800000000001 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140712+0000", 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022059900000000001 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.156194+0000", 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015481818 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158759+0000", 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025644750000000001 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158920+0000", 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016169000000000001 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159033+0000", 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113291 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.409 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2652 3.f e71/17 3:f0cf4464:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_87:head v 71'6, mlcod=59'4)", 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.188125921000001, 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025327902999999999, 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154635+0000", 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4199999999999999e-06 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159003+0000", 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043688370000000004 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159072+0000", 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8546000000000004e-05 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159104+0000", 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2283999999999998e-05 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159252+0000", 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014761200000000001 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159318+0000", 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6248999999999995e-05 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179858+0000", 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020539973 2024-04-26T07:50:43.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179959+0000", 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100982 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2660 3.1b e71/17 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head v 71'5, mlcod=59'3)", 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.113983808, 2024-04-26T07:50:43.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023049618000000001, 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228775+0000", 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.75e-06 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236455+0000", 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076795539999999999 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236485+0000", 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9923000000000001e-05 2024-04-26T07:50:43.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236501+0000", 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6317e-05 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236642+0000", 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014074899999999999 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236688+0000", 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6106000000000002e-05 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251724+0000", 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015035935 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251823+0000", 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9283999999999993e-05 2024-04-26T07:50:43.418 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2717 3.24 e71/17 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head v 71'14, mlcod=71'12)", 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.441860592000001, 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024784816000000001, 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900899+0000", 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907332+0000", 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064328529999999997 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907367+0000", 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4966999999999999e-05 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907397+0000", 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0392999999999999e-05 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907551+0000", 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015379900000000001 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907597+0000", 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639000000000001e-05 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925587+0000", 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017990055000000001 2024-04-26T07:50:43.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925681+0000", 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4696000000000003e-05 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2764 3.34 3:2e573a11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:43.423 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.948326751, 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031072567999999998, 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2764 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394434+0000", 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4240000000000002e-06 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400673+0000", 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062394210000000002 2024-04-26T07:50:43.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400724+0000", 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1175999999999999e-05 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400760+0000", 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5123000000000002e-05 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400955+0000", 2024-04-26T07:50:43.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019514900000000001 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401423+0000", 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046833999999999998 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401840+0000", 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041720800000000002 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.423203+0000", 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021362641000000002 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425243+0000", 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020403420000000001 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425403+0000", 2024-04-26T07:50:43.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015975599999999999 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425503+0000", 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9988000000000006e-05 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2980 3.34 3:2c27af06:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:43.429 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.5287135799999998, 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023940217999999999, 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2980 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814047+0000", 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.49e-06 2024-04-26T07:50:43.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820559+0000", 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065114609999999996 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820595+0000", 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6919999999999999e-05 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820614+0000", 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9017000000000001e-05 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820759+0000", 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014448600000000001 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821025+0000", 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026618799999999999 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821281+0000", 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000255388 2024-04-26T07:50:43.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837756+0000", 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016475019 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837825+0000", 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9529999999999993e-05 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837913+0000", 2024-04-26T07:50:43.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8418000000000006e-05 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837984+0000", 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0301000000000003e-05 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2988 3.f e78/17 3:f2e60fa8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_13:head v 78'11, mlcod=72'9)", 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.4132023220000001, 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025247141000000001, 2024-04-26T07:50:43.435 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929557+0000", 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.812e-06 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932701+0000", 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031440909999999999 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932727+0000", 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6485000000000001e-05 2024-04-26T07:50:43.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932740+0000", 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2899e-05 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932846+0000", 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106261 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932884+0000", 2024-04-26T07:50:43.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7150000000000002e-05 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954658+0000", 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021774803999999998 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954802+0000", 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014363900000000001 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3038 3.14 3:2b0c4970:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8303282940000001, 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02413448, 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3038 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.440 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512431+0000", 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0219999999999999e-06 2024-04-26T07:50:43.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516443+0000", 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040121369999999998 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516479+0000", 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5921999999999999e-05 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516498+0000", 2024-04-26T07:50:43.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9434999999999999e-05 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516594+0000", 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5626999999999998e-05 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516761+0000", 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016746900000000001 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516919+0000", 2024-04-26T07:50:43.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157613 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.532325+0000", 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015405785 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536276+0000", 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039511859999999998 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536433+0000", 2024-04-26T07:50:43.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000156751 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536563+0000", 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013053300000000001 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.445 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3295 3.e e79/17 3:72febd94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_310:head v 79'12, mlcod=71'10)", 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.9252990460000001, 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023400582999999999, 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:43.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:43.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417461+0000", 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.886e-06 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425407+0000", 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079463720000000002 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425450+0000", 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2827000000000002e-05 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425475+0000", 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5276999999999999e-05 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425638+0000", 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016255499999999999 2024-04-26T07:50:43.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425684+0000", 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6226000000000001e-05 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440766+0000", 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015081776999999999 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440859+0000", 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2663000000000004e-05 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3312 3.14 3:28d42ed8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.7544216210000001, 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02506968, 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.451 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3312 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:43.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588339+0000", 2024-04-26T07:50:43.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8139999999999998e-06 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593503+0000", 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051636939999999999 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593552+0000", 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8644999999999999e-05 2024-04-26T07:50:43.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593575+0000", 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3694999999999999e-05 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593721+0000", 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014558099999999999 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594030+0000", 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000309084 2024-04-26T07:50:43.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594362+0000", 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033205799999999998 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.602982+0000", 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086194410000000003 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613081+0000", 2024-04-26T07:50:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010099385000000001 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613235+0000", 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153936 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613405+0000", 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170347 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3362 3.3 3:c21c3c88:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.192218923, 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027051006999999998, 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.459 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3362 2024-04-26T07:50:43.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.459 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:43.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:43.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150542+0000", 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4230000000000001e-06 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155196+0000", 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046542240000000002 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155241+0000", 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5188000000000002e-05 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155264+0000", 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3243000000000001e-05 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155429+0000", 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016474099999999999 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155798+0000", 2024-04-26T07:50:43.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036913799999999997 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156167+0000", 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036868699999999998 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177139+0000", 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020971996999999999 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177402+0000", 2024-04-26T07:50:43.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026307499999999998 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177513+0000", 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110862 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177589+0000", 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6428999999999996e-05 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.464 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3364 3.9 3:93973eda:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_379:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.169772244, 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023680673999999999, 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:43.465 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3364 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:43.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172989+0000", 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7479999999999999e-06 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178348+0000", 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053593870000000002 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178375+0000", 2024-04-26T07:50:43.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6948e-05 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178395+0000", 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9746e-05 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178680+0000", 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028477199999999998 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179097+0000", 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041771700000000001 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179312+0000", 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021453499999999999 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.194902+0000", 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015590530999999999 2024-04-26T07:50:43.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196474+0000", 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015717610000000001 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196592+0000", 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118139 2024-04-26T07:50:43.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196666+0000", 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.339e-05 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3376 3.a e80/17 3:52d883ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_391:head v 80'14, mlcod=79'12)", 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.03541979, 2024-04-26T07:50:43.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022696129999999998, 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307338+0000", 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310209+0000", 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028707699999999999 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310255+0000", 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5872999999999999e-05 2024-04-26T07:50:43.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310283+0000", 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8013000000000001e-05 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310455+0000", 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017232900000000001 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310519+0000", 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633000000000006e-05 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.329934+0000", 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019415536000000001 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330033+0000", 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9393000000000002e-05 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3400 3.e e80/17 3:72fd7c3d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_415:head v 80'16, mlcod=80'14)", 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.79019699499999996, 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022514756, 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552562+0000", 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.176e-06 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555476+0000", 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029136040000000002 2024-04-26T07:50:43.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555511+0000", 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4832999999999997e-05 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555528+0000", 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7580000000000001e-05 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555693+0000", 2024-04-26T07:50:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016455500000000001 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555761+0000", 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7875999999999999e-05 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575001+0000", 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019240295000000001 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575075+0000", 2024-04-26T07:50:43.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3837000000000005e-05 2024-04-26T07:50:43.480 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.480 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.480 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.480 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:43.480 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:43.480 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:43.481 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:43.482 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:43.483 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:43.483 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:43.478+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:43.485 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:43.485 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:43.505 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:43.533 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:43.533 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:43.557 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:43.558 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:43.582 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:43.577+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:43.582 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:43.583 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:43.602 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:43.602 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:43.675 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:43.675 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:43.683 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:43.677+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:43.691 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:43.701 INFO:tasks.workunit.client.0.smithi053.stdout:quota disabled for the bucket: buck_2024_03_26_07_50_33 2024-04-26T07:50:43.702 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 2Gb. 2024-04-26T07:50:43.702 INFO:tasks.workunit.client.0.smithi053.stdout:upload file successful 2024-04-26T07:50:43.702 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:50:43.702 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-04-26T07:50:43.702 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:50:43.783 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:43.781+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:43.816 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:43.816 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:43.832 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:43.884 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:43.882+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:43.961 INFO:tasks.workunit.client.0.smithi053.stdout:user qa_user deleted 2024-04-26T07:50:43.961 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:50:43.963 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:43.963 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:43.977 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:43.985 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:43.981+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:44.086 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:44.082+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:44.097 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:50:44.139 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:44.139 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:44.153 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:44.198 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:44.194+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:44.288 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:44.286+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:44.320 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:44.320 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:44.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:44.419 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:44.418+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:44.490 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:44.485+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:44.500 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:44.500 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:44.514 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:44.591 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:44.585+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:44.685 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:44.685 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:44.692 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:44.690+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:44.698 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:44.793 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:44.789+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:44.866 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:44.867 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:44.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:44.927 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:44.926+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:44.994 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:44.990+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:44.998 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:44.998 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:45.013 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:45.073 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:50:45.095 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:45.094+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:45.157 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:45.157 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:45.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:45.197 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:45.194+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:45.295 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:45.295 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:45.298 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:45.293+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:45.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:45.398 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:45.394+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:45.473 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:45.473 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:45.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:45.499 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:45.498+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:45.600 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:45.597+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:45.602 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:45.602 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:45.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:45.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:45.701 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:45.698+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:45.789 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:45.789 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:45.799 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:45.799 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:45.802 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:45.798+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:45.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:45.815 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:45.815 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:45.831 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:45.850 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:45.850 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:45.869 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:45.870 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:45.890 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:45.891 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:45.902 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:45.898+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:45.911 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:45.911 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:45.919 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:45.919 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:45.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:45.919 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:45.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2106 3.19 3:9a290e5c:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 65.598667449000004, 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021355335999999999, 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2106 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.920 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317667+0000", 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.317670+0000", 2024-04-26T07:50:45.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.58e-06 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322049+0000", 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043789659999999998 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322093+0000", 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3939000000000001e-05 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322113+0000", 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9553000000000001e-05 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322285+0000", 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017178199999999999 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322510+0000", 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000224971 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.322718+0000", 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00020873500000000001 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338050+0000", 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015331588 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338862+0000", 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00081161600000000003 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.338946+0000", 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4834999999999997e-05 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.339022+0000", 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5771000000000003e-05 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2116 3.3e 3:7fc7284a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:45.925 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 65.434008704999997, 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017208775999999999, 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2116 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482326+0000", 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.482329+0000", 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485529+0000", 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003199426 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485565+0000", 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6405999999999997e-05 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485583+0000", 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7955999999999999e-05 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.928 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.485739+0000", 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015656399999999999 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486093+0000", 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000353474 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.486448+0000", 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00035482599999999998 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.495503+0000", 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0090553409999999997 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499391+0000", 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038883379999999999 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499467+0000", 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5275e-05 2024-04-26T07:50:45.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.499534+0000", 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7657000000000006e-05 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2117 3.4 3:200cc10e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 65.412134664000007, 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015403393, 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.931 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2117 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504200+0000", 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.504204+0000", 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9589999999999997e-06 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508095+0000", 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0038917890000000001 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508148+0000", 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2299000000000002e-05 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508167+0000", 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9533000000000001e-05 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508309+0000", 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014177999999999999 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508539+0000", 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000230084 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.508753+0000", 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021357400000000001 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.518709+0000", 2024-04-26T07:50:45.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0099561170000000004 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519515+0000", 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00080584099999999996 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519561+0000", 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6740999999999999e-05 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.519603+0000", 2024-04-26T07:50:45.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1675999999999999e-05 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2151 3.1a e58/17 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head v 58'1, mlcod=0'0)", 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 64.869335677999999, 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018003994999999998, 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.046999+0000", 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.047001+0000", 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6730000000000001e-06 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054313+0000", 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0073116800000000001 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054357+0000", 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4422999999999998e-05 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054381+0000", 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3642000000000002e-05 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054508+0000", 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012736400000000001 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.054545+0000", 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6625999999999998e-05 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.064912+0000", 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.010367049 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.065003+0000", 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0538000000000006e-05 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2161 3.0 3:000f4527:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 64.622492285999996, 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020706322999999999, 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.941 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2161 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293842+0000", 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.293846+0000", 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7859999999999998e-06 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296529+0000", 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002683305 2024-04-26T07:50:45.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296587+0000", 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7590999999999998e-05 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296610+0000", 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3207e-05 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.296762+0000", 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015233099999999999 2024-04-26T07:50:45.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297034+0000", 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027183699999999998 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.297334+0000", 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029977900000000002 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.313281+0000", 2024-04-26T07:50:45.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015947603000000001 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314437+0000", 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001155987 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314497+0000", 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9274999999999997e-05 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.314548+0000", 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1622000000000001e-05 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2202 3.19 3:98901d8d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 64.059647635000005, 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.028535484, 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.947 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2202 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856687+0000", 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.856690+0000", 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9960000000000002e-06 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859214+0000", 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025245810000000001 2024-04-26T07:50:45.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859258+0000", 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.4036000000000003e-05 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859276+0000", 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7408999999999999e-05 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859365+0000", 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9591000000000003e-05 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.859378+0000", 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2296999999999999e-05 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865550+0000", 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061719720000000004 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865700+0000", 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150178 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.865805+0000", 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000105214 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.872056+0000", 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006251398 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885086+0000", 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013029838 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885167+0000", 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0914000000000005e-05 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.885222+0000", 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059999999999998e-05 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2613 3.31 3:8eaf08fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.199801207, 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016123849999999999, 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.954 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2613 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716533+0000", 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.716535+0000", 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.849e-06 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717876+0000", 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001341084 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717910+0000", 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3575000000000003e-05 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.717925+0000", 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5750999999999999e-05 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718012+0000", 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6472999999999997e-05 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718191+0000", 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017946999999999999 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.718360+0000", 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000169154 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.722797+0000", 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044362610000000004 2024-04-26T07:50:45.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732580+0000", 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097836820000000001 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732624+0000", 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3213000000000001e-05 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.732657+0000", 2024-04-26T07:50:45.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3337999999999998e-05 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2618 3.31 3:8daa9f80:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.146523040999998, 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021000648, 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.960 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2618 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769811+0000", 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.769814+0000", 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771227+0000", 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001413428 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771261+0000", 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3244000000000002e-05 2024-04-26T07:50:45.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771276+0000", 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5695000000000001e-05 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771351+0000", 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4919000000000006e-05 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771510+0000", 2024-04-26T07:50:45.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015855900000000001 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.771615+0000", 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010500799999999999 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.776024+0000", 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044095430000000001 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790685+0000", 2024-04-26T07:50:45.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014660678999999999 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790755+0000", 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0364000000000006e-05 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.790812+0000", 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.6527000000000003e-05 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2622 3.31 3:8e8c5c0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.101415980999999, 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019283708, 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2622 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814918+0000", 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.814921+0000", 2024-04-26T07:50:45.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7379999999999999e-06 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.815980+0000", 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0010592729999999999 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816013+0000", 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2224999999999997e-05 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816027+0000", 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4688000000000001e-05 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816104+0000", 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6922000000000007e-05 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816273+0000", 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016859399999999999 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.816446+0000", 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173554 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.821737+0000", 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052907800000000001 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834069+0000", 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012331701 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834141+0000", 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2568e-05 2024-04-26T07:50:45.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.834202+0000", 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0665000000000003e-05 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2707 3.31 3:8c445c82:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.125516445999999, 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020245384000000002, 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.971 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2707 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790818+0000", 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.790821+0000", 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4489999999999999e-06 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792513+0000", 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00169125 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792538+0000", 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5252000000000001e-05 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792552+0000", 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3726999999999999e-05 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792641+0000", 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9653000000000004e-05 2024-04-26T07:50:45.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792813+0000", 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017224499999999999 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.792980+0000", 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167023 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.798223+0000", 2024-04-26T07:50:45.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052425789999999998 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.810923+0000", 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012700438 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811000+0000", 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6526000000000006e-05 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.811063+0000", 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3242000000000002e-05 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2738 3.31 3:8c882a39:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.799756909999999, 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017775144, 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.977 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2738 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116577+0000", 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.116581+0000", 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9700000000000001e-06 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118803+0000", 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022217349999999999 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118829+0000", 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5596999999999999e-05 2024-04-26T07:50:45.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118841+0000", 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2081e-05 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.118923+0000", 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2106000000000003e-05 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119094+0000", 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017146300000000001 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.119258+0000", 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016377899999999999 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.126373+0000", 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071146250000000003 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134224+0000", 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0078514399999999995 2024-04-26T07:50:45.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134297+0000", 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2970000000000001e-05 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.134353+0000", 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5377999999999997e-05 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.982 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2745 3.31 3:8c638261:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.728059297000001, 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018680489000000002, 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2745 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188275+0000", 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.188277+0000", 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8640000000000001e-06 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189907+0000", 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016299159999999999 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189933+0000", 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5853000000000001e-05 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.189943+0000", 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9820000000000003e-06 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190027+0000", 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4330000000000001e-05 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190196+0000", 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016852800000000001 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.190345+0000", 2024-04-26T07:50:45.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014998400000000001 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.195338+0000", 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0049923720000000001 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206878+0000", 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011540323999999999 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206921+0000", 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3034999999999997e-05 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.206956+0000", 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4301000000000002e-05 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2789 3.31 3:8feca985:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:45.988 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.261996890999999, 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017716994999999999, 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2789 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:45.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654337+0000", 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.654339+0000", 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7829999999999999e-06 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655814+0000", 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0014750449999999999 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655840+0000", 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5401e-05 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655850+0000", 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0454e-05 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.655917+0000", 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7022999999999998e-05 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656068+0000", 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151321 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.656189+0000", 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120974 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.660660+0000", 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044709609999999999 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671924+0000", 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011264055 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.671999+0000", 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4072000000000005e-05 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.672054+0000", 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5906000000000003e-05 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3266 3.19 3:9b9e875e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_281:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.080338+0000", 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.8359960060000002, 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01839029, 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:45.994 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3266 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.080338+0000", 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.080338+0000", 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.080342+0000", 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4460000000000001e-06 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082520+0000", 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021783140000000002 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082554+0000", 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3741000000000001e-05 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082569+0000", 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5095e-05 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082659+0000", 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9777000000000005e-05 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.082842+0000", 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183587 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.083001+0000", 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015840299999999999 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.089006+0000", 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060051949999999996 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.098567+0000", 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0095612630000000004 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.098653+0000", 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5554000000000001e-05 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.098729+0000", 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5914999999999994e-05 2024-04-26T07:50:45.999 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3346 3.31 3:8f651508:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_361:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.970586+0000", 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.9457480770000002, 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017574673999999998, 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.000 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3346 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.970586+0000", 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.970586+0000", 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.970588+0000", 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.801e-06 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.972178+0000", 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015901330000000001 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.972205+0000", 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6485000000000001e-05 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.972215+0000", 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0448999999999999e-05 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.972285+0000", 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9923000000000001e-05 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.972397+0000", 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000111463 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.972506+0000", 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000109962 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.976735+0000", 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042282279999999997 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.988022+0000", 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01128732 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.988103+0000", 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0487000000000004e-05 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.988161+0000", 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8423e-05 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3410 3.31 3:8df187e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_425:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.644282+0000", 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.272052167, 2024-04-26T07:50:46.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022963190000000001, 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3410 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.644282+0000", 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.644282+0000", 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.644286+0000", 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3550000000000001e-06 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.649797+0000", 2024-04-26T07:50:46.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055117129999999997 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.649827+0000", 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0093000000000001e-05 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.649842+0000", 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4905e-05 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.649919+0000", 2024-04-26T07:50:46.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6693999999999994e-05 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.650032+0000", 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000113156 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.650127+0000", 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4958999999999997e-05 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.654598+0000", 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044714200000000003 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.667151+0000", 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012552282 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.667190+0000", 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9619999999999997e-05 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.667245+0000", 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4993e-05 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3451 3.25 3:a68970aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_466:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.129891+0000", 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 2.7864430279999999, 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020048554, 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.011 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3451 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.129891+0000", 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.129891+0000", 2024-04-26T07:50:46.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.129896+0000", 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5120000000000002e-06 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.134133+0000", 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042374750000000001 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.134172+0000", 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8992999999999997e-05 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.134190+0000", 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7473999999999999e-05 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.134349+0000", 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015925100000000001 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.134746+0000", 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00039699199999999998 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.135186+0000", 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000439744 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.148876+0000", 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013690447999999999 2024-04-26T07:50:46.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.149784+0000", 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00090791199999999998 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.149876+0000", 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.1518e-05 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.149940+0000", 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.4234999999999997e-05 2024-04-26T07:50:46.016 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3453 3.25 3:a6bd98e9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_468:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.165453+0000", 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 2.7508817099999998, 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017114773, 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.017 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3453 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.165453+0000", 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.165453+0000", 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.165456+0000", 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6430000000000001e-06 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.168676+0000", 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0032200089999999998 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.168717+0000", 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1056000000000001e-05 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.168735+0000", 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.8133000000000001e-05 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.168885+0000", 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014972499999999999 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.169154+0000", 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000268523 2024-04-26T07:50:46.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.169391+0000", 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00023724099999999999 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.176820+0000", 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0074290459999999999 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.182475+0000", 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.005654549 2024-04-26T07:50:46.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.182528+0000", 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3562e-05 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.182567+0000", 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.9286000000000003e-05 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.022 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3455 3.25 3:a40d5325:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_470:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.209274+0000", 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 2.707060362, 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015257405, 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3455 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.209274+0000", 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.209274+0000", 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.209278+0000", 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1930000000000003e-06 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.212641+0000", 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0033628059999999999 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.212694+0000", 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3053000000000002e-05 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.212721+0000", 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6645999999999999e-05 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.212877+0000", 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015609 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.213221+0000", 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000344543 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.213521+0000", 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029968099999999999 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.223312+0000", 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0097914260000000006 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.224377+0000", 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001064569 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.224463+0000", 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6215e-05 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.224531+0000", 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8182999999999994e-05 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3467 3.31 3:8c2574b7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.438765+0000", 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 2.4775694769999999, 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01853573, 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.028 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3467 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.438765+0000", 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.438765+0000", 2024-04-26T07:50:46.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.438768+0000", 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3450000000000002e-06 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.440503+0000", 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001734785 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.440538+0000", 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5225999999999998e-05 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.440551+0000", 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2415000000000001e-05 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.440648+0000", 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6889e-05 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.440858+0000", 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021017900000000001 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.441047+0000", 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018883499999999999 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.447999+0000", 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0069526409999999999 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.457158+0000", 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0091591859999999997 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.457237+0000", 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.8350999999999996e-05 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.457301+0000", 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3878000000000001e-05 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.033 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.034 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.034 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:46.035 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:46.036 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:46.037 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:46.034+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:46.135 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:46.133+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:46.208 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:46.208 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:46.208 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:46.208 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:46.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:46.263 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:46.261+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:46.338 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:46.333+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:46.390 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:46.391 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:46.391 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:46.391 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:46.391 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:46.404 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:46.447 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:46.445+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:46.540 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:46.538+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 65.604258259000005, 2024-04-26T07:50:46.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:46.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 65.503510546000001, 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.582 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:46.583 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.584 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 65.201798034999996, 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:46.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 65.111038909000001, 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.594 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:46.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:46.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:46.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:46.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:46.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:46.598 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.598 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.561309403999999, 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.599 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.600 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.600 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:46.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.600 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:46.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:46.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:46.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:46.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:46.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:46.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:46.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.726117643999999, 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.607 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:46.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:46.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2734 3.1e 3:7bc4dd61:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.496487509000001, 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022112987000000001, 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.613 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2734 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074814+0000", 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8169999999999999e-06 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076636+0000", 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018219670000000001 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076668+0000", 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076684+0000", 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5228000000000001e-05 2024-04-26T07:50:46.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076777+0000", 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3751000000000004e-05 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076907+0000", 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129899 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.077003+0000", 2024-04-26T07:50:46.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5314000000000003e-05 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.081365+0000", 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043621709999999998 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096804+0000", 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015438825999999999 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096870+0000", 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6407000000000003e-05 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096924+0000", 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4027999999999998e-05 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2774 3.21 3:85ac5c16:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:46.619 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.074263942999998, 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022721992, 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2774 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:46.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497037+0000", 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2970000000000002e-06 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498369+0000", 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001332106 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498402+0000", 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2490000000000002e-05 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498416+0000", 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4922999999999999e-05 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498506+0000", 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9040000000000001e-05 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498514+0000", 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1550000000000007e-06 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500799+0000", 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002284861 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500953+0000", 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015486800000000001 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.501099+0000", 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014553499999999999 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.505865+0000", 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047655589999999999 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519642+0000", 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013777608 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519710+0000", 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7702999999999999e-05 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519757+0000", 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6847000000000001e-05 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2800 3.1c 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.806798457999999, 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024565350999999999, 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2800 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.626 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764503+0000", 2024-04-26T07:50:46.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766083+0000", 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015793210000000001 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766113+0000", 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0292999999999999e-05 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766125+0000", 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1575e-05 2024-04-26T07:50:46.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766186+0000", 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1310999999999996e-05 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766357+0000", 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017109199999999999 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766457+0000", 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100144 2024-04-26T07:50:46.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.771500+0000", 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050428799999999996 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.788952+0000", 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017451575 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789010+0000", 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8631000000000002e-05 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789066+0000", 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5235000000000002e-05 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2811 3.1e 3:786cbdae:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 26.693959194000001, 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019591179, 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2811 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.632 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877343+0000", 2024-04-26T07:50:46.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8399999999999997e-06 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879093+0000", 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001749446 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879156+0000", 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3765999999999999e-05 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879206+0000", 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.956e-05 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879283+0000", 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6602999999999998e-05 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879427+0000", 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144232 2024-04-26T07:50:46.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879541+0000", 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364199999999999 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.885376+0000", 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058353909999999997 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896847+0000", 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011471212999999999 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896893+0000", 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5797000000000002e-05 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896931+0000", 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7688999999999998e-05 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.637 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2978 3.21 3:84d7aea2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.8009836640000003, 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024469095999999999, 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.638 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2978 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770317+0000", 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1260000000000001e-06 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774236+0000", 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003919278 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774265+0000", 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8198999999999999e-05 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.640 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774277+0000", 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2021000000000001e-05 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774358+0000", 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1125999999999995e-05 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774536+0000", 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017878699999999999 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774699+0000", 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016269900000000001 2024-04-26T07:50:46.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.780749+0000", 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060501970000000002 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794544+0000", 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013794376000000001 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794674+0000", 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013040999999999999 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794784+0000", 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010987700000000001 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3035 3.13 3:cb4a1b57:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.0957219830000007, 2024-04-26T07:50:46.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020272116, 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3035 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475580+0000", 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.472e-06 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477288+0000", 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017077629999999999 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477325+0000", 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7159000000000001e-05 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477343+0000", 2024-04-26T07:50:46.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7864e-05 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477436+0000", 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3573999999999996e-05 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477619+0000", 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018206 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477782+0000", 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163716 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.483623+0000", 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058409680000000002 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495713+0000", 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012089322 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495789+0000", 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6039999999999997e-05 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495849+0000", 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0177999999999999e-05 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.649 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3283 3.2e 3:75378d11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.2953238840000001, 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.026000832000000001, 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3283 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275978+0000", 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9900000000000002e-06 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278413+0000", 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002435071 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278435+0000", 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2376999999999999e-05 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278445+0000", 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6539999999999994e-06 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278553+0000", 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010861000000000001 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278713+0000", 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015921800000000001 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278866+0000", 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015332599999999999 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.286023+0000", 2024-04-26T07:50:46.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071569349999999997 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301857+0000", 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015834379999999999 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301925+0000", 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7508999999999993e-05 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301976+0000", 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0762e-05 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3302 3.2e 3:7731d88a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_317:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.0923808939999997, 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021970494, 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.655 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3302 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478921+0000", 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2349999999999999e-06 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480764+0000", 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001843019 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480803+0000", 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8591999999999999e-05 2024-04-26T07:50:46.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480822+0000", 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9250999999999999e-05 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480906+0000", 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4450000000000006e-05 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481064+0000", 2024-04-26T07:50:46.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015772099999999999 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481217+0000", 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015252899999999999 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.487388+0000", 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061710719999999997 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500776+0000", 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013388436 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500843+0000", 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6528999999999999e-05 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500888+0000", 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.566e-05 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3307 3.2e 3:777059e0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_322:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.0363089030000001, 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018291400999999999, 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3307 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.661 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534993+0000", 2024-04-26T07:50:46.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2219999999999998e-06 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535923+0000", 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093030599999999999 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535949+0000", 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5834e-05 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535959+0000", 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0373e-05 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536027+0000", 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7719999999999995e-05 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536148+0000", 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120658 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.664 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536238+0000", 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9808000000000005e-05 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.540751+0000", 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045132879999999998 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553187+0000", 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012436189 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553229+0000", 2024-04-26T07:50:46.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2194999999999998e-05 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553281+0000", 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808000000000003e-05 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3341 3.2e 3:7651510b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.6527555129999998, 2024-04-26T07:50:46.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021327268999999999, 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3341 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918546+0000", 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7879999999999998e-06 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920222+0000", 2024-04-26T07:50:46.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016760919999999999 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920249+0000", 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6619999999999999e-05 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920261+0000", 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1959e-05 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920326+0000", 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5759000000000005e-05 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920471+0000", 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014433299999999999 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920579+0000", 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108208 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.670 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.924822+0000", 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042434919999999998 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939736+0000", 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014913932 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939811+0000", 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4449999999999994e-05 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939870+0000", 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9636000000000003e-05 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3348 3.1e 3:7b679b6a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_363:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.580113484, 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018635565, 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.672 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3348 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:46.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991188+0000", 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992865+0000", 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676975 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992892+0000", 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6631999999999998e-05 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992904+0000", 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2629000000000001e-05 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992973+0000", 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8226999999999996e-05 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.993097+0000", 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012449499999999999 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.993214+0000", 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116859 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.676 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.998594+0000", 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053799060000000003 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009690+0000", 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011095743 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009765+0000", 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5737999999999999e-05 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009821+0000", 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5303999999999998e-05 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3377 3.13 3:cbfc4825:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_392:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.264421005, 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023830246999999999, 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.678 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3377 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306881+0000", 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8720000000000004e-06 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309014+0000", 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021321640000000002 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309039+0000", 2024-04-26T07:50:46.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5678999999999999e-05 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309050+0000", 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0832000000000001e-05 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309126+0000", 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6139999999999999e-05 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309284+0000", 2024-04-26T07:50:46.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015728699999999999 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309390+0000", 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106582 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.313696+0000", 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043055289999999998 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.682 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330590+0000", 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016893944000000001 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330656+0000", 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6802000000000002e-05 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330708+0000", 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1415999999999997e-05 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.683 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3413 3.13 3:ca771f50:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_428:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.8921763330000001, 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018182953000000002, 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.684 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3413 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679125+0000", 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7769999999999998e-06 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681086+0000", 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019610090000000001 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681125+0000", 2024-04-26T07:50:46.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8838000000000003e-05 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681141+0000", 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6277e-05 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681225+0000", 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3967000000000004e-05 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681400+0000", 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174389 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681519+0000", 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011937700000000001 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.688365+0000", 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006846235 2024-04-26T07:50:46.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697205+0000", 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0088395739999999993 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697251+0000", 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6119999999999999e-05 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.689 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697305+0000", 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4389999999999999e-05 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3460 3.2e 3:766ebcb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.2487139310000002, 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023101186999999999, 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:46.690 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3460 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.691 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322588+0000", 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6229999999999999e-06 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326866+0000", 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004277866 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.692 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326925+0000", 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8841000000000001e-05 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326946+0000", 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1333999999999999e-05 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327101+0000", 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015422 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.693 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327381+0000", 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027996299999999999 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327724+0000", 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034364500000000001 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.340457+0000", 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012733234 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.694 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345555+0000", 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050971870000000004 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345632+0000", 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7206000000000006e-05 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345686+0000", 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4067999999999998e-05 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.696 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:46.696 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:46.696 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:46.697 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:46.698 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:46.693+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:46.798 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:46.798+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:46.875 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:46.875 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:46.875 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:46.875 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:46.889 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:46.935 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:46.933+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:47.000 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:46.997+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:47.014 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:47.015 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:47.015 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:47.015 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:47.015 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:47.030 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:47.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:50:47.119 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:47.117+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:47.202 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:47.197+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:47.207 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:47.207 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:47.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:47.207 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:47.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.207 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:47.207 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.929801865000002, 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:47.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:47.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:47.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:47.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.212 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 66.289525173000001, 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.213 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:47.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:47.218 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 64.904705488999994, 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.219 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:47.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:47.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.369630555000001, 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:47.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:47.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 29.152948018, 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:47.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:47.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:47.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:47.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.380228337999998, 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.236 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:47.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:47.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:47.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:47.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.306575383999999, 2024-04-26T07:50:47.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:47.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.277870155999999, 2024-04-26T07:50:47.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.245049590000001, 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.253 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:47.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:47.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:47.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:47.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 28.211255785999999, 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:47.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:47.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:47.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.973503863000001, 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.264 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.265 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.267 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.269 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.920096950000001, 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.270 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:47.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:47.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:47.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:47.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 27.509511118999999, 2024-04-26T07:50:47.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:47.283 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3300 3.33 3:cd50c5f5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_315:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.7452704639999999, 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022987548999999999, 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3300 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458268+0000", 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.021e-06 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459957+0000", 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016889120000000001 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459981+0000", 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4406e-05 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459994+0000", 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2680000000000001e-05 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460079+0000", 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5614999999999999e-05 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460283+0000", 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000204172 2024-04-26T07:50:47.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460467+0000", 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183919 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.465999+0000", 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055315850000000003 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481141+0000", 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015142375 2024-04-26T07:50:47.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481204+0000", 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3048999999999999e-05 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481252+0000", 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7815000000000002e-05 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3365 3.33 3:cf6f73fa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_380:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 5.0233476450000003, 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022536079000000001, 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3365 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180191+0000", 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0860000000000004e-06 2024-04-26T07:50:47.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182593+0000", 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024014539999999999 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182622+0000", 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9111e-05 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182634+0000", 2024-04-26T07:50:47.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2149e-05 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182715+0000", 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0945999999999994e-05 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182913+0000", 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019779300000000001 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.183094+0000", 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018092999999999999 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.190830+0000", 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077362419999999999 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202632+0000", 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011801416 2024-04-26T07:50:47.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202669+0000", 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7394000000000001e-05 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202723+0000", 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4558000000000002e-05 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.295 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3372 3.29 3:97c5a4e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.9509432440000003, 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020672864999999999, 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3372 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252596+0000", 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2989999999999998e-06 2024-04-26T07:50:47.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253876+0000", 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001279493 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253904+0000", 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8022999999999999e-05 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253915+0000", 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1878e-05 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254002+0000", 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6528999999999998e-05 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254171+0000", 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168486 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254325+0000", 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000154821 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.258909+0000", 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045840589999999997 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273124+0000", 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014214536 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273179+0000", 2024-04-26T07:50:47.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4598000000000001e-05 2024-04-26T07:50:47.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273265+0000", 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6143000000000005e-05 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3401 3.29 3:94e99a5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.651938822, 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022448046999999999, 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3401 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551599+0000", 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1999999999999999e-06 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553183+0000", 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015834829999999999 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553216+0000", 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2663000000000002e-05 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553232+0000", 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6612999999999998e-05 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553321+0000", 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8941000000000001e-05 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553484+0000", 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162554 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553616+0000", 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013222700000000001 2024-04-26T07:50:47.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.558023+0000", 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044068570000000001 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573919+0000", 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015896100999999999 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573991+0000", 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1950000000000001e-05 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.574044+0000", 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3458000000000002e-05 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.308 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3406 3.27 3:e585af2f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_421:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.6006283080000001, 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020601642999999999, 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3406 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.309 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602909+0000", 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604530+0000", 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016205550000000001 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604555+0000", 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5392999999999999e-05 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604566+0000", 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0400999999999999e-05 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604634+0000", 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7762999999999995e-05 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604752+0000", 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118268 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604888+0000", 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000136601 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.609679+0000", 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047901300000000001 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623360+0000", 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013681125000000001 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623442+0000", 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2208999999999998e-05 2024-04-26T07:50:47.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623508+0000", 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6515999999999998e-05 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3424 3.2 3:422e52f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_439:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 4.4079874319999997, 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021648288000000002, 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.314 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3424 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795550+0000", 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.199e-06 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797322+0000", 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017720329999999999 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797353+0000", 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1390000000000003e-05 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797366+0000", 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3027000000000001e-05 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797436+0000", 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9306000000000004e-05 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797578+0000", 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014246699999999999 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797702+0000", 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124354 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.802182+0000", 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004479841 2024-04-26T07:50:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817086+0000", 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014903506 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817141+0000", 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5207999999999997e-05 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817196+0000", 2024-04-26T07:50:47.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4957000000000003e-05 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3457 3.29 3:975e30a2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_472:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.94773212, 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021210401, 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.320 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3457 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255808+0000", 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1769999999999997e-06 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258946+0000", 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00313766 2024-04-26T07:50:47.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258989+0000", 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3452999999999999e-05 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259009+0000", 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9516000000000001e-05 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259161+0000", 2024-04-26T07:50:47.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151824 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259410+0000", 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024946099999999998 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259694+0000", 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028413400000000001 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:47.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.267979+0000", 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082847070000000005 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276888+0000", 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089093169999999999 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276946+0000", 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7438999999999997e-05 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:47.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:47.326 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.277013+0000", 2024-04-26T07:50:47.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7712999999999994e-05 2024-04-26T07:50:47.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.326 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:47.326 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:47.326 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:47.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:47.328 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:47.325+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:47.428 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:47.426+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:47.461 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:47.461 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:47.461 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:47.461 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:47.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:47.483 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:50:47.529 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:47.525+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:47.630 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:47.625+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:47.643 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:47.643 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:47.643 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:47.643 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:47.643 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:47.657 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:47.731 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:47.729+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 79.568728782999997, 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:50:47.784 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:50:47.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:50:47.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:50:47.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:50:47.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 66.741300447, 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:50:47.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:50:47.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.796 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 65.890718538000002, 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 65.754145964000003, 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.802 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:50:47.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:50:47.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 65.410680876000001, 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.809 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:50:47.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:50:47.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2650 3.9 3:910fae93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.663687470999999, 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026997720999999999, 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.815 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2650 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120449+0000", 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.213e-06 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126814+0000", 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063646370000000002 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126859+0000", 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5769999999999997e-05 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126881+0000", 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1226999999999999e-05 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127062+0000", 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018148799999999999 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127473+0000", 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041101799999999997 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127939+0000", 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046579999999999999 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.142532+0000", 2024-04-26T07:50:47.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014592818 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147212+0000", 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046805379999999997 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147317+0000", 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104706 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147444+0000", 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126506 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2651 3.34 3:2e652162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.65153522, 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026435427000000001, 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.821 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2651 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132621+0000", 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2677e-05 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140045+0000", 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074240269999999997 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140075+0000", 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0159999999999999e-05 2024-04-26T07:50:47.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140090+0000", 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.485e-05 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140253+0000", 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162752 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140492+0000", 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023908800000000001 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140712+0000", 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022059900000000001 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.156194+0000", 2024-04-26T07:50:47.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015481818 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158759+0000", 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025644750000000001 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158920+0000", 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016169000000000001 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159033+0000", 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113291 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2652 3.f e71/17 3:f0cf4464:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_87:head v 71'6, mlcod=59'4)", 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.629502041999999, 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025327902999999999, 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.827 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154635+0000", 2024-04-26T07:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4199999999999999e-06 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159003+0000", 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043688370000000004 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159072+0000", 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8546000000000004e-05 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159104+0000", 2024-04-26T07:50:47.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2283999999999998e-05 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159252+0000", 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014761200000000001 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159318+0000", 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6248999999999995e-05 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179858+0000", 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020539973 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179959+0000", 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100982 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2660 3.1b e71/17 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head v 71'5, mlcod=59'3)", 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.555359929000002, 2024-04-26T07:50:47.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023049618000000001, 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228775+0000", 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.75e-06 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236455+0000", 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076795539999999999 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236485+0000", 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9923000000000001e-05 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236501+0000", 2024-04-26T07:50:47.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6317e-05 2024-04-26T07:50:47.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236642+0000", 2024-04-26T07:50:47.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014074899999999999 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236688+0000", 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6106000000000002e-05 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251724+0000", 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015035935 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251823+0000", 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9283999999999993e-05 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2717 3.24 e71/17 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head v 71'14, mlcod=71'12)", 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.883236712999999, 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024784816000000001, 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900899+0000", 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907332+0000", 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064328529999999997 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907367+0000", 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4966999999999999e-05 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907397+0000", 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0392999999999999e-05 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907551+0000", 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015379900000000001 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907597+0000", 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639000000000001e-05 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925587+0000", 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017990055000000001 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925681+0000", 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4696000000000003e-05 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2764 3.34 3:2e573a11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:47.840 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.389702872000001, 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031072567999999998, 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2764 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394434+0000", 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4240000000000002e-06 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400673+0000", 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062394210000000002 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400724+0000", 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1175999999999999e-05 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400760+0000", 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5123000000000002e-05 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400955+0000", 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019514900000000001 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401423+0000", 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046833999999999998 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401840+0000", 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041720800000000002 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.423203+0000", 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021362641000000002 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425243+0000", 2024-04-26T07:50:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020403420000000001 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425403+0000", 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015975599999999999 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425503+0000", 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9988000000000006e-05 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2980 3.34 3:2c27af06:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.9700897009999991, 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023940217999999999, 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2980 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814047+0000", 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.49e-06 2024-04-26T07:50:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820559+0000", 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065114609999999996 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820595+0000", 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6919999999999999e-05 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820614+0000", 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9017000000000001e-05 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820759+0000", 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014448600000000001 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821025+0000", 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026618799999999999 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821281+0000", 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000255388 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837756+0000", 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016475019 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837825+0000", 2024-04-26T07:50:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9529999999999993e-05 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837913+0000", 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8418000000000006e-05 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837984+0000", 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0301000000000003e-05 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2988 3.f e78/17 3:f2e60fa8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_13:head v 78'11, mlcod=72'9)", 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.8545784429999994, 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025247141000000001, 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929557+0000", 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.812e-06 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932701+0000", 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031440909999999999 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932727+0000", 2024-04-26T07:50:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6485000000000001e-05 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932740+0000", 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2899e-05 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932846+0000", 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106261 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932884+0000", 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7150000000000002e-05 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954658+0000", 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021774803999999998 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954802+0000", 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014363900000000001 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3038 3.14 3:2b0c4970:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.2717044150000003, 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02413448, 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3038 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512431+0000", 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0219999999999999e-06 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516443+0000", 2024-04-26T07:50:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040121369999999998 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516479+0000", 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5921999999999999e-05 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516498+0000", 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9434999999999999e-05 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516594+0000", 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5626999999999998e-05 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516761+0000", 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016746900000000001 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516919+0000", 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157613 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.532325+0000", 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015405785 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536276+0000", 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039511859999999998 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536433+0000", 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000156751 2024-04-26T07:50:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536563+0000", 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013053300000000001 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3295 3.e e79/17 3:72febd94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_310:head v 79'12, mlcod=71'10)", 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.3666751670000004, 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023400582999999999, 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417461+0000", 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.886e-06 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425407+0000", 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079463720000000002 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425450+0000", 2024-04-26T07:50:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2827000000000002e-05 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425475+0000", 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5276999999999999e-05 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425638+0000", 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016255499999999999 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425684+0000", 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6226000000000001e-05 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440766+0000", 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015081776999999999 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440859+0000", 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2663000000000004e-05 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3312 3.14 3:28d42ed8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.1957977419999999, 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02506968, 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3312 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588339+0000", 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8139999999999998e-06 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593503+0000", 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051636939999999999 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593552+0000", 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8644999999999999e-05 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593575+0000", 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3694999999999999e-05 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593721+0000", 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014558099999999999 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594030+0000", 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000309084 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594362+0000", 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033205799999999998 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.602982+0000", 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086194410000000003 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613081+0000", 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010099385000000001 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613235+0000", 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153936 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613405+0000", 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170347 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3362 3.3 3:c21c3c88:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.6335950439999998, 2024-04-26T07:50:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027051006999999998, 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3362 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150542+0000", 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4230000000000001e-06 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155196+0000", 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046542240000000002 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155241+0000", 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5188000000000002e-05 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155264+0000", 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3243000000000001e-05 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155429+0000", 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016474099999999999 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155798+0000", 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036913799999999997 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156167+0000", 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036868699999999998 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177139+0000", 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020971996999999999 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177402+0000", 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026307499999999998 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177513+0000", 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110862 2024-04-26T07:50:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177589+0000", 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6428999999999996e-05 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3364 3.9 3:93973eda:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_379:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.611148365, 2024-04-26T07:50:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023680673999999999, 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3364 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172989+0000", 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7479999999999999e-06 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178348+0000", 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053593870000000002 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178375+0000", 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6948e-05 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178395+0000", 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9746e-05 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178680+0000", 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028477199999999998 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179097+0000", 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041771700000000001 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179312+0000", 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021453499999999999 2024-04-26T07:50:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.194902+0000", 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015590530999999999 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196474+0000", 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015717610000000001 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196592+0000", 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118139 2024-04-26T07:50:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196666+0000", 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.339e-05 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3376 3.a e80/17 3:52d883ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_391:head v 80'14, mlcod=79'12)", 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.476795911, 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022696129999999998, 2024-04-26T07:50:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307338+0000", 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310209+0000", 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028707699999999999 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310255+0000", 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5872999999999999e-05 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310283+0000", 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8013000000000001e-05 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310455+0000", 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017232900000000001 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310519+0000", 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633000000000006e-05 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.329934+0000", 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019415536000000001 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330033+0000", 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9393000000000002e-05 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3400 3.e e80/17 3:72fd7c3d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_415:head v 80'16, mlcod=80'14)", 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.2315731159999999, 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022514756, 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552562+0000", 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.176e-06 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555476+0000", 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029136040000000002 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555511+0000", 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4832999999999997e-05 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555528+0000", 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7580000000000001e-05 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555693+0000", 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016455500000000001 2024-04-26T07:50:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555761+0000", 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7875999999999999e-05 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575001+0000", 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019240295000000001 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575075+0000", 2024-04-26T07:50:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3837000000000005e-05 2024-04-26T07:50:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:47.895 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:47.900 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:47.900 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:47.898+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:48.000 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:47.998+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:48.037 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:48.075 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:48.075 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:48.075 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:48.075 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:48.090 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:48.100 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:48.097+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:48.200 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:48.201 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:48.201 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:48.197+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:48.217 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:48.235 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:48.235 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:48.252 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:48.261 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:48.261 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:48.261 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:48.261 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:48.262 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:48.273 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:48.273 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:48.277 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:48.291 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:48.291 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:48.312 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:48.312 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:48.323 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:48.322+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:48.331 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:48.331 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:48.400 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:48.400 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:48.403 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:48.401+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:48.414 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:48.504 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:48.501+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:48.577 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:48.578 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:48.592 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:48.635 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:48.634+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:48.706 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:48.702+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:48.708 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:48.708 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:48.722 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:48.811 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:48.810+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:48.888 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:48.888 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:48.902 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:48.908 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:48.905+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:49.009 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:49.006+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:49.069 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:49.070 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:49.085 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:49.127 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:49.126+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:49.211 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:49.209+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:49.243 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:49.244 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:49.258 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:49.312 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:49.310+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:49.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:49.439 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:49.437+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:49.514 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:49.509+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:49.516 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:50:49.533 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:49.533 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:49.548 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:49.639 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:49.637+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:49.716 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:49.718+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:49.718 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:49.718 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:49.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:49.819 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:49.817+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:49.896 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:50:49.910 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:49.910 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:49.918 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:49.913+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:49.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:50.020 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:50.017+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:50.095 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:50.095 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:50.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:50.121 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:50.118+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:50.222 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:50.218+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:50.279 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:50.279 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:50.294 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:50.343 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:50.341+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:50.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:50.424 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:50.422+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:50.425 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:50.425 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:50.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:50.496 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:50.496 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:50.512 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:50.512 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:50.524 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:50.522+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:50.544 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:50.581 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:50.581 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:50.581 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:50.581 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:50.594 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:50.597 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:50.617 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:50.617 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:50.625 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:50.622+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:50.637 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:50.658 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:50.658 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:50.722 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:50.722 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:50.723 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:50.726 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:50.721+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:50.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:50.827 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:50.826+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:50.909 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:50.909 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:50.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:50.909 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:50.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.909 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:50.910 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:50.910 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 69.936784634999995, 2024-04-26T07:50:50.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:50.910 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.910 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.910 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.910 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.910 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:50.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:50.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:50.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:50.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:50.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:50.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:50.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:50.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:50.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:50.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:50.918 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.918 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 69.836036922000005, 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.919 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:50.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:50.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:50.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:50.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:50.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:50.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:50.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:50.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:50.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 69.534324411, 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:50.928 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:50.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:50.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:50.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 69.443565285000005, 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.934 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:50.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.936 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:50.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:50.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.936 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:50.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.893835780000003, 2024-04-26T07:50:50.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.058644020000003, 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.945 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:50.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:50.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:50.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2734 3.1e 3:7bc4dd61:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.829013884999998, 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022112987000000001, 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2734 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074814+0000", 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8169999999999999e-06 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076636+0000", 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018219670000000001 2024-04-26T07:50:50.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076668+0000", 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076684+0000", 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5228000000000001e-05 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076777+0000", 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3751000000000004e-05 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076907+0000", 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129899 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:50.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.077003+0000", 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5314000000000003e-05 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.081365+0000", 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043621709999999998 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096804+0000", 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015438825999999999 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096870+0000", 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6407000000000003e-05 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096924+0000", 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4027999999999998e-05 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2774 3.21 3:85ac5c16:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:50.957 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.406790318999999, 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022721992, 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2774 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497037+0000", 2024-04-26T07:50:50.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2970000000000002e-06 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498369+0000", 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001332106 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498402+0000", 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2490000000000002e-05 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498416+0000", 2024-04-26T07:50:50.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4922999999999999e-05 2024-04-26T07:50:50.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498506+0000", 2024-04-26T07:50:50.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9040000000000001e-05 2024-04-26T07:50:50.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498514+0000", 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1550000000000007e-06 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500799+0000", 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002284861 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500953+0000", 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015486800000000001 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.501099+0000", 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014553499999999999 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.505865+0000", 2024-04-26T07:50:50.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047655589999999999 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519642+0000", 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013777608 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519710+0000", 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7702999999999999e-05 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519757+0000", 2024-04-26T07:50:50.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6847000000000001e-05 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2800 3.1c 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.139324834, 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024565350999999999, 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.965 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2800 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764503+0000", 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766083+0000", 2024-04-26T07:50:50.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015793210000000001 2024-04-26T07:50:50.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766113+0000", 2024-04-26T07:50:50.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0292999999999999e-05 2024-04-26T07:50:50.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766125+0000", 2024-04-26T07:50:50.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1575e-05 2024-04-26T07:50:50.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766186+0000", 2024-04-26T07:50:50.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1310999999999996e-05 2024-04-26T07:50:50.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766357+0000", 2024-04-26T07:50:50.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017109199999999999 2024-04-26T07:50:50.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:50.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766457+0000", 2024-04-26T07:50:50.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100144 2024-04-26T07:50:50.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.771500+0000", 2024-04-26T07:50:50.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050428799999999996 2024-04-26T07:50:50.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.788952+0000", 2024-04-26T07:50:50.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017451575 2024-04-26T07:50:50.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789010+0000", 2024-04-26T07:50:50.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8631000000000002e-05 2024-04-26T07:50:50.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789066+0000", 2024-04-26T07:50:50.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5235000000000002e-05 2024-04-26T07:50:50.979 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.979 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.979 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.980 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2811 3.1e 3:786cbdae:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:50.980 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:50.980 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.026485569999998, 2024-04-26T07:50:50.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019591179, 2024-04-26T07:50:50.980 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.980 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.981 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.981 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.981 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.981 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.981 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2811 2024-04-26T07:50:50.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.981 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:50.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:50.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877343+0000", 2024-04-26T07:50:50.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8399999999999997e-06 2024-04-26T07:50:50.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879093+0000", 2024-04-26T07:50:50.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001749446 2024-04-26T07:50:50.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879156+0000", 2024-04-26T07:50:50.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3765999999999999e-05 2024-04-26T07:50:50.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.986 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.986 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879206+0000", 2024-04-26T07:50:50.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.956e-05 2024-04-26T07:50:50.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879283+0000", 2024-04-26T07:50:50.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6602999999999998e-05 2024-04-26T07:50:50.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879427+0000", 2024-04-26T07:50:50.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144232 2024-04-26T07:50:50.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:50.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879541+0000", 2024-04-26T07:50:50.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364199999999999 2024-04-26T07:50:50.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:50.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.885376+0000", 2024-04-26T07:50:50.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058353909999999997 2024-04-26T07:50:50.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:50.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896847+0000", 2024-04-26T07:50:50.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011471212999999999 2024-04-26T07:50:50.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:50.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896893+0000", 2024-04-26T07:50:50.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5797000000000002e-05 2024-04-26T07:50:50.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:50.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896931+0000", 2024-04-26T07:50:50.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7688999999999998e-05 2024-04-26T07:50:50.992 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.993 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:50.993 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:50.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.993 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2978 3.21 3:84d7aea2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:50.994 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:50.994 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.133510040000001, 2024-04-26T07:50:50.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024469095999999999, 2024-04-26T07:50:50.994 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:50.994 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:50.994 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:50.994 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:50.994 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2978 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770317+0000", 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1260000000000001e-06 2024-04-26T07:50:50.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:50.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774236+0000", 2024-04-26T07:50:50.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003919278 2024-04-26T07:50:50.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774265+0000", 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8198999999999999e-05 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774277+0000", 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2021000000000001e-05 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:50.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774358+0000", 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1125999999999995e-05 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774536+0000", 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017878699999999999 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774699+0000", 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016269900000000001 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:50.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.780749+0000", 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060501970000000002 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794544+0000", 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013794376000000001 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794674+0000", 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013040999999999999 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794784+0000", 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010987700000000001 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3035 3.13 3:cb4a1b57:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.428248358999999, 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020272116, 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.001 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3035 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475580+0000", 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.472e-06 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477288+0000", 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017077629999999999 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477325+0000", 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7159000000000001e-05 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477343+0000", 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7864e-05 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477436+0000", 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3573999999999996e-05 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477619+0000", 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018206 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477782+0000", 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163716 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.483623+0000", 2024-04-26T07:50:51.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058409680000000002 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495713+0000", 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012089322 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495789+0000", 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6039999999999997e-05 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495849+0000", 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0177999999999999e-05 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3283 3.2e 3:75378d11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.6278502600000007, 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.026000832000000001, 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.007 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3283 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275978+0000", 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9900000000000002e-06 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278413+0000", 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002435071 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278435+0000", 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2376999999999999e-05 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278445+0000", 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6539999999999994e-06 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278553+0000", 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010861000000000001 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278713+0000", 2024-04-26T07:50:51.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015921800000000001 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278866+0000", 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015332599999999999 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.286023+0000", 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071569349999999997 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301857+0000", 2024-04-26T07:50:51.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015834379999999999 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301925+0000", 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7508999999999993e-05 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301976+0000", 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0762e-05 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.012 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.013 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.013 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3302 3.2e 3:7731d88a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_317:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:51.013 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:51.013 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.4249072700000003, 2024-04-26T07:50:51.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021970494, 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3302 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478921+0000", 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2349999999999999e-06 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480764+0000", 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001843019 2024-04-26T07:50:51.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480803+0000", 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8591999999999999e-05 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480822+0000", 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9250999999999999e-05 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480906+0000", 2024-04-26T07:50:51.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4450000000000006e-05 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481064+0000", 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015772099999999999 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481217+0000", 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015252899999999999 2024-04-26T07:50:51.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.487388+0000", 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061710719999999997 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500776+0000", 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013388436 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500843+0000", 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6528999999999999e-05 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500888+0000", 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.566e-05 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3307 3.2e 3:777059e0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_322:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:51.019 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3688352790000007, 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018291400999999999, 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3307 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.020 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534993+0000", 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2219999999999998e-06 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.021 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535923+0000", 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093030599999999999 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535949+0000", 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5834e-05 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535959+0000", 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0373e-05 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536027+0000", 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7719999999999995e-05 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536148+0000", 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120658 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536238+0000", 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9808000000000005e-05 2024-04-26T07:50:51.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.540751+0000", 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045132879999999998 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553187+0000", 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012436189 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553229+0000", 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2194999999999998e-05 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553281+0000", 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808000000000003e-05 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3341 3.2e 3:7651510b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.9852818889999995, 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021327268999999999, 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.025 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3341 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918546+0000", 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7879999999999998e-06 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920222+0000", 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016760919999999999 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920249+0000", 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6619999999999999e-05 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920261+0000", 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1959e-05 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920326+0000", 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5759000000000005e-05 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920471+0000", 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014433299999999999 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920579+0000", 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108208 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.924822+0000", 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042434919999999998 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939736+0000", 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014913932 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939811+0000", 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4449999999999994e-05 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939870+0000", 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9636000000000003e-05 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.030 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3348 3.1e 3:7b679b6a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_363:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.9126398600000005, 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018635565, 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3348 2024-04-26T07:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991188+0000", 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992865+0000", 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676975 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992892+0000", 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6631999999999998e-05 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992904+0000", 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2629000000000001e-05 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992973+0000", 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8226999999999996e-05 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.993097+0000", 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012449499999999999 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.993214+0000", 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116859 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.034 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.998594+0000", 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053799060000000003 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009690+0000", 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011095743 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009765+0000", 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5737999999999999e-05 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009821+0000", 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5303999999999998e-05 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3377 3.13 3:cbfc4825:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_392:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.5969473809999997, 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023830246999999999, 2024-04-26T07:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3377 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306881+0000", 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8720000000000004e-06 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309014+0000", 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021321640000000002 2024-04-26T07:50:51.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309039+0000", 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5678999999999999e-05 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309050+0000", 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0832000000000001e-05 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309126+0000", 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6139999999999999e-05 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309284+0000", 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015728699999999999 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309390+0000", 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106582 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.313696+0000", 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043055289999999998 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330590+0000", 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016893944000000001 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330656+0000", 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6802000000000002e-05 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330708+0000", 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1415999999999997e-05 2024-04-26T07:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3413 3.13 3:ca771f50:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_428:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.2247027090000007, 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018182953000000002, 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.042 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3413 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679125+0000", 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7769999999999998e-06 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681086+0000", 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019610090000000001 2024-04-26T07:50:51.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681125+0000", 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8838000000000003e-05 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681141+0000", 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6277e-05 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681225+0000", 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3967000000000004e-05 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681400+0000", 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174389 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681519+0000", 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011937700000000001 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.688365+0000", 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006846235 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697205+0000", 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0088395739999999993 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697251+0000", 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6119999999999999e-05 2024-04-26T07:50:51.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697305+0000", 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4389999999999999e-05 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3460 3.2e 3:766ebcb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 7.5812403069999998, 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023101186999999999, 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3460 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322588+0000", 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6229999999999999e-06 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326866+0000", 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004277866 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326925+0000", 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8841000000000001e-05 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326946+0000", 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1333999999999999e-05 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327101+0000", 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015422 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327381+0000", 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027996299999999999 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327724+0000", 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034364500000000001 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.340457+0000", 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012733234 2024-04-26T07:50:51.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345555+0000", 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050971870000000004 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345632+0000", 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7206000000000006e-05 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345686+0000", 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4067999999999998e-05 2024-04-26T07:50:51.053 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.054 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.054 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.054 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.054 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.054 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:51.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:51.056 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:51.053+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:51.157 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:51.158+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:51.232 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:51.233 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:51.233 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:51.233 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:51.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:51.295 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:51.293+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:51.358 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:51.354+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:51.378 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:51.378 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:51.379 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:51.379 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:51.379 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:51.393 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:51.483 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:51.481+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:51.559 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:51.558+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 71.287791855999998, 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:51.566 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:51.567 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:51.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:51.569 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.570 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.571 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 70.647515163999998, 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.573 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.574 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:51.574 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.574 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.574 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:51.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.576 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.577 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.578 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 69.262695480000005, 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.580 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.581 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.585 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:51.585 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.586 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.587 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.727620545999997, 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.588 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:51.589 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.590 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.591 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.592 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.593 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 33.510938009, 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.594 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.595 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:51.596 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.597 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.598 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.599 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.738218328999999, 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:51.602 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:51.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:51.604 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.664565375000002, 2024-04-26T07:50:51.605 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.607 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.608 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:51.609 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.610 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.635860147000002, 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.611 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.612 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.613 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.614 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:51.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.603039580999997, 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:51.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:51.619 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.620 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.621 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.622 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.569245776999999, 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.623 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:51.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.627 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.628 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.331493854000001, 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:51.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.631 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.632 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.633 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:51.634 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 32.278086940999998, 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.636 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.637 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.638 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.639 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 31.867501109999999, 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.640 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:51.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:51.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:51.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.645 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3300 3.33 3:cd50c5f5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_315:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 10.103260454999999, 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022987548999999999, 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3300 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458268+0000", 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.021e-06 2024-04-26T07:50:51.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459957+0000", 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016889120000000001 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459981+0000", 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4406e-05 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459994+0000", 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2680000000000001e-05 2024-04-26T07:50:51.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460079+0000", 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5614999999999999e-05 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460283+0000", 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000204172 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460467+0000", 2024-04-26T07:50:51.649 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183919 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.465999+0000", 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055315850000000003 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481141+0000", 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015142375 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.650 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481204+0000", 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3048999999999999e-05 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481252+0000", 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7815000000000002e-05 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3365 3.33 3:cf6f73fa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_380:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:51.651 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3813376359999996, 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022536079000000001, 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3365 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.652 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180191+0000", 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0860000000000004e-06 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.653 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182593+0000", 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024014539999999999 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182622+0000", 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9111e-05 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182634+0000", 2024-04-26T07:50:51.654 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2149e-05 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182715+0000", 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0945999999999994e-05 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182913+0000", 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019779300000000001 2024-04-26T07:50:51.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.183094+0000", 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018092999999999999 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.190830+0000", 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077362419999999999 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202632+0000", 2024-04-26T07:50:51.656 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011801416 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202669+0000", 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7394000000000001e-05 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202723+0000", 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4558000000000002e-05 2024-04-26T07:50:51.657 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3372 3.29 3:97c5a4e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.3089332349999996, 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020672864999999999, 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.658 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3372 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.659 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252596+0000", 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2989999999999998e-06 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253876+0000", 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001279493 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.660 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253904+0000", 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8022999999999999e-05 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253915+0000", 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1878e-05 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254002+0000", 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6528999999999998e-05 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.661 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254171+0000", 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168486 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254325+0000", 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000154821 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.258909+0000", 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045840589999999997 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273124+0000", 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014214536 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273179+0000", 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4598000000000001e-05 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273265+0000", 2024-04-26T07:50:51.663 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6143000000000005e-05 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3401 3.29 3:94e99a5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 9.0099288130000001, 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022448046999999999, 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.664 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3401 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551599+0000", 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1999999999999999e-06 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553183+0000", 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015834829999999999 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553216+0000", 2024-04-26T07:50:51.666 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2663000000000002e-05 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553232+0000", 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6612999999999998e-05 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553321+0000", 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8941000000000001e-05 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.667 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553484+0000", 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162554 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553616+0000", 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013222700000000001 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.558023+0000", 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044068570000000001 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.668 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573919+0000", 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015896100999999999 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573991+0000", 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1950000000000001e-05 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.574044+0000", 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3458000000000002e-05 2024-04-26T07:50:51.669 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3406 3.27 3:e585af2f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_421:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.9586182989999994, 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020601642999999999, 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.670 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3406 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602909+0000", 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604530+0000", 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016205550000000001 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604555+0000", 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5392999999999999e-05 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604566+0000", 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0400999999999999e-05 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604634+0000", 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7762999999999995e-05 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604752+0000", 2024-04-26T07:50:51.673 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118268 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604888+0000", 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000136601 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.609679+0000", 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047901300000000001 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.674 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623360+0000", 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013681125000000001 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623442+0000", 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2208999999999998e-05 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623508+0000", 2024-04-26T07:50:51.675 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6515999999999998e-05 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3424 3.2 3:422e52f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_439:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.7659774230000007, 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021648288000000002, 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.676 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3424 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.677 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795550+0000", 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.199e-06 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797322+0000", 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017720329999999999 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797353+0000", 2024-04-26T07:50:51.678 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1390000000000003e-05 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797366+0000", 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3027000000000001e-05 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797436+0000", 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9306000000000004e-05 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.679 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797578+0000", 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014246699999999999 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797702+0000", 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124354 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.802182+0000", 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004479841 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817086+0000", 2024-04-26T07:50:51.680 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014903506 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817141+0000", 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5207999999999997e-05 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817196+0000", 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4957000000000003e-05 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.681 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3457 3.29 3:975e30a2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_472:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 8.3057221109999997, 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021210401, 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3457 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.682 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255808+0000", 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1769999999999997e-06 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.683 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258946+0000", 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00313766 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258989+0000", 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3452999999999999e-05 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259009+0000", 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9516000000000001e-05 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.684 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259161+0000", 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151824 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259410+0000", 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024946099999999998 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259694+0000", 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028413400000000001 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.685 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.267979+0000", 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082847070000000005 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276888+0000", 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089093169999999999 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276946+0000", 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7438999999999997e-05 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:51.686 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:51.687 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.277013+0000", 2024-04-26T07:50:51.687 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7712999999999994e-05 2024-04-26T07:50:51.687 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.687 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.687 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.687 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:51.687 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:51.687 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:51.688 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:51.689 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:51.686+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:51.790 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:51.785+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:51.820 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:51.820 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:51.820 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:51.820 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:51.834 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:51.891 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:51.889+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:51.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:50:51.955 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:51.955 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:51.955 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:51.955 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:51.955 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:51.969 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:51.995 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:51.989+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 83.879610348, 2024-04-26T07:50:52.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:50:52.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:50:52.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:50:52.102 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 71.052182012000003, 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.103 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:52.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:50:52.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.201600103000004, 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:50:52.108 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:52.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:50:52.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.065027529000005, 2024-04-26T07:50:52.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:50:52.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:50:52.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.721562441000003, 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:50:52.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2650 3.9 3:910fae93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.974569035999998, 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026997720999999999, 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.124 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2650 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120449+0000", 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.213e-06 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126814+0000", 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063646370000000002 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126859+0000", 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5769999999999997e-05 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126881+0000", 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1226999999999999e-05 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127062+0000", 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018148799999999999 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127473+0000", 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041101799999999997 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127939+0000", 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046579999999999999 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.142532+0000", 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014592818 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147212+0000", 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046805379999999997 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147317+0000", 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104706 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147444+0000", 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126506 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2651 3.34 3:2e652162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:52.129 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.962416785000002, 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026435427000000001, 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2651 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132621+0000", 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2677e-05 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140045+0000", 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074240269999999997 2024-04-26T07:50:52.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140075+0000", 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0159999999999999e-05 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140090+0000", 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.485e-05 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140253+0000", 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162752 2024-04-26T07:50:52.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140492+0000", 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023908800000000001 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140712+0000", 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022059900000000001 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.156194+0000", 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015481818 2024-04-26T07:50:52.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158759+0000", 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025644750000000001 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158920+0000", 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016169000000000001 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159033+0000", 2024-04-26T07:50:52.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113291 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2652 3.f e71/17 3:f0cf4464:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_87:head v 71'6, mlcod=59'4)", 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.940383607000001, 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025327902999999999, 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154635+0000", 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4199999999999999e-06 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159003+0000", 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043688370000000004 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159072+0000", 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8546000000000004e-05 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159104+0000", 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2283999999999998e-05 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159252+0000", 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014761200000000001 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159318+0000", 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6248999999999995e-05 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179858+0000", 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020539973 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179959+0000", 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100982 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2660 3.1b e71/17 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head v 71'5, mlcod=59'3)", 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.866241494000001, 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023049618000000001, 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228775+0000", 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.75e-06 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236455+0000", 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076795539999999999 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236485+0000", 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9923000000000001e-05 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236501+0000", 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6317e-05 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236642+0000", 2024-04-26T07:50:52.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014074899999999999 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236688+0000", 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6106000000000002e-05 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251724+0000", 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015035935 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251823+0000", 2024-04-26T07:50:52.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9283999999999993e-05 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2717 3.24 e71/17 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head v 71'14, mlcod=71'12)", 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.194118277999998, 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024784816000000001, 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900899+0000", 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907332+0000", 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064328529999999997 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907367+0000", 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4966999999999999e-05 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907397+0000", 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0392999999999999e-05 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907551+0000", 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015379900000000001 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907597+0000", 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639000000000001e-05 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925587+0000", 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017990055000000001 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925681+0000", 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4696000000000003e-05 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2764 3.34 3:2e573a11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 32.700584437000003, 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031072567999999998, 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.147 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2764 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394434+0000", 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4240000000000002e-06 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400673+0000", 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062394210000000002 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400724+0000", 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1175999999999999e-05 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400760+0000", 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5123000000000002e-05 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400955+0000", 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019514900000000001 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401423+0000", 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046833999999999998 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401840+0000", 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041720800000000002 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.423203+0000", 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021362641000000002 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425243+0000", 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020403420000000001 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425403+0000", 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015975599999999999 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425503+0000", 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9988000000000006e-05 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.152 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2980 3.34 3:2c27af06:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.280971266, 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023940217999999999, 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2980 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814047+0000", 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.49e-06 2024-04-26T07:50:52.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820559+0000", 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065114609999999996 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820595+0000", 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6919999999999999e-05 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820614+0000", 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9017000000000001e-05 2024-04-26T07:50:52.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820759+0000", 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014448600000000001 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821025+0000", 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026618799999999999 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821281+0000", 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000255388 2024-04-26T07:50:52.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837756+0000", 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016475019 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837825+0000", 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9529999999999993e-05 2024-04-26T07:50:52.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837913+0000", 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8418000000000006e-05 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837984+0000", 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0301000000000003e-05 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2988 3.f e78/17 3:f2e60fa8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_13:head v 78'11, mlcod=72'9)", 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.165460008, 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025247141000000001, 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929557+0000", 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.812e-06 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932701+0000", 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031440909999999999 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932727+0000", 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6485000000000001e-05 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932740+0000", 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2899e-05 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932846+0000", 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106261 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932884+0000", 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7150000000000002e-05 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954658+0000", 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021774803999999998 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954802+0000", 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014363900000000001 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3038 3.14 3:2b0c4970:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.582585979999999, 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02413448, 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.163 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3038 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:52.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512431+0000", 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0219999999999999e-06 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516443+0000", 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040121369999999998 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516479+0000", 2024-04-26T07:50:52.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5921999999999999e-05 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516498+0000", 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9434999999999999e-05 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516594+0000", 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5626999999999998e-05 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516761+0000", 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016746900000000001 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516919+0000", 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157613 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.532325+0000", 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015405785 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536276+0000", 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039511859999999998 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536433+0000", 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000156751 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536563+0000", 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013053300000000001 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.168 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3295 3.e e79/17 3:72febd94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_310:head v 79'12, mlcod=71'10)", 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.677556731999999, 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023400582999999999, 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:52.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417461+0000", 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.886e-06 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425407+0000", 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079463720000000002 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425450+0000", 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2827000000000002e-05 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425475+0000", 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5276999999999999e-05 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425638+0000", 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016255499999999999 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425684+0000", 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6226000000000001e-05 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440766+0000", 2024-04-26T07:50:52.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015081776999999999 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440859+0000", 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2663000000000004e-05 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3312 3.14 3:28d42ed8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.506679307000001, 2024-04-26T07:50:52.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02506968, 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3312 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588339+0000", 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8139999999999998e-06 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593503+0000", 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051636939999999999 2024-04-26T07:50:52.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593552+0000", 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8644999999999999e-05 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593575+0000", 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3694999999999999e-05 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593721+0000", 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014558099999999999 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594030+0000", 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000309084 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594362+0000", 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033205799999999998 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.602982+0000", 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086194410000000003 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613081+0000", 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010099385000000001 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613235+0000", 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153936 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613405+0000", 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170347 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3362 3.3 3:c21c3c88:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.9444766090000005, 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027051006999999998, 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3362 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150542+0000", 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4230000000000001e-06 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155196+0000", 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046542240000000002 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155241+0000", 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5188000000000002e-05 2024-04-26T07:50:52.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155264+0000", 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3243000000000001e-05 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155429+0000", 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016474099999999999 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155798+0000", 2024-04-26T07:50:52.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036913799999999997 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156167+0000", 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036868699999999998 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177139+0000", 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020971996999999999 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177402+0000", 2024-04-26T07:50:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026307499999999998 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177513+0000", 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110862 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177589+0000", 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6428999999999996e-05 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3364 3.9 3:93973eda:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_379:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.9220299300000008, 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023680673999999999, 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3364 2024-04-26T07:50:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172989+0000", 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7479999999999999e-06 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178348+0000", 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053593870000000002 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178375+0000", 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6948e-05 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178395+0000", 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9746e-05 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178680+0000", 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028477199999999998 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179097+0000", 2024-04-26T07:50:52.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041771700000000001 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179312+0000", 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021453499999999999 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.194902+0000", 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015590530999999999 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196474+0000", 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015717610000000001 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196592+0000", 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118139 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196666+0000", 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.339e-05 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3376 3.a e80/17 3:52d883ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_391:head v 80'14, mlcod=79'12)", 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.7876774760000007, 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022696129999999998, 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307338+0000", 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310209+0000", 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028707699999999999 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310255+0000", 2024-04-26T07:50:52.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5872999999999999e-05 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310283+0000", 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8013000000000001e-05 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310455+0000", 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017232900000000001 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310519+0000", 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633000000000006e-05 2024-04-26T07:50:52.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.329934+0000", 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019415536000000001 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330033+0000", 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9393000000000002e-05 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.194 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3400 3.e e80/17 3:72fd7c3d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_415:head v 80'16, mlcod=80'14)", 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.5424546810000006, 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022514756, 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552562+0000", 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.176e-06 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555476+0000", 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029136040000000002 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555511+0000", 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4832999999999997e-05 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555528+0000", 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7580000000000001e-05 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555693+0000", 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016455500000000001 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555761+0000", 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7875999999999999e-05 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575001+0000", 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019240295000000001 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575075+0000", 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3837000000000005e-05 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.199 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.200 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.200 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.200 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.200 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:52.200 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:52.094+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:52.201 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:52.203 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:52.197+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:52.278 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T07:50:52.278 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T07:50:52.278 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T07:50:52.278 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.000000 2024-04-26T07:50:52.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0 2024-04-26T07:50:52.303 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:52.302+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:52.369 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:52.369 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:52.369 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:52.369 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:52.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:52.427 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:52.426+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:52.506 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:52.501+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:52.549 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:52.550 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:52.550 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:52.550 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:52.550 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:52.565 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:52.607 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:52.601+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:52.676 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:52.693 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:52.693 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:52.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:52.693 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:52.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.693 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2204 3.5 3:a294f995:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:52.693 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.809695079999997, 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.03032317, 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2204 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.694 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881994+0000", 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6330000000000002e-06 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888238+0000", 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062439069999999999 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888280+0000", 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2231999999999998e-05 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888305+0000", 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5060000000000001e-05 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888469+0000", 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016422499999999999 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888479+0000", 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.008e-05 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.894701+0000", 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062219969999999999 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895063+0000", 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036214800000000002 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895429+0000", 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036549400000000001 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.909795+0000", 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014366191 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912173+0000", 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023778330000000002 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912250+0000", 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6736000000000005e-05 2024-04-26T07:50:52.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912313+0000", 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633999999999994e-05 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2206 3.16 3:6a8f0fb0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.785786247999994, 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028443779999999998, 2024-04-26T07:50:52.700 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2206 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905902+0000", 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9059999999999998e-06 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910333+0000", 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044310299999999999 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910358+0000", 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4683000000000001e-05 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910373+0000", 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5003e-05 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910466+0000", 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3051000000000001e-05 2024-04-26T07:50:52.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910844+0000", 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037795800000000002 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.911110+0000", 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000266681 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.924934+0000", 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013823287 2024-04-26T07:50:52.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.933975+0000", 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090409510000000002 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934161+0000", 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186276 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934343+0000", 2024-04-26T07:50:52.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018195400000000001 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2643 3.d e71/17 3:b2fabe62:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_78:head v 71'6, mlcod=59'4)", 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 34.642695644, 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025933037999999999, 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.706 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048993+0000", 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.05e-06 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054473+0000", 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054799530000000001 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054509+0000", 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6720000000000001e-05 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054527+0000", 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7643e-05 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054673+0000", 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014575300000000001 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054731+0000", 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8294999999999997e-05 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074792+0000", 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020061208000000001 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074923+0000", 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013041600000000001 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2685 3.2a 3:563d809b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:52.710 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 34.160514671000001, 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024124367000000001, 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2685 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531175+0000", 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2130000000000002e-06 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535309+0000", 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004133828 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535341+0000", 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2583000000000003e-05 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535365+0000", 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4244e-05 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535513+0000", 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000147152 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535766+0000", 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025306800000000001 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.536027+0000", 2024-04-26T07:50:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000260952 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.546828+0000", 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010801471 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555090+0000", 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082623200000000001 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555189+0000", 2024-04-26T07:50:52.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8157000000000002e-05 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555295+0000", 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010637900000000001 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2718 3.2a 3:56cbd9c4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.783055328000003, 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025498831999999999, 2024-04-26T07:50:52.716 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2718 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908634+0000", 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7400000000000002e-06 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912808+0000", 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041748089999999998 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912847+0000", 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8367e-05 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912865+0000", 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7886000000000001e-05 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913036+0000", 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017147199999999999 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913465+0000", 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000429071 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913890+0000", 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042477999999999998 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.929103+0000", 2024-04-26T07:50:52.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015213344 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.933821+0000", 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047172480000000003 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.934000+0000", 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178872 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.934129+0000", 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129243 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2728 3.1d 3:b8ac35e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.676199132999997, 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026742152000000002, 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.722 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2728 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015489+0000", 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0900000000000001e-06 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021300+0000", 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058107380000000002 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021350+0000", 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9775999999999999e-05 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021375+0000", 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5113000000000002e-05 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021530+0000", 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015508199999999999 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021829+0000", 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029866499999999999 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.022068+0000", 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023948200000000001 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.032120+0000", 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010051579 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042009+0000", 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0098892019999999997 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042110+0000", 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010163299999999999 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042228+0000", 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117792 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.727 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2765 3.3a 3:5c727248:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.284532380000002, 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029518037, 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.728 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2765 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407157+0000", 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5569999999999997e-06 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411821+0000", 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004664021 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411877+0000", 2024-04-26T07:50:52.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.588e-05 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411904+0000", 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6763000000000001e-05 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412067+0000", 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016272300000000001 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412462+0000", 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039559000000000003 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412689+0000", 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022669500000000001 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.430894+0000", 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018205063 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436449+0000", 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0055546529999999997 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436582+0000", 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013349499999999999 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436671+0000", 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8597000000000006e-05 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.733 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2979 3.1d 3:ba9645d5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.896792587, 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030394228999999998, 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.734 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2979 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794897+0000", 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2969999999999997e-06 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804170+0000", 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092730629999999998 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804210+0000", 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0426999999999998e-05 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804229+0000", 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.893e-05 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804376+0000", 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014691500000000001 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804637+0000", 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026043799999999999 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804880+0000", 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024350500000000001 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.818402+0000", 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013521574999999999 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825159+0000", 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067568710000000002 2024-04-26T07:50:52.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825217+0000", 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8604000000000003e-05 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825287+0000", 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9604000000000006e-05 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2987 3.16 3:689e92b2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.776668996, 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023936529000000002, 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2987 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915020+0000", 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2830000000000002e-06 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.918997+0000", 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039778799999999996 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919037+0000", 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9520000000000001e-05 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919063+0000", 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6539000000000001e-05 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919189+0000", 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012578200000000001 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919381+0000", 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019129100000000001 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919551+0000", 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169968 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.925721+0000", 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061707120000000001 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938659+0000", 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012937786 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938834+0000", 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017547600000000001 2024-04-26T07:50:52.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938953+0000", 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118292 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3279 3.5 3:a273d8b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_294:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.458808436, 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027017204999999999, 2024-04-26T07:50:52.745 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3279 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232880+0000", 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5700000000000001e-06 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237876+0000", 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049959890000000002 2024-04-26T07:50:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237914+0000", 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7166000000000003e-05 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237938+0000", 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4559999999999999e-05 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238136+0000", 2024-04-26T07:50:52.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000197672 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238418+0000", 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028272200000000001 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238667+0000", 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024804100000000001 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.248432+0000", 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097655169999999996 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259686+0000", 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011253582 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259773+0000", 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7689999999999996e-05 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259894+0000", 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120696 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3310 3.1d 3:bbab4933:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.122261639, 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024852018999999999, 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.751 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3310 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:50:52.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569427+0000", 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3759999999999999e-06 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574227+0000", 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048002490000000004 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574263+0000", 2024-04-26T07:50:52.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5366e-05 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574285+0000", 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2802999999999998e-05 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574407+0000", 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121827 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574743+0000", 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033614199999999999 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.575020+0000", 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000276731 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.586811+0000", 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011791322 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594014+0000", 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072022680000000004 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594163+0000", 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149605 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594276+0000", 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011233 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3328 3.1d 3:b9deba7f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_343:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.924698053, 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024014658000000001, 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3328 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766991+0000", 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:52.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771175+0000", 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041842210000000001 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771212+0000", 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7499999999999997e-05 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771230+0000", 2024-04-26T07:50:52.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7107000000000001e-05 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771350+0000", 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120109 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771604+0000", 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025427799999999998 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:52.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771838+0000", 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234582 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.787185+0000", 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015346761 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.790664+0000", 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003478933 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.790844+0000", 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017979899999999999 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.791002+0000", 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015785500000000001 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3337 3.2a 3:5576afd6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:50:52.762 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.812904207999999, 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024210850999999999, 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3337 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:50:52.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878785+0000", 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8e-06 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884461+0000", 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0056765080000000002 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884499+0000", 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8006999999999997e-05 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884528+0000", 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8215999999999999e-05 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884685+0000", 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015766900000000001 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.885092+0000", 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040696100000000001 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.885545+0000", 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045240299999999998 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.900806+0000", 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015261082 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902766+0000", 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001959854 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902868+0000", 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010214500000000001 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902992+0000", 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000124206 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3358 3.2a 3:5403285b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.582814534000001, 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044350464999999999, 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.768 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3358 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:50:52.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108875+0000", 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5700000000000003e-06 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117074+0000", 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081984469999999993 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117127+0000", 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3359000000000002e-05 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117156+0000", 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9312999999999999e-05 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117376+0000", 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000219946 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:50:52.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117397+0000", 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0449e-05 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131014+0000", 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013617304 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131236+0000", 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022168200000000001 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131455+0000", 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021913100000000001 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.146752+0000", 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015297445 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.152923+0000", 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061707869999999996 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.153094+0000", 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017126899999999999 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.153221+0000", 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012676300000000001 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3359 3.3c 3:3d78e8bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.574365682, 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.038491746, 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3359 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117323+0000", 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0060000000000001e-06 2024-04-26T07:50:52.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125017+0000", 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076944609999999997 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125056+0000", 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8819999999999998e-05 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125075+0000", 2024-04-26T07:50:52.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9352999999999999e-05 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125215+0000", 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139672 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125234+0000", 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9386999999999999e-05 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131593+0000", 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063589930000000003 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131791+0000", 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019822899999999999 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131988+0000", 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019633500000000001 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.149711+0000", 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017723161000000001 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155565+0000", 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058539200000000003 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155706+0000", 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000141252 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155811+0000", 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105157 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3361 3.36 e80/17 3:6fb653d9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_376:head v 80'20, mlcod=79'18)", 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.535654786, 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024761258000000001, 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.781 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156031+0000", 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0299999999999999e-07 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159443+0000", 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118960000000002 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159474+0000", 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1495000000000003e-05 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159491+0000", 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6625000000000001e-05 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159658+0000", 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016732699999999999 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159731+0000", 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2862999999999997e-05 2024-04-26T07:50:52.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.180648+0000", 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020916396 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.180792+0000", 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144053 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3405 3.16 3:68271ef4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_420:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.094313047, 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024793686999999998, 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3405 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597377+0000", 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1900000000000003e-06 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601615+0000", 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042371880000000002 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601654+0000", 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9266e-05 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601672+0000", 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8406e-05 2024-04-26T07:50:52.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601846+0000", 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017330899999999999 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.602257+0000", 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041117399999999999 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.602699+0000", 2024-04-26T07:50:52.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044251700000000002 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.615866+0000", 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013166862999999999 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.621980+0000", 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061141779999999996 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.622082+0000", 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102036 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.622166+0000", 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3560000000000006e-05 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3414 3.16 3:6ba6e04b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_429:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.9996066040000002, 2024-04-26T07:50:52.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029030314000000002, 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3414 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692082+0000", 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1559999999999999e-06 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.696989+0000", 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004907649 2024-04-26T07:50:52.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697029+0000", 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.943e-05 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697049+0000", 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0574e-05 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697189+0000", 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013976900000000001 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697460+0000", 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027075800000000001 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697689+0000", 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022929499999999999 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.718106+0000", 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020416863 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.720916+0000", 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002809878 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.721031+0000", 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115153 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.721109+0000", 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7788999999999997e-05 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3469 3.2f 3:f677d2ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_484:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.229999609, 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024085299000000001, 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.797 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3469 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:50:52.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461689+0000", 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4079999999999998e-06 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465469+0000", 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037796190000000001 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465500+0000", 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0877999999999998e-05 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465514+0000", 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4405e-05 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465608+0000", 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3826000000000006e-05 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465778+0000", 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016981799999999999 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465931+0000", 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015329300000000001 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476409+0000", 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01047788 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485459+0000", 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.009050298 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485638+0000", 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017882900000000001 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485771+0000", 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013304500000000001 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3473 3.16 3:6a1b18ea:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.1901624010000003, 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023955699, 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:52.803 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3473 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501526+0000", 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5669999999999999e-06 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505892+0000", 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043654660000000001 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505925+0000", 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2863e-05 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505942+0000", 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7037e-05 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506114+0000", 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172258 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506485+0000", 2024-04-26T07:50:52.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037092199999999998 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506737+0000", 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000252124 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.524617+0000", 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017879674000000002 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:52.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525286+0000", 2024-04-26T07:50:52.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00066962300000000005 2024-04-26T07:50:52.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:52.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525402+0000", 2024-04-26T07:50:52.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000116119 2024-04-26T07:50:52.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:52.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:52.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:52.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525479+0000", 2024-04-26T07:50:52.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6045999999999997e-05 2024-04-26T07:50:52.811 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.811 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.811 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.811 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:52.811 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:52.811 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:52.813 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:52.813 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:52.809+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:52.830 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:52.830 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:52.847 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:52.847 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:52.863 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:52.863 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:52.879 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:52.880 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:52.899 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:52.899 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:52.914 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:52.909+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:52.919 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:52.919 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:52.925 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.7 primary-affinity to 0 (802) 2024-04-26T07:50:52.930 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:50:52.947 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:52.948 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:52.958 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:52.958 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:52.970 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:52.971 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:53.015 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:53.014+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:53.091 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:53.091 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:53.107 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:53.151 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:53.150+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:53.216 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:53.213+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:53.274 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:53.274 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:53.289 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:53.335 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:53.334+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:53.412 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:53.412 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:53.418 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:53.414+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:53.427 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:53.519 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:53.518+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:53.598 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:53.599 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:53.613 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:53.620 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:53.617+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:53.721 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:53.717+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:53.778 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:53.778 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:53.792 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:53.822 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:53.818+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:53.923 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:53.921+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:53.938 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:53.938 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:53.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:54.024 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:54.022+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:54.125 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:54.122+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:54.130 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:54.130 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:54.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:54.227 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:54.226+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:54.273 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:54.273 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:54.287 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:54.332 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:54.329+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:54.407 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:54.407 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:54.421 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:54.463 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:54.461+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:54.529 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:54.530+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:54.584 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:54.584 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:54.599 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:54.644 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:54.641+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:54.730 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:54.730 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:54.731 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:54.730+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:54.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:54.831 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:54.830+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:54.913 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:54.913 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:54.928 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:54.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:50:54.979 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:54.977+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:54.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:55.057 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:55.057 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:55.057 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:55.053+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:55.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:55.134 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:55.134+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:55.167 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:55.168 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:55.185 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:55.185 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:55.202 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:55.202 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:55.220 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:55.220 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:55.235 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:55.234+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2148 3.1e 3:7b55e259:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 74.267988876000004, 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023791369999999999, 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.237 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2148 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.238 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967040+0000", 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.967044+0000", 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1420000000000002e-06 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970464+0000", 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003420476 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.239 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970519+0000", 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5059000000000003e-05 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970541+0000", 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1466000000000001e-05 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.970748+0000", 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000207865 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.240 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971059+0000", 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00031019899999999999 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.971313+0000", 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00025432699999999999 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.984234+0000", 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012920724999999999 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.241 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990608+0000", 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0063745829999999996 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990707+0000", 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8450999999999996e-05 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.990832+0000", 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125077 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.242 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2152 3.21 3:857054a8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 74.167241163, 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.02036688, 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2152 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.243 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067788+0000", 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.067793+0000", 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5199999999999999e-06 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.244 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070914+0000", 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003121352 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070963+0000", 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.8982e-05 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.070988+0000", 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5069e-05 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.245 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071156+0000", 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016792599999999999 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071422+0000", 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026608399999999998 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:55.246 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.071765+0000", 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034272399999999998 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.080741+0000", 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089767509999999998 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088039+0000", 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0072974019999999997 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.247 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088106+0000", 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6952999999999994e-05 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.088155+0000", 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9116999999999997e-05 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2164 3.2e 3:7693c6e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 73.865528651999995, 2024-04-26T07:50:55.248 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018907564000000002, 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2164 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369501+0000", 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.369505+0000", 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3970000000000004e-06 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372691+0000", 2024-04-26T07:50:55.250 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00318637 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372743+0000", 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1538e-05 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372763+0000", 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0183e-05 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.251 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.372916+0000", 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015275299999999999 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373226+0000", 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000310079 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.373559+0000", 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00033273899999999997 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.252 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.381200+0000", 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0076410920000000004 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388241+0000", 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0070417040000000002 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388336+0000", 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4240999999999994e-05 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.253 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.388408+0000", 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.2467999999999998e-05 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_repop(client.4458.0:2168 3.2d e58/17 3:b6a8af37:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_57:head v 58'3, mlcod=58'1)", 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 73.774769526, 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020204854000000001, 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.254 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460260+0000", 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.255 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.460262+0000", 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4420000000000001e-06 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466198+0000", 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0059363339999999997 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466250+0000", 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1211000000000001e-05 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.256 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466270+0000", 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0469999999999999e-05 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466396+0000", 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000125578 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.466430+0000", 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.4453999999999999e-05 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.257 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480338+0000", 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013907733 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:41.480465+0000", 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000126632 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2640 3.2e 3:77844312:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.225040020999998, 2024-04-26T07:50:55.258 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027589625, 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2640 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009989+0000", 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.009991+0000", 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.278e-06 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011596+0000", 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016040379999999999 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011623+0000", 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7209e-05 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011646+0000", 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3662000000000001e-05 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011741+0000", 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4285999999999998e-05 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.261 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.011940+0000", 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0001994 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.012120+0000", 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000179848 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.017706+0000", 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055856489999999998 2024-04-26T07:50:55.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037454+0000", 2024-04-26T07:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019748099000000002 2024-04-26T07:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037524+0000", 2024-04-26T07:50:55.266 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0407000000000005e-05 2024-04-26T07:50:55.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.266 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.266 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.266 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.037579+0000", 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4749e-05 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2712 3.21 3:850eb5aa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.389848260999997, 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020848245000000001, 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.267 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2712 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.268 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845181+0000", 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.845184+0000", 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6579999999999998e-06 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847421+0000", 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0022374790000000001 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.269 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847453+0000", 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999997e-05 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847466+0000", 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3604999999999999e-05 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847550+0000", 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3825000000000005e-05 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.270 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847728+0000", 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017738000000000001 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.847852+0000", 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124449 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.852245+0000", 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043931530000000003 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.271 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865942+0000", 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013697047 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.865988+0000", 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5788000000000003e-05 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.866029+0000", 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1081000000000002e-05 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.272 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2734 3.1e 3:7bc4dd61:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.160218125999997, 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022112987000000001, 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2734 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.273 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074811+0000", 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.074814+0000", 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8169999999999999e-06 2024-04-26T07:50:55.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076636+0000", 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018219670000000001 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076668+0000", 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2579000000000001e-05 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076684+0000", 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5228000000000001e-05 2024-04-26T07:50:55.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076777+0000", 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3751000000000004e-05 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.076907+0000", 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000129899 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.077003+0000", 2024-04-26T07:50:55.276 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.5314000000000003e-05 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.081365+0000", 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043621709999999998 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096804+0000", 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015438825999999999 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.277 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096870+0000", 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6407000000000003e-05 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.096924+0000", 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4027999999999998e-05 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2774 3.21 3:85ac5c16:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:55.278 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.737994559999997, 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022721992, 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2774 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.279 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497035+0000", 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.497037+0000", 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2970000000000002e-06 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.280 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498369+0000", 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001332106 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498402+0000", 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2490000000000002e-05 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498416+0000", 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4922999999999999e-05 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.281 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498506+0000", 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9040000000000001e-05 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op must wait for map", 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.498514+0000", 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1550000000000007e-06 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500799+0000", 2024-04-26T07:50:55.282 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002284861 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.500953+0000", 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015486800000000001 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.501099+0000", 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014553499999999999 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.283 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.505865+0000", 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047655589999999999 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519642+0000", 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013777608 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519710+0000", 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7702999999999999e-05 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.284 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.519757+0000", 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6847000000000001e-05 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2800 3.1c 3:395a1da4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.470529075000002, 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024565350999999999, 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.285 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2800 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.286 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764500+0000", 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.764503+0000", 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2940000000000001e-06 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766083+0000", 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015793210000000001 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.287 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766113+0000", 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0292999999999999e-05 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766125+0000", 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1575e-05 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766186+0000", 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.1310999999999996e-05 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.288 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766357+0000", 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017109199999999999 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.766457+0000", 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100144 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.771500+0000", 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050428799999999996 2024-04-26T07:50:55.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.788952+0000", 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017451575 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789010+0000", 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8631000000000002e-05 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.789066+0000", 2024-04-26T07:50:55.290 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5235000000000002e-05 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2811 3.1e 3:786cbdae:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 35.357689811, 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.019591179, 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.291 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2811 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877339+0000", 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.877343+0000", 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8399999999999997e-06 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879093+0000", 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001749446 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.293 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879156+0000", 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3765999999999999e-05 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879206+0000", 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.956e-05 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879283+0000", 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6602999999999998e-05 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.294 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879427+0000", 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000144232 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.879541+0000", 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011364199999999999 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.885376+0000", 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058353909999999997 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.295 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896847+0000", 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011471212999999999 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896893+0000", 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5797000000000002e-05 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.896931+0000", 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7688999999999998e-05 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.296 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2978 3.21 3:84d7aea2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.464714280999999, 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.024469095999999999, 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2978 2024-04-26T07:50:55.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770315+0000", 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.298 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.770317+0000", 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1260000000000001e-06 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774236+0000", 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.003919278 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774265+0000", 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8198999999999999e-05 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.299 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774277+0000", 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2021000000000001e-05 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774358+0000", 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.1125999999999995e-05 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774536+0000", 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017878699999999999 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.300 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.774699+0000", 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016269900000000001 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.780749+0000", 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060501970000000002 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794544+0000", 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013794376000000001 2024-04-26T07:50:55.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794674+0000", 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013040999999999999 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:37.794784+0000", 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010987700000000001 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3035 3.13 3:cb4a1b57:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.759452599999999, 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020272116, 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3035 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.303 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475577+0000", 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.475580+0000", 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.472e-06 2024-04-26T07:50:55.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477288+0000", 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017077629999999999 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477325+0000", 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7159000000000001e-05 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.305 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477343+0000", 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.7864e-05 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477436+0000", 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.3573999999999996e-05 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477619+0000", 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018206 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.306 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.477782+0000", 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000163716 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.483623+0000", 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0058409680000000002 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495713+0000", 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012089322 2024-04-26T07:50:55.307 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495789+0000", 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6039999999999997e-05 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:38.495849+0000", 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.0177999999999999e-05 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3283 3.2e 3:75378d11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_298:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.959054501000001, 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.026000832000000001, 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3283 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.309 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275975+0000", 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.275978+0000", 2024-04-26T07:50:55.310 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9900000000000002e-06 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278413+0000", 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002435071 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278435+0000", 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.2376999999999999e-05 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278445+0000", 2024-04-26T07:50:55.311 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.6539999999999994e-06 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278553+0000", 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010861000000000001 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278713+0000", 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015921800000000001 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.278866+0000", 2024-04-26T07:50:55.312 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015332599999999999 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.286023+0000", 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0071569349999999997 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301857+0000", 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015834379999999999 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301925+0000", 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7508999999999993e-05 2024-04-26T07:50:55.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.301976+0000", 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0762e-05 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3302 3.2e 3:7731d88a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_317:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.756111511, 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021970494, 2024-04-26T07:50:55.314 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3302 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478918+0000", 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.478921+0000", 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2349999999999999e-06 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480764+0000", 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001843019 2024-04-26T07:50:55.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480803+0000", 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8591999999999999e-05 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480822+0000", 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9250999999999999e-05 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.480906+0000", 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.4450000000000006e-05 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.317 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481064+0000", 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015772099999999999 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481217+0000", 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015252899999999999 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.487388+0000", 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0061710719999999997 2024-04-26T07:50:55.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500776+0000", 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013388436 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500843+0000", 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6528999999999999e-05 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.319 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.500888+0000", 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.566e-05 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3307 3.2e 3:777059e0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_322:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.700039520000001, 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018291400999999999, 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3307 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534990+0000", 2024-04-26T07:50:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.534993+0000", 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2219999999999998e-06 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535923+0000", 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00093030599999999999 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.322 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535949+0000", 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5834e-05 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.535959+0000", 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0373e-05 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536027+0000", 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7719999999999995e-05 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536148+0000", 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000120658 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.536238+0000", 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.9808000000000005e-05 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.540751+0000", 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045132879999999998 2024-04-26T07:50:55.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553187+0000", 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012436189 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553229+0000", 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2194999999999998e-05 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.553281+0000", 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1808000000000003e-05 2024-04-26T07:50:55.325 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3341 3.2e 3:7651510b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.316486129999999, 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021327268999999999, 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.326 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3341 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918543+0000", 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.918546+0000", 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7879999999999998e-06 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920222+0000", 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016760919999999999 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920249+0000", 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6619999999999999e-05 2024-04-26T07:50:55.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920261+0000", 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1959e-05 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920326+0000", 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5759000000000005e-05 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920471+0000", 2024-04-26T07:50:55.329 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014433299999999999 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.920579+0000", 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000108208 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.924822+0000", 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042434919999999998 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.330 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939736+0000", 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014913932 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939811+0000", 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.4449999999999994e-05 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.939870+0000", 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9636000000000003e-05 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.331 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3348 3.1e 3:7b679b6a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_363:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.243844101000001, 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018635565, 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3348 2024-04-26T07:50:55.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991185+0000", 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.333 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.991188+0000", 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0570000000000001e-06 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992865+0000", 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001676975 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992892+0000", 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6631999999999998e-05 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.334 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992904+0000", 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2629000000000001e-05 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.992973+0000", 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8226999999999996e-05 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.993097+0000", 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012449499999999999 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.335 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.993214+0000", 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000116859 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.998594+0000", 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0053799060000000003 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009690+0000", 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011095743 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009765+0000", 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.5737999999999999e-05 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.009821+0000", 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5303999999999998e-05 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3377 3.13 3:cbfc4825:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_392:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.337 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.928151622, 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023830246999999999, 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3377 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.338 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306878+0000", 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.306881+0000", 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8720000000000004e-06 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309014+0000", 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021321640000000002 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309039+0000", 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5678999999999999e-05 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309050+0000", 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0832000000000001e-05 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309126+0000", 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6139999999999999e-05 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309284+0000", 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015728699999999999 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.309390+0000", 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000106582 2024-04-26T07:50:55.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.313696+0000", 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043055289999999998 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330590+0000", 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016893944000000001 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330656+0000", 2024-04-26T07:50:55.342 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6802000000000002e-05 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.330708+0000", 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1415999999999997e-05 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3413 3.13 3:ca771f50:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_428:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.555906950000001, 2024-04-26T07:50:55.343 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.018182953000000002, 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3413 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679122+0000", 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.679125+0000", 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7769999999999998e-06 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681086+0000", 2024-04-26T07:50:55.345 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0019610090000000001 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681125+0000", 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.8838000000000003e-05 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681141+0000", 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6277e-05 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.346 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681225+0000", 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3967000000000004e-05 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681400+0000", 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000174389 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.681519+0000", 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011937700000000001 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.347 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.688365+0000", 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006846235 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697205+0000", 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0088395739999999993 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697251+0000", 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6119999999999999e-05 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.348 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.697305+0000", 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4389999999999999e-05 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3460 3.2e 3:766ebcb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 11.912444548, 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023101186999999999, 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.349 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3460 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322585+0000", 2024-04-26T07:50:55.350 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.322588+0000", 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.6229999999999999e-06 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326866+0000", 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004277866 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.351 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326925+0000", 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8841000000000001e-05 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.326946+0000", 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.1333999999999999e-05 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327101+0000", 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015422 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.352 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327381+0000", 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00027996299999999999 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.327724+0000", 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00034364500000000001 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.340457+0000", 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012733234 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.353 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345555+0000", 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0050971870000000004 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345632+0000", 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.7206000000000006e-05 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.345686+0000", 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4067999999999998e-05 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.354 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.355 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.355 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:55.356 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:55.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:55.357 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:55.358 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:55.358 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:55.360 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:55.353+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:55.457 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:55.453+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:55.525 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:55.525 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:55.525 INFO:teuthology.orchestra.run.smithi053.stdout: "num_ops": 0 2024-04-26T07:50:55.525 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:55.540 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:55.558 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:55.554+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:55.659 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:55.658+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:55.709 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:55.710 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:55.710 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:55.710 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:55.710 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:55.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:50:55.771 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:55.769+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:55.857 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:55.857 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:50:55.857 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:50:55.857 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:50:55.857 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.857 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 75.579183643999997, 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:50:55.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:50:55.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:50:55.862 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 74.938906951999996, 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:50:55.863 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.864 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:50:55.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:50:55.866 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:50:55.867 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:50:55.868 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 73.554087268000004, 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.869 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.870 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.871 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:50:55.872 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:50:55.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.874 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 38.019012334000003, 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.875 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.876 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:55.878 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:50:55.879 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:50:55.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.879 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.882 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.883 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.802329796999999, 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.884 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:50:55.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:50:55.886 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.887 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:50:55.888 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 37.029610116999997, 2024-04-26T07:50:55.889 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.955957163000001, 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.896 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.897 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.898 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.899 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.900 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.903 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.903 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.903 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:55.903 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.927251935000001, 2024-04-26T07:50:55.904 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:50:55.904 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.904 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.905 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.905 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.905 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.905 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.905 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:50:55.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.905 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.906 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.906 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.906 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:55.906 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.907 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:50:55.907 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.907 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:50:55.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:50:55.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.908 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.908 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:50:55.908 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:50:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:50:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:50:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:50:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:50:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:50:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:50:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:50:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:50:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:50:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.894431369000003, 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:50:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.860637564999998, 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.921 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:50:55.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:50:55.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:55.925 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:50:55.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.622885642, 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.929 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.929 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:55.929 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.930 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.930 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:50:55.930 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.931 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:50:55.932 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:50:55.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.932 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.932 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:50:55.933 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:50:55.934 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.935 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.569478728999997, 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.936 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.937 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:50:55.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:50:55.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:50:55.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:50:55.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:50:55.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 36.158892897999998, 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.943 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.944 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.948 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3300 3.33 3:cd50c5f5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_315:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 14.394652242999999, 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022987548999999999, 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.949 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3300 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:50:55.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458268+0000", 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.021e-06 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459957+0000", 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016889120000000001 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.951 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459981+0000", 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4406e-05 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459994+0000", 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2680000000000001e-05 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460079+0000", 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5614999999999999e-05 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460283+0000", 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000204172 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460467+0000", 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183919 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.465999+0000", 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055315850000000003 2024-04-26T07:50:55.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481141+0000", 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015142375 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481204+0000", 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3048999999999999e-05 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481252+0000", 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7815000000000002e-05 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3365 3.33 3:cf6f73fa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_380:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.672729424, 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022536079000000001, 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.955 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3365 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180191+0000", 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0860000000000004e-06 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182593+0000", 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024014539999999999 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182622+0000", 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9111e-05 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182634+0000", 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2149e-05 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182715+0000", 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0945999999999994e-05 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182913+0000", 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019779300000000001 2024-04-26T07:50:55.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.183094+0000", 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018092999999999999 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.190830+0000", 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077362419999999999 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202632+0000", 2024-04-26T07:50:55.959 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011801416 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202669+0000", 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7394000000000001e-05 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202723+0000", 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4558000000000002e-05 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3372 3.29 3:97c5a4e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.600325023, 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020672864999999999, 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.961 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3372 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252596+0000", 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2989999999999998e-06 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253876+0000", 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001279493 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253904+0000", 2024-04-26T07:50:55.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8022999999999999e-05 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253915+0000", 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1878e-05 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254002+0000", 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6528999999999998e-05 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254171+0000", 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168486 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254325+0000", 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000154821 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.258909+0000", 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045840589999999997 2024-04-26T07:50:55.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273124+0000", 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014214536 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273179+0000", 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4598000000000001e-05 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273265+0000", 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6143000000000005e-05 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3401 3.29 3:94e99a5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.301320601, 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022448046999999999, 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.967 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3401 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551599+0000", 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1999999999999999e-06 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553183+0000", 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015834829999999999 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553216+0000", 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2663000000000002e-05 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553232+0000", 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6612999999999998e-05 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553321+0000", 2024-04-26T07:50:55.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8941000000000001e-05 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553484+0000", 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162554 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553616+0000", 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013222700000000001 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.558023+0000", 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044068570000000001 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573919+0000", 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015896100999999999 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573991+0000", 2024-04-26T07:50:55.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1950000000000001e-05 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.574044+0000", 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3458000000000002e-05 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3406 3.27 3:e585af2f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_421:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.250010087, 2024-04-26T07:50:55.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020601642999999999, 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3406 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602909+0000", 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604530+0000", 2024-04-26T07:50:55.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016205550000000001 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604555+0000", 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5392999999999999e-05 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604566+0000", 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0400999999999999e-05 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604634+0000", 2024-04-26T07:50:55.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7762999999999995e-05 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604752+0000", 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118268 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604888+0000", 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000136601 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.609679+0000", 2024-04-26T07:50:55.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047901300000000001 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623360+0000", 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013681125000000001 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623442+0000", 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2208999999999998e-05 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623508+0000", 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6515999999999998e-05 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3424 3.2 3:422e52f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_439:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 13.057369210999999, 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021648288000000002, 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.979 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3424 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:50:55.980 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795550+0000", 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.199e-06 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797322+0000", 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017720329999999999 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797353+0000", 2024-04-26T07:50:55.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1390000000000003e-05 2024-04-26T07:50:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797366+0000", 2024-04-26T07:50:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3027000000000001e-05 2024-04-26T07:50:55.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797436+0000", 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9306000000000004e-05 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797578+0000", 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014246699999999999 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:55.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797702+0000", 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124354 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.802182+0000", 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004479841 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817086+0000", 2024-04-26T07:50:55.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014903506 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817141+0000", 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5207999999999997e-05 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817196+0000", 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4957000000000003e-05 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3457 3.29 3:975e30a2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_472:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 12.597113899, 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021210401, 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3457 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.986 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255808+0000", 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1769999999999997e-06 2024-04-26T07:50:55.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258946+0000", 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00313766 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258989+0000", 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3452999999999999e-05 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259009+0000", 2024-04-26T07:50:55.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9516000000000001e-05 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259161+0000", 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151824 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259410+0000", 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024946099999999998 2024-04-26T07:50:55.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259694+0000", 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028413400000000001 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.267979+0000", 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082847070000000005 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276888+0000", 2024-04-26T07:50:55.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089093169999999999 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276946+0000", 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7438999999999997e-05 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.277013+0000", 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7712999999999994e-05 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.991 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:50:55.992 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:50:55.992 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:55.994 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:50:55.994 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:50:55.995 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:55.990+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:56.094 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:56.089+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:56.127 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:56.127 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:56.141 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:50:56.196 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:50:56.194+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:50:56.258 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:56.258 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:56.258 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:56.258 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:56.258 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:56.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:50:56.297 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:56.293+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:56.399 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:56.393+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 88.225265472000004, 2024-04-26T07:50:56.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:50:56.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.447 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 75.397837136000007, 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.448 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:50:56.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:50:56.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:50:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:50:56.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.547255226999994, 2024-04-26T07:50:56.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:50:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:50:56.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:50:56.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:50:56.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.410682652999995, 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.459 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:56.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.067217565000007, 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:50:56.464 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:50:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:50:56.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:50:56.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2650 3.9 3:910fae93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.320224160000002, 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026997720999999999, 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.470 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2650 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120449+0000", 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.213e-06 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126814+0000", 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063646370000000002 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126859+0000", 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5769999999999997e-05 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126881+0000", 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1226999999999999e-05 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127062+0000", 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018148799999999999 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127473+0000", 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041101799999999997 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127939+0000", 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046579999999999999 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.142532+0000", 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014592818 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147212+0000", 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046805379999999997 2024-04-26T07:50:56.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147317+0000", 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104706 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147444+0000", 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126506 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2651 3.34 3:2e652162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.308071908999999, 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026435427000000001, 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2651 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132621+0000", 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2677e-05 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140045+0000", 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074240269999999997 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140075+0000", 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0159999999999999e-05 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140090+0000", 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.485e-05 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140253+0000", 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162752 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140492+0000", 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023908800000000001 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140712+0000", 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022059900000000001 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.156194+0000", 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015481818 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158759+0000", 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025644750000000001 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158920+0000", 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016169000000000001 2024-04-26T07:50:56.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159033+0000", 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113291 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2652 3.f e71/17 3:f0cf4464:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_87:head v 71'6, mlcod=59'4)", 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.286038730999998, 2024-04-26T07:50:56.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025327902999999999, 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154635+0000", 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4199999999999999e-06 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159003+0000", 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043688370000000004 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159072+0000", 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8546000000000004e-05 2024-04-26T07:50:56.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159104+0000", 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2283999999999998e-05 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159252+0000", 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014761200000000001 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159318+0000", 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6248999999999995e-05 2024-04-26T07:50:56.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179858+0000", 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020539973 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179959+0000", 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100982 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.485 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2660 3.1b e71/17 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head v 71'5, mlcod=59'3)", 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.211896617999997, 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023049618000000001, 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228775+0000", 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.75e-06 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236455+0000", 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076795539999999999 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236485+0000", 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9923000000000001e-05 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236501+0000", 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6317e-05 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236642+0000", 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014074899999999999 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236688+0000", 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6106000000000002e-05 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251724+0000", 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015035935 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251823+0000", 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9283999999999993e-05 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.489 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2717 3.24 e71/17 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head v 71'14, mlcod=71'12)", 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.539773402000002, 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024784816000000001, 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900899+0000", 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907332+0000", 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064328529999999997 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907367+0000", 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4966999999999999e-05 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907397+0000", 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0392999999999999e-05 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907551+0000", 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015379900000000001 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907597+0000", 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639000000000001e-05 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925587+0000", 2024-04-26T07:50:56.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017990055000000001 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925681+0000", 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4696000000000003e-05 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2764 3.34 3:2e573a11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.046239561, 2024-04-26T07:50:56.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031072567999999998, 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2764 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394434+0000", 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4240000000000002e-06 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400673+0000", 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062394210000000002 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400724+0000", 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1175999999999999e-05 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400760+0000", 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5123000000000002e-05 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400955+0000", 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019514900000000001 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401423+0000", 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046833999999999998 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401840+0000", 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041720800000000002 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.423203+0000", 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021362641000000002 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425243+0000", 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020403420000000001 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425403+0000", 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015975599999999999 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425503+0000", 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9988000000000006e-05 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.499 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2980 3.34 3:2c27af06:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.626626389999998, 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023940217999999999, 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2980 2024-04-26T07:50:56.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814047+0000", 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.49e-06 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820559+0000", 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065114609999999996 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820595+0000", 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6919999999999999e-05 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820614+0000", 2024-04-26T07:50:56.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9017000000000001e-05 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820759+0000", 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014448600000000001 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821025+0000", 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026618799999999999 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821281+0000", 2024-04-26T07:50:56.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000255388 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837756+0000", 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016475019 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837825+0000", 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9529999999999993e-05 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837913+0000", 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8418000000000006e-05 2024-04-26T07:50:56.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837984+0000", 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0301000000000003e-05 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2988 3.f e78/17 3:f2e60fa8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_13:head v 78'11, mlcod=72'9)", 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.511115132, 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025247141000000001, 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929557+0000", 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.812e-06 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932701+0000", 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031440909999999999 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932727+0000", 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6485000000000001e-05 2024-04-26T07:50:56.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932740+0000", 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2899e-05 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932846+0000", 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106261 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932884+0000", 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7150000000000002e-05 2024-04-26T07:50:56.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954658+0000", 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021774803999999998 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954802+0000", 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014363900000000001 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3038 3.14 3:2b0c4970:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.928241104000001, 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02413448, 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3038 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512431+0000", 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0219999999999999e-06 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516443+0000", 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040121369999999998 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516479+0000", 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5921999999999999e-05 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516498+0000", 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9434999999999999e-05 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516594+0000", 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5626999999999998e-05 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516761+0000", 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016746900000000001 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516919+0000", 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157613 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.532325+0000", 2024-04-26T07:50:56.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015405785 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536276+0000", 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039511859999999998 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536433+0000", 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000156751 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536563+0000", 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013053300000000001 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3295 3.e e79/17 3:72febd94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_310:head v 79'12, mlcod=71'10)", 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.023211856, 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023400582999999999, 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.515 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417461+0000", 2024-04-26T07:50:56.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.886e-06 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425407+0000", 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079463720000000002 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425450+0000", 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2827000000000002e-05 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425475+0000", 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5276999999999999e-05 2024-04-26T07:50:56.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425638+0000", 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016255499999999999 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425684+0000", 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6226000000000001e-05 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440766+0000", 2024-04-26T07:50:56.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015081776999999999 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440859+0000", 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2663000000000004e-05 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3312 3.14 3:28d42ed8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.852334430999999, 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02506968, 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.519 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3312 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588339+0000", 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8139999999999998e-06 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593503+0000", 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051636939999999999 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593552+0000", 2024-04-26T07:50:56.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8644999999999999e-05 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593575+0000", 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3694999999999999e-05 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593721+0000", 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014558099999999999 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594030+0000", 2024-04-26T07:50:56.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000309084 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594362+0000", 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033205799999999998 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.602982+0000", 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086194410000000003 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613081+0000", 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010099385000000001 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613235+0000", 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153936 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613405+0000", 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170347 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3362 3.3 3:c21c3c88:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:56.524 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.290131733000001, 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027051006999999998, 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3362 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150542+0000", 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4230000000000001e-06 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155196+0000", 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046542240000000002 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155241+0000", 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5188000000000002e-05 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155264+0000", 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3243000000000001e-05 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155429+0000", 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016474099999999999 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155798+0000", 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036913799999999997 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156167+0000", 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036868699999999998 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177139+0000", 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020971996999999999 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177402+0000", 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026307499999999998 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177513+0000", 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110862 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177589+0000", 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6428999999999996e-05 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.529 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3364 3.9 3:93973eda:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_379:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.267685053999999, 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023680673999999999, 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3364 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172989+0000", 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7479999999999999e-06 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178348+0000", 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053593870000000002 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178375+0000", 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6948e-05 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178395+0000", 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9746e-05 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178680+0000", 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028477199999999998 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179097+0000", 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041771700000000001 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179312+0000", 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021453499999999999 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.194902+0000", 2024-04-26T07:50:56.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015590530999999999 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196474+0000", 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015717610000000001 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196592+0000", 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118139 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196666+0000", 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.339e-05 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3376 3.a e80/17 3:52d883ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_391:head v 80'14, mlcod=79'12)", 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.133332599999999, 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022696129999999998, 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.535 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307338+0000", 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310209+0000", 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028707699999999999 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310255+0000", 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5872999999999999e-05 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310283+0000", 2024-04-26T07:50:56.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8013000000000001e-05 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310455+0000", 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017232900000000001 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310519+0000", 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633000000000006e-05 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.329934+0000", 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019415536000000001 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330033+0000", 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9393000000000002e-05 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3400 3.e e80/17 3:72fd7c3d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_415:head v 80'16, mlcod=80'14)", 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.888109804999999, 2024-04-26T07:50:56.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022514756, 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552562+0000", 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.176e-06 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555476+0000", 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029136040000000002 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555511+0000", 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4832999999999997e-05 2024-04-26T07:50:56.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555528+0000", 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7580000000000001e-05 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555693+0000", 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016455500000000001 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555761+0000", 2024-04-26T07:50:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7875999999999999e-05 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575001+0000", 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019240295000000001 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575075+0000", 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3837000000000005e-05 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.543 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.544 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:56.545 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:50:56.546 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:56.541+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:56.646 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:56.641+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:56.672 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:56.672 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:56.687 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:50:56.747 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:56.745+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:56.809 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:56.809 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:56.809 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:56.809 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:56.810 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:56.824 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:50:56.871 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:56.870+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:56.949 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:56.946+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:56.951 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:56.951 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:56.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:56.952 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:56.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.952 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2204 3.5 3:a294f995:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:56.952 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:50:56.952 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 75.066893059999998, 2024-04-26T07:50:56.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.03032317, 2024-04-26T07:50:56.953 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.953 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.953 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.953 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.953 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.953 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.954 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2204 2024-04-26T07:50:56.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.954 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:50:56.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:50:56.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881994+0000", 2024-04-26T07:50:56.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6330000000000002e-06 2024-04-26T07:50:56.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888238+0000", 2024-04-26T07:50:56.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062439069999999999 2024-04-26T07:50:56.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888280+0000", 2024-04-26T07:50:56.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2231999999999998e-05 2024-04-26T07:50:56.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888305+0000", 2024-04-26T07:50:56.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5060000000000001e-05 2024-04-26T07:50:56.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888469+0000", 2024-04-26T07:50:56.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016422499999999999 2024-04-26T07:50:56.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:50:56.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888479+0000", 2024-04-26T07:50:56.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.008e-05 2024-04-26T07:50:56.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.894701+0000", 2024-04-26T07:50:56.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062219969999999999 2024-04-26T07:50:56.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895063+0000", 2024-04-26T07:50:56.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036214800000000002 2024-04-26T07:50:56.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:56.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895429+0000", 2024-04-26T07:50:56.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036549400000000001 2024-04-26T07:50:56.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.909795+0000", 2024-04-26T07:50:56.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014366191 2024-04-26T07:50:56.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912173+0000", 2024-04-26T07:50:56.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023778330000000002 2024-04-26T07:50:56.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912250+0000", 2024-04-26T07:50:56.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6736000000000005e-05 2024-04-26T07:50:56.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912313+0000", 2024-04-26T07:50:56.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633999999999994e-05 2024-04-26T07:50:56.967 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.967 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.967 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.968 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2206 3.16 3:6a8f0fb0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:56.968 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:50:56.968 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 75.042984227999995, 2024-04-26T07:50:56.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028443779999999998, 2024-04-26T07:50:56.968 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.969 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.969 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.969 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.969 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.969 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.970 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2206 2024-04-26T07:50:56.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.970 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:50:56.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:50:56.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905902+0000", 2024-04-26T07:50:56.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9059999999999998e-06 2024-04-26T07:50:56.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910333+0000", 2024-04-26T07:50:56.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044310299999999999 2024-04-26T07:50:56.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910358+0000", 2024-04-26T07:50:56.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4683000000000001e-05 2024-04-26T07:50:56.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910373+0000", 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5003e-05 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910466+0000", 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3051000000000001e-05 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910844+0000", 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037795800000000002 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.911110+0000", 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000266681 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.924934+0000", 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013823287 2024-04-26T07:50:56.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.933975+0000", 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090409510000000002 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934161+0000", 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186276 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934343+0000", 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018195400000000001 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.977 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2643 3.d e71/17 3:b2fabe62:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_78:head v 71'6, mlcod=59'4)", 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.899893624000001, 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025933037999999999, 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048993+0000", 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.05e-06 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054473+0000", 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054799530000000001 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054509+0000", 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6720000000000001e-05 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054527+0000", 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7643e-05 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054673+0000", 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014575300000000001 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054731+0000", 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8294999999999997e-05 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074792+0000", 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020061208000000001 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074923+0000", 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013041600000000001 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2685 3.2a 3:563d809b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.417712651000002, 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024124367000000001, 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2685 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:50:56.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531175+0000", 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2130000000000002e-06 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535309+0000", 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004133828 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535341+0000", 2024-04-26T07:50:56.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2583000000000003e-05 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535365+0000", 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4244e-05 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535513+0000", 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000147152 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535766+0000", 2024-04-26T07:50:56.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025306800000000001 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.536027+0000", 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000260952 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.546828+0000", 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010801471 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555090+0000", 2024-04-26T07:50:56.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082623200000000001 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555189+0000", 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8157000000000002e-05 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555295+0000", 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010637900000000001 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.987 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2718 3.2a 3:56cbd9c4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.040253307999997, 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025498831999999999, 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2718 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908634+0000", 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7400000000000002e-06 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912808+0000", 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041748089999999998 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912847+0000", 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8367e-05 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912865+0000", 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7886000000000001e-05 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913036+0000", 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017147199999999999 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913465+0000", 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000429071 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913890+0000", 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042477999999999998 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.929103+0000", 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015213344 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.933821+0000", 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047172480000000003 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.934000+0000", 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178872 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.934129+0000", 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129243 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2728 3.1d 3:b8ac35e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.933397112999998, 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026742152000000002, 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.993 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2728 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:56.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015489+0000", 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0900000000000001e-06 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021300+0000", 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058107380000000002 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021350+0000", 2024-04-26T07:50:56.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9775999999999999e-05 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021375+0000", 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5113000000000002e-05 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021530+0000", 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015508199999999999 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021829+0000", 2024-04-26T07:50:56.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029866499999999999 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.022068+0000", 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023948200000000001 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.032120+0000", 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010051579 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:56.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042009+0000", 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0098892019999999997 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042110+0000", 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010163299999999999 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042228+0000", 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117792 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:56.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2765 3.3a 3:5c727248:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.541730360000003, 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029518037, 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:56.999 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2765 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407157+0000", 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5569999999999997e-06 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411821+0000", 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004664021 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411877+0000", 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.588e-05 2024-04-26T07:50:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411904+0000", 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6763000000000001e-05 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412067+0000", 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016272300000000001 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412462+0000", 2024-04-26T07:50:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039559000000000003 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412689+0000", 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022669500000000001 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.430894+0000", 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018205063 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436449+0000", 2024-04-26T07:50:57.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0055546529999999997 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436582+0000", 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013349499999999999 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436671+0000", 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8597000000000006e-05 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2979 3.1d 3:ba9645d5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.153990567000001, 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030394228999999998, 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2979 2024-04-26T07:50:57.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794897+0000", 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2969999999999997e-06 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804170+0000", 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092730629999999998 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804210+0000", 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0426999999999998e-05 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804229+0000", 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.893e-05 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804376+0000", 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014691500000000001 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804637+0000", 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026043799999999999 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804880+0000", 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024350500000000001 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.818402+0000", 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013521574999999999 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825159+0000", 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067568710000000002 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825217+0000", 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8604000000000003e-05 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825287+0000", 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9604000000000006e-05 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2987 3.16 3:689e92b2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:50:57.010 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.033866975999999, 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023936529000000002, 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2987 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:50:57.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915020+0000", 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2830000000000002e-06 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.918997+0000", 2024-04-26T07:50:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039778799999999996 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919037+0000", 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9520000000000001e-05 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919063+0000", 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6539000000000001e-05 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919189+0000", 2024-04-26T07:50:57.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012578200000000001 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919381+0000", 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019129100000000001 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919551+0000", 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169968 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.925721+0000", 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061707120000000001 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938659+0000", 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012937786 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938834+0000", 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017547600000000001 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938953+0000", 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118292 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3279 3.5 3:a273d8b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_294:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.716006416000001, 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027017204999999999, 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.016 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3279 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232880+0000", 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5700000000000001e-06 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237876+0000", 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049959890000000002 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237914+0000", 2024-04-26T07:50:57.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7166000000000003e-05 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237938+0000", 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4559999999999999e-05 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238136+0000", 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000197672 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238418+0000", 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028272200000000001 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238667+0000", 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024804100000000001 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.248432+0000", 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097655169999999996 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259686+0000", 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011253582 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259773+0000", 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7689999999999996e-05 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259894+0000", 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120696 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3310 3.1d 3:bbab4933:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.379459619, 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024852018999999999, 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3310 2024-04-26T07:50:57.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569427+0000", 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3759999999999999e-06 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574227+0000", 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048002490000000004 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574263+0000", 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5366e-05 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574285+0000", 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2802999999999998e-05 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574407+0000", 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121827 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574743+0000", 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033614199999999999 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.575020+0000", 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000276731 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.586811+0000", 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011791322 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594014+0000", 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072022680000000004 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594163+0000", 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149605 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594276+0000", 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011233 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3328 3.1d 3:b9deba7f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_343:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.181896032999999, 2024-04-26T07:50:57.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024014658000000001, 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3328 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766991+0000", 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771175+0000", 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041842210000000001 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771212+0000", 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7499999999999997e-05 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771230+0000", 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7107000000000001e-05 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771350+0000", 2024-04-26T07:50:57.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120109 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771604+0000", 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025427799999999998 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771838+0000", 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234582 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.787185+0000", 2024-04-26T07:50:57.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015346761 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.790664+0000", 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003478933 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.790844+0000", 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017979899999999999 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.791002+0000", 2024-04-26T07:50:57.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015785500000000001 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3337 3.2a 3:5576afd6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.070102188, 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024210850999999999, 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.033 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3337 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878785+0000", 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8e-06 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884461+0000", 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0056765080000000002 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884499+0000", 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8006999999999997e-05 2024-04-26T07:50:57.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884528+0000", 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8215999999999999e-05 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884685+0000", 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015766900000000001 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.885092+0000", 2024-04-26T07:50:57.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040696100000000001 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.885545+0000", 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045240299999999998 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.900806+0000", 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015261082 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902766+0000", 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001959854 2024-04-26T07:50:57.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902868+0000", 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010214500000000001 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902992+0000", 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000124206 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.038 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3358 3.2a 3:5403285b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.840012514, 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044350464999999999, 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3358 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108875+0000", 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5700000000000003e-06 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117074+0000", 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081984469999999993 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117127+0000", 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3359000000000002e-05 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117156+0000", 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9312999999999999e-05 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117376+0000", 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000219946 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117397+0000", 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0449e-05 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131014+0000", 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013617304 2024-04-26T07:50:57.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131236+0000", 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022168200000000001 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131455+0000", 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021913100000000001 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.146752+0000", 2024-04-26T07:50:57.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015297445 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.152923+0000", 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061707869999999996 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.153094+0000", 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017126899999999999 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.153221+0000", 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012676300000000001 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3359 3.3c 3:3d78e8bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.831563662000001, 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.038491746, 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.045 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3359 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:50:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117323+0000", 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0060000000000001e-06 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125017+0000", 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076944609999999997 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125056+0000", 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8819999999999998e-05 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125075+0000", 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9352999999999999e-05 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125215+0000", 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139672 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:50:57.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125234+0000", 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9386999999999999e-05 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131593+0000", 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063589930000000003 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131791+0000", 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019822899999999999 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:50:57.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131988+0000", 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019633500000000001 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.149711+0000", 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017723161000000001 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155565+0000", 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058539200000000003 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155706+0000", 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000141252 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155811+0000", 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105157 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3361 3.36 e80/17 3:6fb653d9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_376:head v 80'20, mlcod=79'18)", 2024-04-26T07:50:57.051 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.792852765999999, 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024761258000000001, 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156031+0000", 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0299999999999999e-07 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159443+0000", 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118960000000002 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159474+0000", 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1495000000000003e-05 2024-04-26T07:50:57.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159491+0000", 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6625000000000001e-05 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159658+0000", 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016732699999999999 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159731+0000", 2024-04-26T07:50:57.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2862999999999997e-05 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.180648+0000", 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020916396 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.180792+0000", 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144053 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3405 3.16 3:68271ef4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_420:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.351511027000001, 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024793686999999998, 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3405 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597377+0000", 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1900000000000003e-06 2024-04-26T07:50:57.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601615+0000", 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042371880000000002 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601654+0000", 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9266e-05 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601672+0000", 2024-04-26T07:50:57.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8406e-05 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601846+0000", 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017330899999999999 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.602257+0000", 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041117399999999999 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.602699+0000", 2024-04-26T07:50:57.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044251700000000002 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.615866+0000", 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013166862999999999 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.621980+0000", 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061141779999999996 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.622082+0000", 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102036 2024-04-26T07:50:57.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.622166+0000", 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3560000000000006e-05 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3414 3.16 3:6ba6e04b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_429:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.256804583999999, 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029030314000000002, 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.061 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3414 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692082+0000", 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1559999999999999e-06 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.696989+0000", 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004907649 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697029+0000", 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.943e-05 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697049+0000", 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0574e-05 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697189+0000", 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013976900000000001 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697460+0000", 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027075800000000001 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697689+0000", 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022929499999999999 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.718106+0000", 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020416863 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.720916+0000", 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002809878 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.721031+0000", 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115153 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.721109+0000", 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7788999999999997e-05 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.066 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3469 3.2f 3:f677d2ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_484:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.487197589000001, 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024085299000000001, 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.067 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3469 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461689+0000", 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4079999999999998e-06 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465469+0000", 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037796190000000001 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465500+0000", 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0877999999999998e-05 2024-04-26T07:50:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465514+0000", 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4405e-05 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465608+0000", 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3826000000000006e-05 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465778+0000", 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016981799999999999 2024-04-26T07:50:57.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465931+0000", 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015329300000000001 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476409+0000", 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01047788 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485459+0000", 2024-04-26T07:50:57.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.009050298 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485638+0000", 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017882900000000001 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485771+0000", 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013304500000000001 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3473 3.16 3:6a1b18ea:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.447360380999999, 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023955699, 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3473 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.073 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501526+0000", 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5669999999999999e-06 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505892+0000", 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043654660000000001 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505925+0000", 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2863e-05 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505942+0000", 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7037e-05 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506114+0000", 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172258 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506485+0000", 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037092199999999998 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506737+0000", 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000252124 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.524617+0000", 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017879674000000002 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525286+0000", 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00066962300000000005 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525402+0000", 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000116119 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525479+0000", 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6045999999999997e-05 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.078 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:57.080 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:50:57.080 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:57.077+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:57.181 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:57.178+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:57.249 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:57.249 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:57.249 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:50:57.249 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:57.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:50:57.303 INFO:tasks.workunit.client.0.smithi053.stderr:200+0 records in 2024-04-26T07:50:57.303 INFO:tasks.workunit.client.0.smithi053.stderr:200+0 records out 2024-04-26T07:50:57.303 INFO:tasks.workunit.client.0.smithi053.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.1178 s, 160 MB/s 2024-04-26T07:50:57.307 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:57.306+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:57.360 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:50:57.383 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:57.382+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:57.434 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:57.435 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:50:57.435 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:50:57.435 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:50:57.435 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:57.450 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:50:57.472 INFO:tasks.workunit.client.0.smithi053.stdout:Bucket Created: buck_2024_03_26_07_50_57 2024-04-26T07:50:57.484 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:50:57.481+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:50:57.511 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:57.511 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:57.530 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:57.530 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:57.549 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:57.550 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:57.569 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:57.569 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:57.585 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:57.581+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:57.590 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:57.591 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:57.611 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:50:57.611 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:50:57.629 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:50:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:50:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:50:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:50:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 148.06911921700001, 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:50:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2102 3.35 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:50:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.380404440000007, 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025241564000000001, 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2102 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246463+0000", 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.106e-06 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252299+0000", 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058363080000000001 2024-04-26T07:50:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252331+0000", 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1914e-05 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252346+0000", 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4829e-05 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252506+0000", 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015995500000000001 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252872+0000", 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000365817 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253249+0000", 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037744100000000001 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271215+0000", 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017965979 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271568+0000", 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035317600000000002 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271630+0000", 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1853000000000006e-05 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271701+0000", 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1186000000000006e-05 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2218 3.34 e59/17 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head v 59'2, mlcod=0'0)", 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 75.591128707999999, 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030663971000000002, 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035737+0000", 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0869999999999999e-06 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039593+0000", 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038566609999999999 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039642+0000", 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8699999999999998e-05 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:50:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7350000000000001e-05 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039870+0000", 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020093199999999999 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039931+0000", 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1294e-05 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066342+0000", 2024-04-26T07:50:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026410869 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066399+0000", 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7077999999999998e-05 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2242 3.2c 3:3494587f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 75.306005209999995, 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023803956000000001, 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2242 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320862+0000", 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326077+0000", 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052153720000000002 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326119+0000", 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1112999999999998e-05 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326139+0000", 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9962999999999998e-05 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326237+0000", 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8110999999999996e-05 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326355+0000", 2024-04-26T07:50:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011791200000000001 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326459+0000", 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010489600000000001 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338991+0000", 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012531967 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344349+0000", 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053576589999999999 2024-04-26T07:50:57.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344529+0000", 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179958 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344663+0000", 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013385 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.651 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2642 3.26 3:660978ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 39.593994273, 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028089177, 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2642 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032873+0000", 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4599999999999999e-06 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038900+0000", 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060268300000000004 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038936+0000", 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5469999999999998e-05 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038954+0000", 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7903000000000001e-05 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039143+0000", 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000189118 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039587+0000", 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000444027 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039995+0000", 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040862100000000002 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.050770+0000", 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010774327 2024-04-26T07:50:57.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060672+0000", 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099018999999999999 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060837+0000", 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000165885 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060959+0000", 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121636 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2653 3.35 3:af769224:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 39.473356283999998, 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025812589, 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.657 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2653 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:50:57.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153512+0000", 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1189999999999999e-06 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158218+0000", 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047056720000000002 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158268+0000", 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0319999999999999e-05 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158299+0000", 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1189000000000002e-05 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158465+0000", 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016535899999999999 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158802+0000", 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033700800000000002 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159078+0000", 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027675200000000001 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179029+0000", 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019950658999999999 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179143+0000", 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000114245 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179234+0000", 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0305999999999999e-05 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179320+0000", 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6959999999999994e-05 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.662 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2670 3.a 3:530171a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 39.277820142000003, 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024254465999999999, 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2670 2024-04-26T07:50:57.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349047+0000", 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3969999999999998e-06 2024-04-26T07:50:57.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.352981+0000", 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039336040000000003 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353021+0000", 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9932999999999999e-05 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353041+0000", 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9755999999999999e-05 2024-04-26T07:50:57.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353179+0000", 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013804600000000001 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353464+0000", 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000285335 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353706+0000", 2024-04-26T07:50:57.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024165499999999999 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.362865+0000", 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00915967 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.372976+0000", 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010110472000000001 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.373155+0000", 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179469 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.373298+0000", 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000143129 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2706 3.26 3:6727925e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.783490+0000", 2024-04-26T07:50:57.668 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.843374226000002, 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023799429, 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2706 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.783490+0000", 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.783490+0000", 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.783494+0000", 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.614e-06 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.790549+0000", 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070554550000000004 2024-04-26T07:50:57.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.790605+0000", 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6175999999999999e-05 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.790635+0000", 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9490000000000001e-05 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.790854+0000", 2024-04-26T07:50:57.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021968199999999999 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.791214+0000", 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035932 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.791533+0000", 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031918799999999998 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.803893+0000", 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01235985 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.807117+0000", 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032242920000000001 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.807213+0000", 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5558999999999998e-05 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.807289+0000", 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6803000000000003e-05 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2798 3.26 3:65c1d500:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.880036580000002, 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026073496000000002, 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.674 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2798 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:50:57.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746831+0000", 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7270000000000001e-06 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.751974+0000", 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051423550000000004 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752019+0000", 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5729999999999998e-05 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752046+0000", 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6838999999999998e-05 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752177+0000", 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013056999999999999 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752428+0000", 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250871 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752665+0000", 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023739799999999999 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.761126+0000", 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008461049 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772651+0000", 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011525262999999999 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772796+0000", 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144382 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772901+0000", 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105312 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2799 3.26 3:67acbf7d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.869412242999999, 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026954779000000002, 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2799 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757456+0000", 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5999999999999998e-06 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.764926+0000", 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074704230000000003 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.764973+0000", 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6922999999999998e-05 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765002+0000", 2024-04-26T07:50:57.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9203000000000001e-05 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765131+0000", 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012904299999999999 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765396+0000", 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026475799999999997 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765656+0000", 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025973499999999998 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.774155+0000", 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084992799999999997 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784112+0000", 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099569930000000008 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784289+0000", 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017662799999999999 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784407+0000", 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118193 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.685 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2806 3.35 3:ad99b9ab:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.796199454000003, 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025789340000000001, 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2806 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830686+0000", 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1763000000000002e-05 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835651+0000", 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049641529999999998 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835681+0000", 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9967e-05 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835699+0000", 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8065999999999999e-05 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835867+0000", 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016876200000000001 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.836266+0000", 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039829500000000001 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.836707+0000", 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044176000000000003 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.847725+0000", 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011017506 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856182+0000", 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084570960000000008 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856349+0000", 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000166439 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856454+0000", 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010553299999999999 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2976 3.2c 3:37a6e58a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.873309896999999, 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027636029999999999, 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.691 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2976 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753557+0000", 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759271+0000", 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057135069999999996 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759308+0000", 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7555999999999998e-05 2024-04-26T07:50:57.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759327+0000", 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8277000000000001e-05 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759492+0000", 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016504900000000001 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759922+0000", 2024-04-26T07:50:57.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042981300000000003 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.760383+0000", 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000461201 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.773654+0000", 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013270929000000001 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.780865+0000", 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072115970000000001 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.781051+0000", 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186109 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.781190+0000", 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013895199999999999 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3304 3.36 3:6d1acc3e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_319:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.121041433999999, 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029248973000000001, 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3304 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.697 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505827+0000", 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0439999999999997e-06 2024-04-26T07:50:57.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511763+0000", 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059365820000000001 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511802+0000", 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8296000000000001e-05 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511820+0000", 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377e-05 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511984+0000", 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016365600000000001 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.512397+0000", 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041346699999999999 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.512819+0000", 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042219000000000002 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.525450+0000", 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01263016 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.534770+0000", 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093202330000000007 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.534938+0000", 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000168245 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.535072+0000", 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013372300000000001 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3323 3.2c 3:37b6bfd3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_338:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.918520054, 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023969408000000001, 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.702 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3323 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:50:57.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708347+0000", 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.14e-06 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712309+0000", 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039621760000000004 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712348+0000", 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8386000000000001e-05 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712367+0000", 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9216999999999999e-05 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712506+0000", 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013908900000000001 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712779+0000", 2024-04-26T07:50:57.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027279799999999999 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.713020+0000", 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024111799999999999 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.722732+0000", 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097123969999999994 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732000+0000", 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092674999999999997 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732175+0000", 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017472200000000001 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732314+0000", 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013886500000000001 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3349 3.2c 3:35dd8e5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_364:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.622953634, 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025879333000000001, 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3349 2024-04-26T07:50:57.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003913+0000", 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5469999999999999e-06 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.007957+0000", 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040434219999999996 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.007988+0000", 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1473000000000002e-05 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008006+0000", 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7810000000000001e-05 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008139+0000", 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133602 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008409+0000", 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026979899999999998 2024-04-26T07:50:57.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008654+0000", 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024439200000000001 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.018119+0000", 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0094655439999999993 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029492+0000", 2024-04-26T07:50:57.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011372996 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029660+0000", 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016761200000000001 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029790+0000", 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013013599999999999 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3361 3.36 3:6fb653d9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_376:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.489736042000001, 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044308437999999999, 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3361 2024-04-26T07:50:57.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137134+0000", 2024-04-26T07:50:57.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6130000000000003e-06 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144821+0000", 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076868769999999999 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144872+0000", 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.134e-05 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144897+0000", 2024-04-26T07:50:57.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5347e-05 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.145083+0000", 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000185298 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.145101+0000", 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8026999999999999e-05 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155170+0000", 2024-04-26T07:50:57.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010069794 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155500+0000", 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032923400000000003 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155731+0000", 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000231478 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179162+0000", 2024-04-26T07:50:57.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023431110000000002 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181138+0000", 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001975367 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181295+0000", 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157742 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181437+0000", 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000141211 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3366 3.35 3:ae42cef6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_381:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.433787253, 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024877366000000001, 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.720 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3366 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:50:57.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193081+0000", 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6569999999999999e-06 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198183+0000", 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051024069999999998 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198218+0000", 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5240000000000001e-05 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198244+0000", 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.563e-05 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198366+0000", 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121758 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198662+0000", 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029598999999999999 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198924+0000", 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026244300000000001 2024-04-26T07:50:57.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.216160+0000", 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017236006000000002 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217729+0000", 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001568896 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217872+0000", 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000143382 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217954+0000", 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1957000000000002e-05 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3376 3.a 3:52d883ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_391:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.326742989, 2024-04-26T07:50:57.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030462698, 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3376 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300125+0000", 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2339999999999996e-06 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306292+0000", 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006166721 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306332+0000", 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9888999999999997e-05 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306351+0000", 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8997000000000001e-05 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306477+0000", 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012618199999999999 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306761+0000", 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000283789 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307034+0000", 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027255399999999999 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.320094+0000", 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013060024 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330404+0000", 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010310685 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330506+0000", 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101686 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330584+0000", 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7936999999999996e-05 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3425 3.36 3:6fcd7b97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_440:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.817399548000001, 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029676536, 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3425 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809468+0000", 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3830000000000001e-06 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.813970+0000", 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045021530000000001 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814022+0000", 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2160000000000002e-05 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814043+0000", 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0472999999999999e-05 2024-04-26T07:50:57.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814184+0000", 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000140822 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814448+0000", 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026465499999999998 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:57.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814760+0000", 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031151799999999999 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.838297+0000", 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023537215 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.838927+0000", 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00063033200000000005 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.839021+0000", 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4018999999999995e-05 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.839141+0000", 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119806 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3470 3.36 3:6ccc0563:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_485:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:50:57.737 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.155674937000001, 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02579234, 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3470 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471192+0000", 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.357e-06 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475395+0000", 2024-04-26T07:50:57.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042034380000000003 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475446+0000", 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0726000000000002e-05 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475472+0000", 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6693e-05 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:50:57.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475663+0000", 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019097600000000001 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476091+0000", 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042763399999999998 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476528+0000", 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043667000000000001 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.492375+0000", 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015847421 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496686+0000", 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043108030000000002 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496846+0000", 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000159739 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:50:57.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496982+0000", 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135883 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:50:57.743 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:50:57.744 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:50:57.745 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:50:57.745 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:50:57.746 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:50:57.746 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:57.742+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:57.747 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:50:57.747 INFO:tasks.workunit.client.0.smithi053.stdout:bucket quota max size set for the given user: buck_2024_03_26_07_50_57 2024-04-26T07:50:57.845 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:57.841+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:57.920 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:57.920 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:57.934 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:50:57.946 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:57.941+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:57.995 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T07:50:58.047 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:58.041+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:58.055 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:58.055 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:58.070 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:50:58.147 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:58.145+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:58.188 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:58.188 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:58.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:50:58.248 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:58.245+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:58.329 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:58.329 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:58.342 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:50:58.383 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:58.381+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:58.450 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:58.450+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:58.496 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:58.496 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:58.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:50:58.555 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:58.553+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:58.640 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:58.641 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:58.652 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:58.650+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:58.654 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:50:58.753 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:58.749+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:58.812 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:58.812 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:58.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:50:58.867 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:58.865+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:58.955 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:58.953+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:58.962 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is set 2024-04-26T07:50:58.986 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:58.986 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:58.999 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:50:59.056 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:59.054+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:59.158 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:59.158 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:59.159 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:59.158+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:59.169 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:50:59.260 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:59.257+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:59.300 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:59.300 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:59.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:50:59.363 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:50:59.362+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:50:59.463 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:59.461+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:59.470 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:59.470 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:59.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:50:59.571 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:50:59.569+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:50:59.658 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:59.658 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:59.666 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:50:59.662+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:50:59.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:50:59.748 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:50:59.769 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:50:59.766+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:50:59.845 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:50:59.846 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:50:59.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:50:59.907 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:50:59.905+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:50:59.909 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:50:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:50:59.925 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:50:59.925 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:50:59.943 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:50:59.943 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:50:59.959 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:50:59.960 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:50:59.968 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:50:59.965+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:50:59.981 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:50:59.981 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [], 2024-04-26T07:50:59.981 INFO:teuthology.orchestra.run.smithi053.stdout: "complaint_time": 30, 2024-04-26T07:50:59.981 INFO:teuthology.orchestra.run.smithi053.stdout: "num_blocked_ops": 0 2024-04-26T07:50:59.981 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:50:59.982 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:50:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:50:59.995 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:51:00.002 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:51:00.003 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:51:00.022 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:51:00.023 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:51:00.044 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:51:00.044 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:51:00.103 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:00.101+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:00.117 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:51:00.117 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:51:00.117 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:51:00.117 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:51:00.117 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 79.841467550999994, 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:51:00.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:51:00.120 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.122 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 79.201190858999993, 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.124 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:51:00.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:51:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:51:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.126 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.127 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.128 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.129 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 77.816371175, 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.130 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:51:00.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:51:00.133 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.134 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.135 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.281296241, 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.136 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.137 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:51:00.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:51:00.139 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.140 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 42.064613704000003, 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.142 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.143 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.144 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:51:00.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:51:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2710 3.33 3:cc717f28:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_145:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.291894024000001, 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020420134, 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2710 2024-04-26T07:51:00.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823307+0000", 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.149 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.823309+0000", 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.756e-06 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.824981+0000", 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016720070000000001 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825006+0000", 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4791e-05 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.150 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825016+0000", 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8090000000000004e-06 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825093+0000", 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.6939000000000003e-05 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825249+0000", 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000155759 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.151 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.825359+0000", 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00010990200000000001 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.830001+0000", 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0046423139999999998 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843620+0000", 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013618865000000001 2024-04-26T07:51:00.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843680+0000", 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9871999999999999e-05 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.843727+0000", 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7120000000000003e-05 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.153 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.218241069999998, 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.154 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:51:00.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:51:00.156 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.157 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.158 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.159 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.189535841999998, 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.160 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.161 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.162 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:51:00.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:51:00.164 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.156715276, 2024-04-26T07:51:00.165 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.166 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:51:00.167 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.168 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.169 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.170 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 41.122921472000002, 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.171 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.172 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.173 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:51:00.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:51:00.176 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.885169548999997, 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.177 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:51:00.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:51:00.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.831762636000001, 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.183 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:51:00.184 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.185 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.186 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:51:00.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.188 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 40.421176805000002, 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:51:00.190 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:51:00.191 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.192 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.193 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3300 3.33 3:cd50c5f5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_315:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:00.194 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 18.65693615, 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022987548999999999, 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3300 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.195 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458268+0000", 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.021e-06 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.196 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459957+0000", 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016889120000000001 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459981+0000", 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4406e-05 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459994+0000", 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2680000000000001e-05 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.197 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460079+0000", 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5614999999999999e-05 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460283+0000", 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000204172 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460467+0000", 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183919 2024-04-26T07:51:00.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.465999+0000", 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055315850000000003 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481141+0000", 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015142375 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481204+0000", 2024-04-26T07:51:00.199 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3048999999999999e-05 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481252+0000", 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7815000000000002e-05 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3365 3.33 3:cf6f73fa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_380:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.935013331, 2024-04-26T07:51:00.200 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022536079000000001, 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3365 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180191+0000", 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0860000000000004e-06 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182593+0000", 2024-04-26T07:51:00.202 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024014539999999999 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182622+0000", 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9111e-05 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182634+0000", 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2149e-05 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.203 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182715+0000", 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0945999999999994e-05 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182913+0000", 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019779300000000001 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.183094+0000", 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018092999999999999 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.204 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.190830+0000", 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077362419999999999 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202632+0000", 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011801416 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202669+0000", 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7394000000000001e-05 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.205 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202723+0000", 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4558000000000002e-05 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3372 3.29 3:97c5a4e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.86260893, 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020672864999999999, 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.206 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3372 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:51:00.207 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252596+0000", 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2989999999999998e-06 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253876+0000", 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001279493 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.208 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253904+0000", 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8022999999999999e-05 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253915+0000", 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1878e-05 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254002+0000", 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6528999999999998e-05 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254171+0000", 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168486 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254325+0000", 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000154821 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.258909+0000", 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045840589999999997 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273124+0000", 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014214536 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273179+0000", 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4598000000000001e-05 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273265+0000", 2024-04-26T07:51:00.211 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6143000000000005e-05 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3401 3.29 3:94e99a5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.563604508000001, 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022448046999999999, 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.212 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3401 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.213 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551599+0000", 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1999999999999999e-06 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553183+0000", 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015834829999999999 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553216+0000", 2024-04-26T07:51:00.214 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2663000000000002e-05 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553232+0000", 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6612999999999998e-05 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553321+0000", 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8941000000000001e-05 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.215 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553484+0000", 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162554 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553616+0000", 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013222700000000001 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.558023+0000", 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044068570000000001 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.216 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573919+0000", 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015896100999999999 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573991+0000", 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1950000000000001e-05 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.574044+0000", 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3458000000000002e-05 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.217 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3406 3.27 3:e585af2f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_421:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.512293994, 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020601642999999999, 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.218 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3406 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602907+0000", 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.219 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.602909+0000", 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.6819999999999999e-06 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604530+0000", 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016205550000000001 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604555+0000", 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5392999999999999e-05 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.220 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604566+0000", 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.0400999999999999e-05 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604634+0000", 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7762999999999995e-05 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604752+0000", 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000118268 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.221 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.604888+0000", 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000136601 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.609679+0000", 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0047901300000000001 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623360+0000", 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013681125000000001 2024-04-26T07:51:00.222 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623442+0000", 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.2208999999999998e-05 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.623508+0000", 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.6515999999999998e-05 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.223 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3424 3.2 3:422e52f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_439:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 17.319653118000002, 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021648288000000002, 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3424 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.224 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795550+0000", 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.199e-06 2024-04-26T07:51:00.225 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797322+0000", 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017720329999999999 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797353+0000", 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1390000000000003e-05 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797366+0000", 2024-04-26T07:51:00.226 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3027000000000001e-05 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797436+0000", 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9306000000000004e-05 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797578+0000", 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014246699999999999 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797702+0000", 2024-04-26T07:51:00.227 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124354 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.802182+0000", 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004479841 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817086+0000", 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014903506 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.228 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817141+0000", 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5207999999999997e-05 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817196+0000", 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4957000000000003e-05 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3457 3.29 3:975e30a2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_472:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 16.859397806, 2024-04-26T07:51:00.229 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021210401, 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3457 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255808+0000", 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1769999999999997e-06 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258946+0000", 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00313766 2024-04-26T07:51:00.231 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258989+0000", 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3452999999999999e-05 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259009+0000", 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9516000000000001e-05 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259161+0000", 2024-04-26T07:51:00.232 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151824 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259410+0000", 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024946099999999998 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259694+0000", 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028413400000000001 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.267979+0000", 2024-04-26T07:51:00.233 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082847070000000005 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276888+0000", 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089093169999999999 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276946+0000", 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7438999999999997e-05 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:00.234 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.277013+0000", 2024-04-26T07:51:00.235 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7712999999999994e-05 2024-04-26T07:51:00.235 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.235 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.235 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.235 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:00.235 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:00.235 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:51:00.236 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:51:00.237 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:00.233+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:00.338 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:00.333+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:00.362 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:51:00.362 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:00.376 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:51:00.439 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:00.438+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:00.494 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:00.494 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:00.494 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:51:00.494 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:51:00.494 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:00.508 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:51:00.540 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:00.537+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:00.641 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:00.637+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:00.679 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:00.679 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:51:00.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:51:00.679 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 92.462174640000001, 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.680 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:51:00.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:00.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2151 3.1a 3:5b50bb71:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:51:00.685 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 79.634746304000004, 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022957264000000002, 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2151 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042833+0000", 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.042836+0000", 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9129999999999999e-06 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046670+0000", 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038342659999999998 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046697+0000", 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6985e-05 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046708+0000", 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1224e-05 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046793+0000", 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4998000000000002e-05 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.046931+0000", 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013786000000000001 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 1", 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.047062+0000", 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013063199999999999 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.054354+0000", 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072921879999999998 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065656+0000", 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011302559 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065730+0000", 2024-04-26T07:51:00.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3399999999999995e-05 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.065790+0000", 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0238999999999997e-05 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.784164395000005, 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:51:00.691 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:00.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.647591821000006, 2024-04-26T07:51:00.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:51:00.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.304126733000004, 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.703 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:51:00.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:51:00.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2650 3.9 3:910fae93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.557133327999999, 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026997720999999999, 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2650 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120449+0000", 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.213e-06 2024-04-26T07:51:00.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126814+0000", 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063646370000000002 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126859+0000", 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5769999999999997e-05 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126881+0000", 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1226999999999999e-05 2024-04-26T07:51:00.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127062+0000", 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018148799999999999 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127473+0000", 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041101799999999997 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127939+0000", 2024-04-26T07:51:00.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046579999999999999 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.142532+0000", 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014592818 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147212+0000", 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046805379999999997 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147317+0000", 2024-04-26T07:51:00.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104706 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147444+0000", 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126506 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2651 3.34 3:2e652162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.544981077000003, 2024-04-26T07:51:00.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026435427000000001, 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2651 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132621+0000", 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2677e-05 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140045+0000", 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074240269999999997 2024-04-26T07:51:00.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140075+0000", 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0159999999999999e-05 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140090+0000", 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.485e-05 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140253+0000", 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162752 2024-04-26T07:51:00.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140492+0000", 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023908800000000001 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140712+0000", 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022059900000000001 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.156194+0000", 2024-04-26T07:51:00.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015481818 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158759+0000", 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025644750000000001 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158920+0000", 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016169000000000001 2024-04-26T07:51:00.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159033+0000", 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113291 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2652 3.f e71/17 3:f0cf4464:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_87:head v 71'6, mlcod=59'4)", 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.522947899000002, 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025327902999999999, 2024-04-26T07:51:00.720 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154635+0000", 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4199999999999999e-06 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159003+0000", 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043688370000000004 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159072+0000", 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8546000000000004e-05 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159104+0000", 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2283999999999998e-05 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159252+0000", 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014761200000000001 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159318+0000", 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6248999999999995e-05 2024-04-26T07:51:00.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179858+0000", 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020539973 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179959+0000", 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100982 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2660 3.1b e71/17 3:d80c6e1b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_95:head v 71'5, mlcod=59'3)", 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.448805786000001, 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023049618000000001, 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228773+0000", 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.228775+0000", 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.75e-06 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236455+0000", 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076795539999999999 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236485+0000", 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9923000000000001e-05 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236501+0000", 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6317e-05 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236642+0000", 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014074899999999999 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.236688+0000", 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6106000000000002e-05 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251724+0000", 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015035935 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.251823+0000", 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9283999999999993e-05 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.728 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2717 3.24 e71/17 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head v 71'14, mlcod=71'12)", 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 41.776682569999998, 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024784816000000001, 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900899+0000", 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907332+0000", 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064328529999999997 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907367+0000", 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4966999999999999e-05 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907397+0000", 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0392999999999999e-05 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907551+0000", 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015379900000000001 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907597+0000", 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639000000000001e-05 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925587+0000", 2024-04-26T07:51:00.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017990055000000001 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925681+0000", 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4696000000000003e-05 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2764 3.34 3:2e573a11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 41.283148728999997, 2024-04-26T07:51:00.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031072567999999998, 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2764 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:51:00.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394434+0000", 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4240000000000002e-06 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400673+0000", 2024-04-26T07:51:00.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062394210000000002 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400724+0000", 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1175999999999999e-05 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400760+0000", 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5123000000000002e-05 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400955+0000", 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019514900000000001 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401423+0000", 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046833999999999998 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401840+0000", 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041720800000000002 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.423203+0000", 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021362641000000002 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425243+0000", 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020403420000000001 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425403+0000", 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015975599999999999 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425503+0000", 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9988000000000006e-05 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2980 3.34 3:2c27af06:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.863535557999999, 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023940217999999999, 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.739 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2980 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:51:00.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814047+0000", 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.49e-06 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820559+0000", 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065114609999999996 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820595+0000", 2024-04-26T07:51:00.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6919999999999999e-05 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820614+0000", 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9017000000000001e-05 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820759+0000", 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014448600000000001 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821025+0000", 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026618799999999999 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821281+0000", 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000255388 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837756+0000", 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016475019 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837825+0000", 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9529999999999993e-05 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837913+0000", 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8418000000000006e-05 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837984+0000", 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0301000000000003e-05 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2988 3.f e78/17 3:f2e60fa8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_13:head v 78'11, mlcod=72'9)", 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.748024300000001, 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025247141000000001, 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929557+0000", 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.812e-06 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932701+0000", 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031440909999999999 2024-04-26T07:51:00.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932727+0000", 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6485000000000001e-05 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932740+0000", 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2899e-05 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932846+0000", 2024-04-26T07:51:00.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106261 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932884+0000", 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7150000000000002e-05 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954658+0000", 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021774803999999998 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954802+0000", 2024-04-26T07:51:00.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014363900000000001 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3038 3.14 3:2b0c4970:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.165150271999998, 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02413448, 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.749 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3038 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512431+0000", 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0219999999999999e-06 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516443+0000", 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040121369999999998 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516479+0000", 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5921999999999999e-05 2024-04-26T07:51:00.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516498+0000", 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9434999999999999e-05 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516594+0000", 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5626999999999998e-05 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516761+0000", 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016746900000000001 2024-04-26T07:51:00.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516919+0000", 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157613 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.532325+0000", 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015405785 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536276+0000", 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039511859999999998 2024-04-26T07:51:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536433+0000", 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000156751 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536563+0000", 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013053300000000001 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3295 3.e e79/17 3:72febd94:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_310:head v 79'12, mlcod=71'10)", 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.260121024, 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023400582999999999, 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417458+0000", 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.417461+0000", 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.886e-06 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425407+0000", 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079463720000000002 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425450+0000", 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2827000000000002e-05 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425475+0000", 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5276999999999999e-05 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425638+0000", 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016255499999999999 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.425684+0000", 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6226000000000001e-05 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440766+0000", 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015081776999999999 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.440859+0000", 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2663000000000004e-05 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.758 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3312 3.14 3:28d42ed8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.089243599, 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02506968, 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3312 2024-04-26T07:51:00.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588339+0000", 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8139999999999998e-06 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593503+0000", 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051636939999999999 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593552+0000", 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8644999999999999e-05 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593575+0000", 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3694999999999999e-05 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593721+0000", 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014558099999999999 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594030+0000", 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000309084 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:00.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594362+0000", 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033205799999999998 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.602982+0000", 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086194410000000003 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613081+0000", 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010099385000000001 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613235+0000", 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153936 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613405+0000", 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170347 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3362 3.3 3:c21c3c88:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.527040900999999, 2024-04-26T07:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027051006999999998, 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3362 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:51:00.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150542+0000", 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4230000000000001e-06 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155196+0000", 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046542240000000002 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155241+0000", 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5188000000000002e-05 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155264+0000", 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3243000000000001e-05 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155429+0000", 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016474099999999999 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155798+0000", 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036913799999999997 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156167+0000", 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036868699999999998 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177139+0000", 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020971996999999999 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177402+0000", 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026307499999999998 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177513+0000", 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110862 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177589+0000", 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6428999999999996e-05 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3364 3.9 3:93973eda:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_379:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.504594222000001, 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023680673999999999, 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.770 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3364 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172989+0000", 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7479999999999999e-06 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178348+0000", 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053593870000000002 2024-04-26T07:51:00.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178375+0000", 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6948e-05 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178395+0000", 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9746e-05 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178680+0000", 2024-04-26T07:51:00.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028477199999999998 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179097+0000", 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041771700000000001 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179312+0000", 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021453499999999999 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.194902+0000", 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015590530999999999 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196474+0000", 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015717610000000001 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196592+0000", 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118139 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196666+0000", 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.339e-05 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3376 3.a e80/17 3:52d883ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_391:head v 80'14, mlcod=79'12)", 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.370241768, 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022696129999999998, 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307337+0000", 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307338+0000", 2024-04-26T07:51:00.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8299999999999997e-07 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310209+0000", 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028707699999999999 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310255+0000", 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5872999999999999e-05 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310283+0000", 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8013000000000001e-05 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310455+0000", 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017232900000000001 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.310519+0000", 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633000000000006e-05 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.329934+0000", 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019415536000000001 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330033+0000", 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9393000000000002e-05 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3400 3.e e80/17 3:72fd7c3d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_415:head v 80'16, mlcod=80'14)", 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:51:00.780 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.125018973, 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.022514756, 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552560+0000", 2024-04-26T07:51:00.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.552562+0000", 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.176e-06 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555476+0000", 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0029136040000000002 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555511+0000", 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4832999999999997e-05 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555528+0000", 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7580000000000001e-05 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555693+0000", 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016455500000000001 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.555761+0000", 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7875999999999999e-05 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575001+0000", 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019240295000000001 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.575075+0000", 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3837000000000005e-05 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.784 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:00.785 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:00.785 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:00.786 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:51:00.787 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:00.786+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:00.887 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:00.885+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:00.961 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:00.961 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:00.961 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:51:00.962 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:00.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:51:00.988 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:00.985+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:00.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T07:51:01.089 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:01.085+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:01.101 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:01.101 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:01.101 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:51:01.101 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:51:01.102 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:01.117 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:51:01.190 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:01.185+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2204 3.5 3:a294f995:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 79.362919227000006, 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.03032317, 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.247 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2204 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881994+0000", 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6330000000000002e-06 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888238+0000", 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062439069999999999 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888280+0000", 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2231999999999998e-05 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888305+0000", 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5060000000000001e-05 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888469+0000", 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016422499999999999 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888479+0000", 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.008e-05 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.894701+0000", 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062219969999999999 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895063+0000", 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036214800000000002 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895429+0000", 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036549400000000001 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.909795+0000", 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014366191 2024-04-26T07:51:01.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912173+0000", 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023778330000000002 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912250+0000", 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6736000000000005e-05 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912313+0000", 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633999999999994e-05 2024-04-26T07:51:01.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2206 3.16 3:6a8f0fb0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 79.339010395000003, 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028443779999999998, 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2206 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905902+0000", 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9059999999999998e-06 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910333+0000", 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044310299999999999 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910358+0000", 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4683000000000001e-05 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910373+0000", 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5003e-05 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910466+0000", 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3051000000000001e-05 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910844+0000", 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037795800000000002 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.911110+0000", 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000266681 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.924934+0000", 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013823287 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.933975+0000", 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090409510000000002 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934161+0000", 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186276 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934343+0000", 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018195400000000001 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.259 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2643 3.d e71/17 3:b2fabe62:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_78:head v 71'6, mlcod=59'4)", 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.195919791000001, 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025933037999999999, 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048993+0000", 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.05e-06 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054473+0000", 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054799530000000001 2024-04-26T07:51:01.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054509+0000", 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6720000000000001e-05 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054527+0000", 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7643e-05 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054673+0000", 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014575300000000001 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054731+0000", 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8294999999999997e-05 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074792+0000", 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020061208000000001 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074923+0000", 2024-04-26T07:51:01.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013041600000000001 2024-04-26T07:51:01.264 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.264 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.264 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.264 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2685 3.2a 3:563d809b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:01.265 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:51:01.265 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.713738818000003, 2024-04-26T07:51:01.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024124367000000001, 2024-04-26T07:51:01.265 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.265 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.265 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.265 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.266 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.266 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.266 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2685 2024-04-26T07:51:01.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.266 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:51:01.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:51:01.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531175+0000", 2024-04-26T07:51:01.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2130000000000002e-06 2024-04-26T07:51:01.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535309+0000", 2024-04-26T07:51:01.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004133828 2024-04-26T07:51:01.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535341+0000", 2024-04-26T07:51:01.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2583000000000003e-05 2024-04-26T07:51:01.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535365+0000", 2024-04-26T07:51:01.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4244e-05 2024-04-26T07:51:01.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535513+0000", 2024-04-26T07:51:01.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000147152 2024-04-26T07:51:01.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535766+0000", 2024-04-26T07:51:01.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025306800000000001 2024-04-26T07:51:01.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.536027+0000", 2024-04-26T07:51:01.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000260952 2024-04-26T07:51:01.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.546828+0000", 2024-04-26T07:51:01.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010801471 2024-04-26T07:51:01.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555090+0000", 2024-04-26T07:51:01.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082623200000000001 2024-04-26T07:51:01.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555189+0000", 2024-04-26T07:51:01.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8157000000000002e-05 2024-04-26T07:51:01.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555295+0000", 2024-04-26T07:51:01.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010637900000000001 2024-04-26T07:51:01.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.276 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.277 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2718 3.2a 3:56cbd9c4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:01.277 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:51:01.277 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.336279474999998, 2024-04-26T07:51:01.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025498831999999999, 2024-04-26T07:51:01.278 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.278 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.278 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.278 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.278 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.278 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.279 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2718 2024-04-26T07:51:01.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.279 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:51:01.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:51:01.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908634+0000", 2024-04-26T07:51:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7400000000000002e-06 2024-04-26T07:51:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912808+0000", 2024-04-26T07:51:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041748089999999998 2024-04-26T07:51:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912847+0000", 2024-04-26T07:51:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8367e-05 2024-04-26T07:51:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912865+0000", 2024-04-26T07:51:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7886000000000001e-05 2024-04-26T07:51:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913036+0000", 2024-04-26T07:51:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017147199999999999 2024-04-26T07:51:01.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913465+0000", 2024-04-26T07:51:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000429071 2024-04-26T07:51:01.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913890+0000", 2024-04-26T07:51:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042477999999999998 2024-04-26T07:51:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.929103+0000", 2024-04-26T07:51:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015213344 2024-04-26T07:51:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.933821+0000", 2024-04-26T07:51:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047172480000000003 2024-04-26T07:51:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.934000+0000", 2024-04-26T07:51:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178872 2024-04-26T07:51:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.934129+0000", 2024-04-26T07:51:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129243 2024-04-26T07:51:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2728 3.1d 3:b8ac35e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:01.290 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:51:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.229423279999999, 2024-04-26T07:51:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026742152000000002, 2024-04-26T07:51:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.291 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2728 2024-04-26T07:51:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:51:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:51:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015489+0000", 2024-04-26T07:51:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0900000000000001e-06 2024-04-26T07:51:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021300+0000", 2024-04-26T07:51:01.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058107380000000002 2024-04-26T07:51:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021350+0000", 2024-04-26T07:51:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9775999999999999e-05 2024-04-26T07:51:01.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021375+0000", 2024-04-26T07:51:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5113000000000002e-05 2024-04-26T07:51:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021530+0000", 2024-04-26T07:51:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015508199999999999 2024-04-26T07:51:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021829+0000", 2024-04-26T07:51:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029866499999999999 2024-04-26T07:51:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.022068+0000", 2024-04-26T07:51:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023948200000000001 2024-04-26T07:51:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.032120+0000", 2024-04-26T07:51:01.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010051579 2024-04-26T07:51:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042009+0000", 2024-04-26T07:51:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0098892019999999997 2024-04-26T07:51:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042110+0000", 2024-04-26T07:51:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010163299999999999 2024-04-26T07:51:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042228+0000", 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117792 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2765 3.3a 3:5c727248:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 41.837756527000003, 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029518037, 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.303 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2765 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407157+0000", 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5569999999999997e-06 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411821+0000", 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004664021 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411877+0000", 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.588e-05 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411904+0000", 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6763000000000001e-05 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412067+0000", 2024-04-26T07:51:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016272300000000001 2024-04-26T07:51:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412462+0000", 2024-04-26T07:51:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039559000000000003 2024-04-26T07:51:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:51:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412689+0000", 2024-04-26T07:51:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022669500000000001 2024-04-26T07:51:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.430894+0000", 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018205063 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436449+0000", 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0055546529999999997 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436582+0000", 2024-04-26T07:51:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013349499999999999 2024-04-26T07:51:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436671+0000", 2024-04-26T07:51:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8597000000000006e-05 2024-04-26T07:51:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2979 3.1d 3:ba9645d5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:51:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.450016733999998, 2024-04-26T07:51:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030394228999999998, 2024-04-26T07:51:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2979 2024-04-26T07:51:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:51:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:51:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794897+0000", 2024-04-26T07:51:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2969999999999997e-06 2024-04-26T07:51:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804170+0000", 2024-04-26T07:51:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092730629999999998 2024-04-26T07:51:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804210+0000", 2024-04-26T07:51:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0426999999999998e-05 2024-04-26T07:51:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804229+0000", 2024-04-26T07:51:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.893e-05 2024-04-26T07:51:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804376+0000", 2024-04-26T07:51:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014691500000000001 2024-04-26T07:51:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804637+0000", 2024-04-26T07:51:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026043799999999999 2024-04-26T07:51:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804880+0000", 2024-04-26T07:51:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024350500000000001 2024-04-26T07:51:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.818402+0000", 2024-04-26T07:51:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013521574999999999 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825159+0000", 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067568710000000002 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825217+0000", 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8604000000000003e-05 2024-04-26T07:51:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825287+0000", 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9604000000000006e-05 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2987 3.16 3:689e92b2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.329893143, 2024-04-26T07:51:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023936529000000002, 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2987 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:51:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915016+0000", 2024-04-26T07:51:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.915020+0000", 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2830000000000002e-06 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.918997+0000", 2024-04-26T07:51:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039778799999999996 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919037+0000", 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9520000000000001e-05 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919063+0000", 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6539000000000001e-05 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919189+0000", 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012578200000000001 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919381+0000", 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019129100000000001 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.919551+0000", 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169968 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.925721+0000", 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061707120000000001 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938659+0000", 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012937786 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938834+0000", 2024-04-26T07:51:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017547600000000001 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.938953+0000", 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118292 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3279 3.5 3:a273d8b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_294:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.012032583, 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027017204999999999, 2024-04-26T07:51:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3279 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232880+0000", 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5700000000000001e-06 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237876+0000", 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049959890000000002 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237914+0000", 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7166000000000003e-05 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237938+0000", 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4559999999999999e-05 2024-04-26T07:51:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238136+0000", 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000197672 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238418+0000", 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028272200000000001 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238667+0000", 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024804100000000001 2024-04-26T07:51:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.248432+0000", 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097655169999999996 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259686+0000", 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011253582 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259773+0000", 2024-04-26T07:51:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7689999999999996e-05 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259894+0000", 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120696 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3310 3.1d 3:bbab4933:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.675485785999999, 2024-04-26T07:51:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024852018999999999, 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3310 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569427+0000", 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3759999999999999e-06 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574227+0000", 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048002490000000004 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574263+0000", 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5366e-05 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574285+0000", 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2802999999999998e-05 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574407+0000", 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121827 2024-04-26T07:51:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574743+0000", 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033614199999999999 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.575020+0000", 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000276731 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.586811+0000", 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011791322 2024-04-26T07:51:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594014+0000", 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072022680000000004 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594163+0000", 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149605 2024-04-26T07:51:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594276+0000", 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011233 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3328 3.1d 3:b9deba7f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_343:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:51:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.477922199999998, 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024014658000000001, 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3328 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:51:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766987+0000", 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.766991+0000", 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5130000000000001e-06 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771175+0000", 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041842210000000001 2024-04-26T07:51:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771212+0000", 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7499999999999997e-05 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771230+0000", 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7107000000000001e-05 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771350+0000", 2024-04-26T07:51:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120109 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771604+0000", 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025427799999999998 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.771838+0000", 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000234582 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.787185+0000", 2024-04-26T07:51:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015346761 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.790664+0000", 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003478933 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.790844+0000", 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017979899999999999 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.791002+0000", 2024-04-26T07:51:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015785500000000001 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3337 3.2a 3:5576afd6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.366128355000001, 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024210850999999999, 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3337 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878785+0000", 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8e-06 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884461+0000", 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0056765080000000002 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884499+0000", 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8006999999999997e-05 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884528+0000", 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8215999999999999e-05 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884685+0000", 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015766900000000001 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.885092+0000", 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040696100000000001 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.885545+0000", 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045240299999999998 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.900806+0000", 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015261082 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902766+0000", 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001959854 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902868+0000", 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010214500000000001 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902992+0000", 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000124206 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3358 3.2a 3:5403285b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.136038680999999, 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044350464999999999, 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3358 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:51:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108875+0000", 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5700000000000003e-06 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117074+0000", 2024-04-26T07:51:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081984469999999993 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117127+0000", 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3359000000000002e-05 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117156+0000", 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9312999999999999e-05 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117376+0000", 2024-04-26T07:51:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000219946 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117397+0000", 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0449e-05 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131014+0000", 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013617304 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131236+0000", 2024-04-26T07:51:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022168200000000001 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131455+0000", 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021913100000000001 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.146752+0000", 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015297445 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.152923+0000", 2024-04-26T07:51:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061707869999999996 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.153094+0000", 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017126899999999999 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.153221+0000", 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012676300000000001 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3359 3.3c 3:3d78e8bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.127589829000001, 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.038491746, 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3359 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117323+0000", 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0060000000000001e-06 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125017+0000", 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076944609999999997 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125056+0000", 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8819999999999998e-05 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125075+0000", 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9352999999999999e-05 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125215+0000", 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139672 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125234+0000", 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9386999999999999e-05 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131593+0000", 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063589930000000003 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131791+0000", 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019822899999999999 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131988+0000", 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019633500000000001 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.149711+0000", 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017723161000000001 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155565+0000", 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058539200000000003 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155706+0000", 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000141252 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155811+0000", 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105157 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3361 3.36 e80/17 3:6fb653d9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_376:head v 80'20, mlcod=79'18)", 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.088878933, 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024761258000000001, 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156031+0000", 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0299999999999999e-07 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159443+0000", 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118960000000002 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159474+0000", 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1495000000000003e-05 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159491+0000", 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6625000000000001e-05 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159658+0000", 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016732699999999999 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159731+0000", 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2862999999999997e-05 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.180648+0000", 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020916396 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.180792+0000", 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144053 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3405 3.16 3:68271ef4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_420:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.647537194000002, 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024793686999999998, 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3405 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597377+0000", 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1900000000000003e-06 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601615+0000", 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042371880000000002 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601654+0000", 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9266e-05 2024-04-26T07:51:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601672+0000", 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8406e-05 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601846+0000", 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017330899999999999 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.602257+0000", 2024-04-26T07:51:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041117399999999999 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.602699+0000", 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044251700000000002 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.615866+0000", 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013166862999999999 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.621980+0000", 2024-04-26T07:51:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061141779999999996 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.622082+0000", 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102036 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.622166+0000", 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3560000000000006e-05 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3414 3.16 3:6ba6e04b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_429:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.552830750999998, 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029030314000000002, 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3414 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692082+0000", 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1559999999999999e-06 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.696989+0000", 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004907649 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697029+0000", 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.943e-05 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697049+0000", 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0574e-05 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697189+0000", 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013976900000000001 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697460+0000", 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027075800000000001 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697689+0000", 2024-04-26T07:51:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022929499999999999 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.718106+0000", 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020416863 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.720916+0000", 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002809878 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.721031+0000", 2024-04-26T07:51:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115153 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.721109+0000", 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7788999999999997e-05 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3469 3.2f 3:f677d2ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_484:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.783223756000002, 2024-04-26T07:51:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024085299000000001, 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3469 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461686+0000", 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.461689+0000", 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4079999999999998e-06 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465469+0000", 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037796190000000001 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465500+0000", 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0877999999999998e-05 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465514+0000", 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4405e-05 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465608+0000", 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3826000000000006e-05 2024-04-26T07:51:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465778+0000", 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016981799999999999 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.465931+0000", 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015329300000000001 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476409+0000", 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01047788 2024-04-26T07:51:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485459+0000", 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.009050298 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485638+0000", 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017882900000000001 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.485771+0000", 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013304500000000001 2024-04-26T07:51:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3473 3.16 3:6a1b18ea:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.743386548, 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023955699, 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3473 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501523+0000", 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.501526+0000", 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5669999999999999e-06 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505892+0000", 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043654660000000001 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505925+0000", 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2863e-05 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.505942+0000", 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7037e-05 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506114+0000", 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172258 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506485+0000", 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037092199999999998 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.506737+0000", 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000252124 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.524617+0000", 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017879674000000002 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525286+0000", 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00066962300000000005 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525402+0000", 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000116119 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.525479+0000", 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6045999999999997e-05 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.391 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:01.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:51:01.393 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:01.389+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:01.494 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:01.489+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:01.520 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:01.520 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:01.520 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:51:01.520 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:01.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:51:01.595 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:01.593+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:01.658 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:01.658 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:01.658 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:51:01.658 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:51:01.658 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:01.673 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:51:01.696 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:01.693+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:01.797 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:01.793+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:01.798 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:01.798 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:51:01.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:51:01.798 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:51:01.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.798 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:51:01.798 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 152.238578179, 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:51:01.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:51:01.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:51:01.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2102 3.35 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.549863402, 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025241564000000001, 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2102 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246463+0000", 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.106e-06 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252299+0000", 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058363080000000001 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252331+0000", 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1914e-05 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252346+0000", 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4829e-05 2024-04-26T07:51:01.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252506+0000", 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015995500000000001 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252872+0000", 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000365817 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253249+0000", 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037744100000000001 2024-04-26T07:51:01.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271215+0000", 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017965979 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271568+0000", 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035317600000000002 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271630+0000", 2024-04-26T07:51:01.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1853000000000006e-05 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271701+0000", 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1186000000000006e-05 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2218 3.34 e59/17 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head v 59'2, mlcod=0'0)", 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:51:01.815 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 79.760587670000007, 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030663971000000002, 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:51:01.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035737+0000", 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0869999999999999e-06 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039593+0000", 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038566609999999999 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039642+0000", 2024-04-26T07:51:01.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8699999999999998e-05 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7350000000000001e-05 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039870+0000", 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020093199999999999 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039931+0000", 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1294e-05 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066342+0000", 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026410869 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066399+0000", 2024-04-26T07:51:01.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7077999999999998e-05 2024-04-26T07:51:01.820 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.820 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.820 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2242 3.2c 3:3494587f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 79.475464172000002, 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023803956000000001, 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2242 2024-04-26T07:51:01.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320859+0000", 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.320862+0000", 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1549999999999999e-06 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326077+0000", 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052153720000000002 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326119+0000", 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1112999999999998e-05 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326139+0000", 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9962999999999998e-05 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326237+0000", 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8110999999999996e-05 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326355+0000", 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011791200000000001 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.326459+0000", 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010489600000000001 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.338991+0000", 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012531967 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344349+0000", 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053576589999999999 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344529+0000", 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179958 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.344663+0000", 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013385 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2642 3.26 3:660978ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:01.826 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.763453235, 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028089177, 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2642 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:51:01.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032873+0000", 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4599999999999999e-06 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038900+0000", 2024-04-26T07:51:01.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060268300000000004 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038936+0000", 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5469999999999998e-05 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038954+0000", 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7903000000000001e-05 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039143+0000", 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000189118 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039587+0000", 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000444027 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039995+0000", 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040862100000000002 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.050770+0000", 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010774327 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060672+0000", 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099018999999999999 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060837+0000", 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000165885 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060959+0000", 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121636 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2653 3.35 3:af769224:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.642815245999998, 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025812589, 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.832 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2653 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153512+0000", 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1189999999999999e-06 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158218+0000", 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047056720000000002 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158268+0000", 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0319999999999999e-05 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158299+0000", 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1189000000000002e-05 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158465+0000", 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016535899999999999 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158802+0000", 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033700800000000002 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159078+0000", 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027675200000000001 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179029+0000", 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019950658999999999 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179143+0000", 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000114245 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179234+0000", 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0305999999999999e-05 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179320+0000", 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6959999999999994e-05 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.837 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2670 3.a 3:530171a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.447279104000003, 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024254465999999999, 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2670 2024-04-26T07:51:01.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349047+0000", 2024-04-26T07:51:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3969999999999998e-06 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.352981+0000", 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039336040000000003 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353021+0000", 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9932999999999999e-05 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353041+0000", 2024-04-26T07:51:01.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9755999999999999e-05 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353179+0000", 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013804600000000001 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353464+0000", 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000285335 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353706+0000", 2024-04-26T07:51:01.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024165499999999999 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.362865+0000", 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00915967 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.372976+0000", 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010110472000000001 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.373155+0000", 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179469 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.373298+0000", 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000143129 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2706 3.26 3:6727925e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:01.843 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.783490+0000", 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.012833188000002, 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023799429, 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2706 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.783490+0000", 2024-04-26T07:51:01.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.783490+0000", 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.783494+0000", 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.614e-06 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.790549+0000", 2024-04-26T07:51:01.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070554550000000004 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.790605+0000", 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6175999999999999e-05 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.790635+0000", 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9490000000000001e-05 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.790854+0000", 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021968199999999999 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.791214+0000", 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035932 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.791533+0000", 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031918799999999998 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.803893+0000", 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01235985 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.807117+0000", 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032242920000000001 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.807213+0000", 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5558999999999998e-05 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.807289+0000", 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6803000000000003e-05 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2798 3.26 3:65c1d500:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.049495542000003, 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026073496000000002, 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.849 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2798 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746831+0000", 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7270000000000001e-06 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.751974+0000", 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051423550000000004 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752019+0000", 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5729999999999998e-05 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752046+0000", 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6838999999999998e-05 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752177+0000", 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013056999999999999 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752428+0000", 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250871 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752665+0000", 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023739799999999999 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.761126+0000", 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008461049 2024-04-26T07:51:01.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772651+0000", 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011525262999999999 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772796+0000", 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144382 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772901+0000", 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105312 2024-04-26T07:51:01.854 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2799 3.26 3:67acbf7d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.038871205, 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026954779000000002, 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.855 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2799 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757456+0000", 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5999999999999998e-06 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.764926+0000", 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074704230000000003 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.764973+0000", 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6922999999999998e-05 2024-04-26T07:51:01.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765002+0000", 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9203000000000001e-05 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765131+0000", 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012904299999999999 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765396+0000", 2024-04-26T07:51:01.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026475799999999997 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765656+0000", 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025973499999999998 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.774155+0000", 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084992799999999997 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784112+0000", 2024-04-26T07:51:01.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099569930000000008 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784289+0000", 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017662799999999999 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784407+0000", 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118193 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2806 3.35 3:ad99b9ab:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 41.965658415999997, 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025789340000000001, 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2806 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.861 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830686+0000", 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1763000000000002e-05 2024-04-26T07:51:01.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835651+0000", 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049641529999999998 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835681+0000", 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9967e-05 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835699+0000", 2024-04-26T07:51:01.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8065999999999999e-05 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835867+0000", 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016876200000000001 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.836266+0000", 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039829500000000001 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:01.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.836707+0000", 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044176000000000003 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.847725+0000", 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011017506 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856182+0000", 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084570960000000008 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856349+0000", 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000166439 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856454+0000", 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010553299999999999 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2976 3.2c 3:37a6e58a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:01.866 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.042768858999999, 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027636029999999999, 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2976 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:51:01.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753557+0000", 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759271+0000", 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057135069999999996 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759308+0000", 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7555999999999998e-05 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759327+0000", 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8277000000000001e-05 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759492+0000", 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016504900000000001 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759922+0000", 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042981300000000003 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.760383+0000", 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000461201 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.773654+0000", 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013270929000000001 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.780865+0000", 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072115970000000001 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.781051+0000", 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186109 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.781190+0000", 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013895199999999999 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3304 3.36 3:6d1acc3e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_319:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.290500395999999, 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029248973000000001, 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.872 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3304 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505827+0000", 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0439999999999997e-06 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511763+0000", 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059365820000000001 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511802+0000", 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8296000000000001e-05 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511820+0000", 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377e-05 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511984+0000", 2024-04-26T07:51:01.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016365600000000001 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.512397+0000", 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041346699999999999 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.512819+0000", 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042219000000000002 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.525450+0000", 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01263016 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.534770+0000", 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093202330000000007 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.534938+0000", 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000168245 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.535072+0000", 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013372300000000001 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3323 3.2c 3:37b6bfd3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_338:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.087979015999998, 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023969408000000001, 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.878 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3323 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708347+0000", 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.14e-06 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712309+0000", 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039621760000000004 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712348+0000", 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8386000000000001e-05 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712367+0000", 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9216999999999999e-05 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712506+0000", 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013908900000000001 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712779+0000", 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027279799999999999 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.713020+0000", 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024111799999999999 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.722732+0000", 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097123969999999994 2024-04-26T07:51:01.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732000+0000", 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092674999999999997 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732175+0000", 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017472200000000001 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732314+0000", 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013886500000000001 2024-04-26T07:51:01.883 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3349 3.2c 3:35dd8e5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_364:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.792412595999998, 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025879333000000001, 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.884 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3349 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003913+0000", 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5469999999999999e-06 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.007957+0000", 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040434219999999996 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.007988+0000", 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1473000000000002e-05 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008006+0000", 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7810000000000001e-05 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008139+0000", 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133602 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008409+0000", 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026979899999999998 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008654+0000", 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024439200000000001 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.018119+0000", 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0094655439999999993 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029492+0000", 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011372996 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029660+0000", 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016761200000000001 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029790+0000", 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013013599999999999 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.889 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3361 3.36 3:6fb653d9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_376:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.659195004000001, 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044308437999999999, 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3361 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137134+0000", 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6130000000000003e-06 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144821+0000", 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076868769999999999 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144872+0000", 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.134e-05 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144897+0000", 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5347e-05 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.145083+0000", 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000185298 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.145101+0000", 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8026999999999999e-05 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155170+0000", 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010069794 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155500+0000", 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032923400000000003 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155731+0000", 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000231478 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179162+0000", 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023431110000000002 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181138+0000", 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001975367 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181295+0000", 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157742 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181437+0000", 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000141211 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3366 3.35 3:ae42cef6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_381:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.603246214999999, 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024877366000000001, 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.896 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3366 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193081+0000", 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6569999999999999e-06 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198183+0000", 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051024069999999998 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198218+0000", 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5240000000000001e-05 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198244+0000", 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.563e-05 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198366+0000", 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121758 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198662+0000", 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029598999999999999 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198924+0000", 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026244300000000001 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.216160+0000", 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017236006000000002 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217729+0000", 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001568896 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217872+0000", 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000143382 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217954+0000", 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1957000000000002e-05 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.901 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3376 3.a 3:52d883ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_391:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.496201951, 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030462698, 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.902 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3376 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300125+0000", 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2339999999999996e-06 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306292+0000", 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006166721 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306332+0000", 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9888999999999997e-05 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306351+0000", 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8997000000000001e-05 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306477+0000", 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012618199999999999 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306761+0000", 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000283789 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307034+0000", 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027255399999999999 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.320094+0000", 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013060024 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330404+0000", 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010310685 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330506+0000", 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101686 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330584+0000", 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7936999999999996e-05 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.907 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3425 3.36 3:6fcd7b97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_440:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.986858510000001, 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029676536, 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3425 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809468+0000", 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3830000000000001e-06 2024-04-26T07:51:01.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.813970+0000", 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045021530000000001 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814022+0000", 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2160000000000002e-05 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814043+0000", 2024-04-26T07:51:01.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0472999999999999e-05 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814184+0000", 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000140822 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814448+0000", 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026465499999999998 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814760+0000", 2024-04-26T07:51:01.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031151799999999999 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.838297+0000", 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023537215 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.838927+0000", 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00063033200000000005 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.839021+0000", 2024-04-26T07:51:01.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4018999999999995e-05 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.839141+0000", 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119806 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3470 3.36 3:6ccc0563:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_485:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.325133899000001, 2024-04-26T07:51:01.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02579234, 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3470 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471192+0000", 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.357e-06 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475395+0000", 2024-04-26T07:51:01.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042034380000000003 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475446+0000", 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0726000000000002e-05 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475472+0000", 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6693e-05 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475663+0000", 2024-04-26T07:51:01.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019097600000000001 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476091+0000", 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042763399999999998 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476528+0000", 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043667000000000001 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.492375+0000", 2024-04-26T07:51:01.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015847421 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496686+0000", 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043108030000000002 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496846+0000", 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000159739 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:01.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496982+0000", 2024-04-26T07:51:01.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135883 2024-04-26T07:51:01.919 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.919 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.919 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.919 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:01.919 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:01.919 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:01.920 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:51:01.921 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:01.917+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:01.972 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is set 2024-04-26T07:51:02.022 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:02.022+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:02.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:51:02.069 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:02.069 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:51:02.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.069 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3661 3.3f e88/84 3:fe38d32d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_15:head v 88'17, mlcod=80'15)", 2024-04-26T07:51:02.069 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:02.061958+0000", 2024-04-26T07:51:02.069 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.0097444709999999993, 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.009782855, 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.061958+0000", 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:02.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.061958+0000", 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.061959+0000", 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2900000000000002e-07 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.065534+0000", 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003574743 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.065560+0000", 2024-04-26T07:51:02.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6639999999999999e-05 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.065581+0000", 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0366000000000001e-05 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.067329+0000", 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017480970000000001 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:02.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.067359+0000", 2024-04-26T07:51:02.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9590999999999998e-05 2024-04-26T07:51:02.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:02.073 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:02.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:02.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:02.073 INFO:teuthology.orchestra.run.smithi191.stdout: ], 2024-04-26T07:51:02.073 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 1 2024-04-26T07:51:02.073 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:02.090 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:51:02.135 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:02.134+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:02.224 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:02.221+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:02.232 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:51:02.233 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:51:02.257 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:51:02.257 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:51:02.277 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:51:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:51:02.278 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:02.278 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:51:02.279 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:51:02.293 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:51:02.303 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:51:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:51:02.325 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:51:02.325 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:51:02.339 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:51:02.338+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:51:02.346 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:51:02.346 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:51:02.381 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:51:02.382 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:51:02.416 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:51:02.417 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:51:02.425 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:02.421+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:02.429 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:02.429 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:02.446 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:51:02.531 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:02.529+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:02.625 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:02.625 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:02.626 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:02.621+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:02.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:51:02.727 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:02.726+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:02.828 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:02.826+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:02.839 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:02.839 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:02.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:51:02.929 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:02.925+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:03.016 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:03.030 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:03.026+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:03.040 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:51:03.131 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:03.129+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:03.233 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:03.230+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:03.239 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:03.239 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:03.265 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:51:03.334 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:03.330+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:03.434 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:03.429+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:03.450 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:03.450 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:03.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:51:03.536 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:03.534+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:03.637 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:51:03.634+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:51:03.663 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:03.664 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:03.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:51:03.738 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:51:03.734+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:51:03.826 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:03.827 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:03.839 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:51:03.838+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:51:03.846 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:51:03.940 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:51:03.938+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:51:03.990 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:03.990 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:04.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:51:04.012 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:51:04.055 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:04.053+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:04.141 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:04.137+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:04.242 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:04.237+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:04.257 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:04.257 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:04.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:51:04.376 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:04.373+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:04.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T07:51:04.445 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:51:04.442+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:51:04.487 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:04.488 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:04.519 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:51:04.546 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:04.542+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:04.633 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:51:04.634 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:51:04.646 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:51:04.646+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:51:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:51:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:51:04.703 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:51:04.704 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:51:04.730 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:04.730 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:04.743 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:51:04.743 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:51:04.747 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:04.745+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:04.751 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:51:04.780 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:51:04.781 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:51:04.820 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:51:04.820 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:51:04.849 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:04.845+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:04.855 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:51:04.856 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:51:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:51:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:51:04.936 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "size": 20, 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 600, 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "ops": [ 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2104 3.7 3:e07fb3dc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 84.659915634000001, 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022314389, 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.937 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2104 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273733+0000", 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.273738+0000", 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.5000000000000001e-06 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279172+0000", 2024-04-26T07:51:04.939 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0054342360000000003 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279213+0000", 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1139e-05 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279239+0000", 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5681999999999999e-05 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.940 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279412+0000", 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000172836 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.279729+0000", 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000317502 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.280022+0000", 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00029294899999999998 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.941 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.291281+0000", 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011258788 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295762+0000", 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044808340000000004 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.295921+0000", 2024-04-26T07:51:04.942 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159822 2024-04-26T07:51:04.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.943 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.943 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.296048+0000", 2024-04-26T07:51:04.943 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012610099999999999 2024-04-26T07:51:04.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.943 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:04.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2146 3.38 3:1efa8962:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 84.019638942, 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023514108999999998, 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.944 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2146 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.945 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914010+0000", 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.914015+0000", 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9640000000000002e-06 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.946 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919265+0000", 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0052503239999999998 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919314+0000", 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.9194999999999999e-05 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919334+0000", 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.0143e-05 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.947 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919502+0000", 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000167169 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.919942+0000", 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000440106 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.920207+0000", 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00026539700000000001 2024-04-26T07:51:04.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.949 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.949 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.936417+0000", 2024-04-26T07:51:04.949 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016209956000000001 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937250+0000", 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00083288199999999996 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937400+0000", 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000150486 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.950 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.951 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:40.937524+0000", 2024-04-26T07:51:04.951 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012348700000000001 2024-04-26T07:51:04.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.951 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:04.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2240 3.2 3:427c2d70:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 82.634819257999993, 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023000021999999998, 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2240 2024-04-26T07:51:04.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.953 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.953 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:51:04.953 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.953 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298830+0000", 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.298833+0000", 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3850000000000002e-06 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.954 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301411+0000", 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0025782579999999999 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301440+0000", 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8844999999999999e-05 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301465+0000", 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.474e-05 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301563+0000", 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7876999999999998e-05 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301736+0000", 2024-04-26T07:51:04.956 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000173723 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.301889+0000", 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015237399999999999 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.308418+0000", 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0065293210000000003 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.957 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321747+0000", 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013328817999999999 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321794+0000", 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.6699999999999997e-05 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:49:42.321830+0000", 2024-04-26T07:51:04.958 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.5981e-05 2024-04-26T07:51:04.959 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.959 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:04.959 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.959 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.959 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2624 3.7 3:e18b8d5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:04.959 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 47.099744324, 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022029437999999998, 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2624 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.960 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833904+0000", 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.833907+0000", 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7829999999999999e-06 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.961 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836102+0000", 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0021945039999999999 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836129+0000", 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7382999999999999e-05 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836144+0000", 2024-04-26T07:51:04.962 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4523e-05 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836234+0000", 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.0140000000000001e-05 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836414+0000", 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018010899999999999 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.836537+0000", 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012306 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.842116+0000", 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055790309999999999 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855827+0000", 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.01371084 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.964 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855878+0000", 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1116999999999999e-05 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:17.855934+0000", 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5948e-05 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2644 3.24 3:26dbab36:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:04.965 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.883061787000003, 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022783326999999999, 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2644 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.966 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050587+0000", 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.967 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.050590+0000", 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.926e-06 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052190+0000", 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016004770000000001 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052222+0000", 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1883e-05 2024-04-26T07:51:04.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052237+0000", 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4775e-05 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052332+0000", 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4752000000000004e-05 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.969 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052544+0000", 2024-04-26T07:51:04.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00021216 2024-04-26T07:51:04.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.970 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:04.970 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.052743+0000", 2024-04-26T07:51:04.970 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019906399999999999 2024-04-26T07:51:04.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.059591+0000", 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0068482650000000001 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073241+0000", 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013649791 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.971 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073312+0000", 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.0916999999999999e-05 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.073370+0000", 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8316999999999997e-05 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.972 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2717 3.24 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.036689152999998, 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027326647999999999, 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2717 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.973 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896960+0000", 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.974 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.896963+0000", 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.0029999999999999e-06 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898525+0000", 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015619690000000001 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.975 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898550+0000", 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5293999999999999e-05 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898563+0000", 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3164e-05 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.976 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898631+0000", 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.8392999999999994e-05 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898769+0000", 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013780899999999999 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.898882+0000", 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000112404 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.977 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.903326+0000", 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044447059999999997 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924162+0000", 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020835692999999999 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924233+0000", 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1334000000000005e-05 2024-04-26T07:51:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.924286+0000", 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2879e-05 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2720 3.29 3:97b63d0b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 46.007983924999998, 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021434502000000001, 2024-04-26T07:51:04.979 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2720 2024-04-26T07:51:04.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925665+0000", 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.925667+0000", 2024-04-26T07:51:04.981 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.3329999999999999e-06 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927365+0000", 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016978189999999999 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927397+0000", 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1814999999999999e-05 2024-04-26T07:51:04.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927413+0000", 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5701000000000001e-05 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927501+0000", 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8721999999999995e-05 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.983 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927660+0000", 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00015847499999999999 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.927759+0000", 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.9442000000000001e-05 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.932264+0000", 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004504821 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.984 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.946918+0000", 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014654253000000001 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947013+0000", 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.4493000000000005e-05 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.947099+0000", 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6627999999999998e-05 2024-04-26T07:51:04.985 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2723 3.29 3:948407d3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.975163359, 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021262346000000001, 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.986 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2723 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958485+0000", 2024-04-26T07:51:04.987 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.958489+0000", 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1779999999999999e-06 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960380+0000", 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0018913319999999999 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.988 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960409+0000", 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8815000000000001e-05 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960423+0000", 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4525999999999999e-05 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960509+0000", 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5984999999999998e-05 2024-04-26T07:51:04.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960689+0000", 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017960599999999999 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.960858+0000", 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016958699999999999 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.990 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.966401+0000", 2024-04-26T07:51:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055425919999999998 2024-04-26T07:51:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979611+0000", 2024-04-26T07:51:04.991 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013210024000000001 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979695+0000", 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.3756000000000002e-05 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.979748+0000", 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.2945000000000002e-05 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.992 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2726 3.38 3:1dd49cc1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.941369555000001, 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.027774566000000001, 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:04.993 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2726 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:04.994 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992279+0000", 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.992282+0000", 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4849999999999999e-06 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994733+0000", 2024-04-26T07:51:04.995 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024511250000000002 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994765+0000", 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2004000000000001e-05 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:04.996 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994781+0000", 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5693999999999999e-05 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.994852+0000", 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1488000000000004e-05 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:04.997 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995023+0000", 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017139100000000001 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:18.995191+0000", 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00016788400000000001 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.002100+0000", 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006908371 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.998 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019926+0000", 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.017825952999999999 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.019999+0000", 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3269999999999995e-05 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.020054+0000", 2024-04-26T07:51:04.999 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4901000000000002e-05 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2749 3.27 3:e4048420:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.703617631999997, 2024-04-26T07:51:05.000 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022843841, 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2749 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.001 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230031+0000", 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.002 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.230034+0000", 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9340000000000002e-06 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232058+0000", 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.002024231 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232087+0000", 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8892000000000001e-05 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.003 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232101+0000", 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.4168999999999999e-05 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232171+0000", 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9845999999999995e-05 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.004 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232300+0000", 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012891899999999999 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.232419+0000", 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00011846299999999999 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.005 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.236674+0000", 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0042552670000000001 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252759+0000", 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.016085486 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252825+0000", 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.5180999999999998e-05 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.006 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.252875+0000", 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.0453e-05 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2754 3.27 3:e54c3138:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.650210719, 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021374135999999998, 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.007 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2754 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.008 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283438+0000", 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.283440+0000", 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.283e-06 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285189+0000", 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017491130000000001 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.009 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285219+0000", 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9852000000000001e-05 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285233+0000", 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3688e-05 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285319+0000", 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5955e-05 2024-04-26T07:51:05.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285504+0000", 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000184811 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.285664+0000", 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000159956 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.011 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.292056+0000", 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.006392315 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304676+0000", 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.012619615000000001 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.012 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304756+0000", 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0662999999999997e-05 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.304812+0000", 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5884999999999998e-05 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.013 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:2793 3.24 3:246825e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 45.239624888000002, 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021990902, 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 2793 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.014 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694024+0000", 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.694026+0000", 2024-04-26T07:51:05.015 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.334e-06 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695646+0000", 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001619351 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695673+0000", 2024-04-26T07:51:05.016 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.7801999999999999e-05 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695686+0000", 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2311e-05 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695783+0000", 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.7714000000000007e-05 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.017 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.695981+0000", 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000197713 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.696170+0000", 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018838399999999999 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.702461+0000", 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0062915549999999999 2024-04-26T07:51:05.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715870+0000", 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.013409377 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.715957+0000", 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6223000000000004e-05 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.019 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:19.716015+0000", 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.8137999999999998e-05 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3300 3.33 3:cd50c5f5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_315:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 23.475384233, 2024-04-26T07:51:05.020 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022987548999999999, 2024-04-26T07:51:05.021 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.021 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.021 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.021 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.021 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3300 2024-04-26T07:51:05.022 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.022 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.022 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.022 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.022 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:51:05.022 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.023 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.023 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.023 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458265+0000", 2024-04-26T07:51:05.023 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.024 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.458268+0000", 2024-04-26T07:51:05.024 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.021e-06 2024-04-26T07:51:05.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.024 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.024 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459957+0000", 2024-04-26T07:51:05.025 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0016889120000000001 2024-04-26T07:51:05.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.025 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.025 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.025 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459981+0000", 2024-04-26T07:51:05.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.4406e-05 2024-04-26T07:51:05.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.026 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.026 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.026 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.459994+0000", 2024-04-26T07:51:05.026 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2680000000000001e-05 2024-04-26T07:51:05.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.027 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.027 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.027 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460079+0000", 2024-04-26T07:51:05.027 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.5614999999999999e-05 2024-04-26T07:51:05.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.028 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.028 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460283+0000", 2024-04-26T07:51:05.028 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000204172 2024-04-26T07:51:05.028 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.028 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.029 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:05.029 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.460467+0000", 2024-04-26T07:51:05.029 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000183919 2024-04-26T07:51:05.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.029 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.465999+0000", 2024-04-26T07:51:05.030 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0055315850000000003 2024-04-26T07:51:05.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.030 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.030 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.030 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481141+0000", 2024-04-26T07:51:05.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015142375 2024-04-26T07:51:05.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.031 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.031 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.031 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481204+0000", 2024-04-26T07:51:05.031 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.3048999999999999e-05 2024-04-26T07:51:05.031 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.032 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.032 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.032 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:41.481252+0000", 2024-04-26T07:51:05.032 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.7815000000000002e-05 2024-04-26T07:51:05.032 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.032 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.033 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.033 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.033 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3365 3.33 3:cf6f73fa:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_380:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:05.033 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:51:05.033 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.753461414, 2024-04-26T07:51:05.034 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022536079000000001, 2024-04-26T07:51:05.034 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.034 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.034 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.034 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.035 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.035 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3365 2024-04-26T07:51:05.035 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.035 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.036 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:51:05.036 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.036 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.036 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180187+0000", 2024-04-26T07:51:05.037 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.037 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.037 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.037 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.180191+0000", 2024-04-26T07:51:05.038 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.0860000000000004e-06 2024-04-26T07:51:05.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.038 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.038 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.038 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182593+0000", 2024-04-26T07:51:05.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0024014539999999999 2024-04-26T07:51:05.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.039 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.039 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.039 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182622+0000", 2024-04-26T07:51:05.039 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.9111e-05 2024-04-26T07:51:05.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182634+0000", 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.2149e-05 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182715+0000", 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.0945999999999994e-05 2024-04-26T07:51:05.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.182913+0000", 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019779300000000001 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.183094+0000", 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018092999999999999 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.041 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.190830+0000", 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0077362419999999999 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202632+0000", 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.011801416 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202669+0000", 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.7394000000000001e-05 2024-04-26T07:51:05.042 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.202723+0000", 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4558000000000002e-05 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3372 3.29 3:97c5a4e1:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:51:05.043 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.681057013, 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.020672864999999999, 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3372 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:51:05.044 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252592+0000", 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.252596+0000", 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.2989999999999998e-06 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.045 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253876+0000", 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.001279493 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253904+0000", 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.8022999999999999e-05 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.253915+0000", 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.1878e-05 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.046 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254002+0000", 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6528999999999998e-05 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254171+0000", 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000168486 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.254325+0000", 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000154821 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.047 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.258909+0000", 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0045840589999999997 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273124+0000", 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014214536 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273179+0000", 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4598000000000001e-05 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.048 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.273265+0000", 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.6143000000000005e-05 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3401 3.29 3:94e99a5f:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.382052591000001, 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022448046999999999, 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.049 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3401 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551596+0000", 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.551599+0000", 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1999999999999999e-06 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553183+0000", 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0015834829999999999 2024-04-26T07:51:05.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553216+0000", 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.2663000000000002e-05 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553232+0000", 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.6612999999999998e-05 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553321+0000", 2024-04-26T07:51:05.052 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 8.8941000000000001e-05 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553484+0000", 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000162554 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.553616+0000", 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00013222700000000001 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.053 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.558023+0000", 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0044068570000000001 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573919+0000", 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.015896100999999999 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.573991+0000", 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.1950000000000001e-05 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.054 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.574044+0000", 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.3458000000000002e-05 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3424 3.2 3:422e52f6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_439:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 22.138101201000001, 2024-04-26T07:51:05.055 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021648288000000002, 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3424 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:51:05.056 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795548+0000", 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.795550+0000", 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.199e-06 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.057 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797322+0000", 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0017720329999999999 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797353+0000", 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.1390000000000003e-05 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797366+0000", 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.3027000000000001e-05 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.058 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797436+0000", 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.9306000000000004e-05 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797578+0000", 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00014246699999999999 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.797702+0000", 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000124354 2024-04-26T07:51:05.059 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.802182+0000", 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.004479841 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817086+0000", 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014903506 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.060 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817141+0000", 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.5207999999999997e-05 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:42.817196+0000", 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.4957000000000003e-05 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3457 3.29 3:975e30a2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_472:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:05.061 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 21.677845889, 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.021210401, 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3457 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.062 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255803+0000", 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.255808+0000", 2024-04-26T07:51:05.063 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.1769999999999997e-06 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258946+0000", 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00313766 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.258989+0000", 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.3452999999999999e-05 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.064 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259009+0000", 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9516000000000001e-05 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259161+0000", 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000151824 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259410+0000", 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00024946099999999998 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.065 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.259694+0000", 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00028413400000000001 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.267979+0000", 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0082847070000000005 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276888+0000", 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0089093169999999999 2024-04-26T07:51:05.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.276946+0000", 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.7438999999999997e-05 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:50:43.277013+0000", 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 6.7712999999999994e-05 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.067 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3647 3.38 3:1c63df73:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:51:01.827911+0000", 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 3.1057375120000001, 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.022448984000000002, 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3647 2024-04-26T07:51:05.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.827911+0000", 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.827911+0000", 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.069 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.827916+0000", 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.51e-06 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.832292+0000", 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0043759389999999997 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.832351+0000", 2024-04-26T07:51:05.070 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 5.9049999999999999e-05 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.832370+0000", 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.9568999999999998e-05 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.832471+0000", 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000100797 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.071 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.832665+0000", 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000193544 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.832837+0000", 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00017198499999999999 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.840746+0000", 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0079093140000000006 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.072 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.850052+0000", 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0093061619999999998 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.850235+0000", 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.000182812 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:01.850360+0000", 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00012530199999999999 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.073 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "description": "osd_op(client.4458.0:3679 3.7 3:e0994d08:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "initiated_at": "2024-04-26T07:51:02.247038+0000", 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "age": 2.6866106109999999, 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.023521851999999999, 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "continuous": false, 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "type_data": { 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client_info": { 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client": "client.4458", 2024-04-26T07:51:05.074 INFO:teuthology.orchestra.run.smithi053.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: "tid": 3679 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: "events": [ 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "initiated", 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.247038+0000", 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "header_read", 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.247038+0000", 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.075 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "throttled", 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.247041+0000", 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 2.5220000000000002e-06 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "all_read", 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.249424+0000", 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0023832290000000002 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "dispatched", 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.249457+0000", 2024-04-26T07:51:05.076 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 3.3034000000000003e-05 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.249472+0000", 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 1.5427e-05 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "reached_pg", 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.249571+0000", 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 9.8821999999999997e-05 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "started", 2024-04-26T07:51:05.077 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.249771+0000", 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00019948399999999999 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.249956+0000", 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.00018547099999999999 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "op_commit", 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.255961+0000", 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.0060052270000000001 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.078 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.270445+0000", 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 0.014483592 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "commit_sent", 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.270519+0000", 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 7.3506999999999999e-05 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: "event": "done", 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: "time": "2024-04-26T07:51:02.270560+0000", 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: "duration": 4.1536999999999999e-05 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.080 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-04-26T07:51:05.080 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-04-26T07:51:05.080 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:51:05.081 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:51:05.082 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:51:05.083 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:51:05.078+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:51:05.183 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:05.177+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3958 3.13 e89/46 3:cb91a468:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_310:head v 89'18, mlcod=88'16)", 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:05.216434+0000", 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.010660749000000001, 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010689397999999999, 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-26T07:51:05.225 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.216434+0000", 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.216434+0000", 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.216436+0000", 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.922e-06 2024-04-26T07:51:05.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.220229+0000", 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00379299 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.220256+0000", 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6746000000000001e-05 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.220269+0000", 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3702e-05 2024-04-26T07:51:05.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.220398+0000", 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129045 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.220441+0000", 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2647e-05 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.228 INFO:teuthology.orchestra.run.smithi191.stdout: ], 2024-04-26T07:51:05.229 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 1 2024-04-26T07:51:05.229 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:05.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:51:05.286 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:51:05.286+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:51:05.382 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:05.382 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:05.382 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:51:05.382 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:51:05.383 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:05.385 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-26T07:51:05.382+0000 7fbd7b5cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25237) UID: 0 2024-04-26T07:51:05.399 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:51:05.485 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:05.481+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:05.581 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:51:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:1243 3.34 3:2c6d6162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.2__shadow_.plWsv-OCJX9FgfjKujjXJY5XqZED9d7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 97.364192618999994, 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027779406999999999, 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 1243 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215404+0000", 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.215412+0000", 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4819999999999997e-06 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.222978+0000", 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075663120000000004 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223020+0000", 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1822e-05 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223039+0000", 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8987e-05 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223190+0000", 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015117200000000001 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223567+0000", 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037653200000000001 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.223953+0000", 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00038587000000000002 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.242323+0000", 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018370118000000001 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243105+0000", 2024-04-26T07:51:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00078179400000000004 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243143+0000", 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8068000000000002e-05 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:28.243184+0000", 2024-04-26T07:51:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.125e-05 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2205 3.14 3:28e2c620:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 83.686182373999998, 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026053276, 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2205 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893415+0000", 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.893417+0000", 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6749999999999998e-06 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897528+0000", 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041110340000000004 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897550+0000", 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2048e-05 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897563+0000", 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782000000000001e-05 2024-04-26T07:51:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897646+0000", 2024-04-26T07:51:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2800999999999995e-05 2024-04-26T07:51:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897813+0000", 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016703599999999999 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.897975+0000", 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000161588 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910669+0000", 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012694571 2024-04-26T07:51:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919336+0000", 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008666956 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919410+0000", 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3732000000000005e-05 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.919468+0000", 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8053000000000001e-05 2024-04-26T07:51:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2218 3.34 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 83.549609799999999, 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.036744706000000002, 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2218 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029987+0000", 2024-04-26T07:51:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.029990+0000", 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1130000000000001e-06 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034756+0000", 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047653330000000001 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034798+0000", 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2515999999999997e-05 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034817+0000", 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8487000000000001e-05 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.034961+0000", 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144282 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035213+0000", 2024-04-26T07:51:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025165799999999998 2024-04-26T07:51:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035443+0000", 2024-04-26T07:51:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023000200000000001 2024-04-26T07:51:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.045839+0000", 2024-04-26T07:51:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010396069000000001 2024-04-26T07:51:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066634+0000", 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020795126000000001 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066688+0000", 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3927000000000001e-05 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066732+0000", 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4193000000000002e-05 2024-04-26T07:51:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2247 3.14 3:29febfb2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 83.206144711999997, 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024548258999999999, 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2247 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373452+0000", 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.373455+0000", 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6359999999999998e-06 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377469+0000", 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040144029999999997 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377510+0000", 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0772999999999997e-05 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377529+0000", 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8787000000000002e-05 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377626+0000", 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.6779000000000003e-05 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377815+0000", 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018884199999999999 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.377982+0000", 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016781200000000001 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.389428+0000", 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011445936 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397850+0000", 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084213440000000007 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.397942+0000", 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1879999999999994e-05 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.398001+0000", 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9067000000000002e-05 2024-04-26T07:51:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2650 3.9 3:910fae93:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.459151306999999, 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026997720999999999, 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2650 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120446+0000", 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.120449+0000", 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.213e-06 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126814+0000", 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063646370000000002 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126859+0000", 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5769999999999997e-05 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.126881+0000", 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1226999999999999e-05 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127062+0000", 2024-04-26T07:51:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018148799999999999 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127473+0000", 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041101799999999997 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.127939+0000", 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046579999999999999 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.142532+0000", 2024-04-26T07:51:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014592818 2024-04-26T07:51:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147212+0000", 2024-04-26T07:51:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046805379999999997 2024-04-26T07:51:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147317+0000", 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000104706 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.147444+0000", 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000126506 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2651 3.34 3:2e652162:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.446999056000003, 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026435427000000001, 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2651 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132598+0000", 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.132621+0000", 2024-04-26T07:51:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2677e-05 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140045+0000", 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074240269999999997 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140075+0000", 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0159999999999999e-05 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140090+0000", 2024-04-26T07:51:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.485e-05 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140253+0000", 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162752 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140492+0000", 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023908800000000001 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.140712+0000", 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022059900000000001 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.156194+0000", 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015481818 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158759+0000", 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0025644750000000001 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158920+0000", 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016169000000000001 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159033+0000", 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113291 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2652 3.f e71/17 3:f0cf4464:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_87:head v 71'6, mlcod=59'4)", 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.424965878000002, 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025327902999999999, 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154631+0000", 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.154635+0000", 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4199999999999999e-06 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159003+0000", 2024-04-26T07:51:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043688370000000004 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159072+0000", 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8546000000000004e-05 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159104+0000", 2024-04-26T07:51:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2283999999999998e-05 2024-04-26T07:51:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159252+0000", 2024-04-26T07:51:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014761200000000001 2024-04-26T07:51:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159318+0000", 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6248999999999995e-05 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179858+0000", 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020539973 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179959+0000", 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000100982 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2717 3.24 e71/17 3:276b41f2:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_152:head v 71'14, mlcod=71'12)", 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:51:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.678700548999998, 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024784816000000001, 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900897+0000", 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.900899+0000", 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4140000000000001e-06 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907332+0000", 2024-04-26T07:51:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064328529999999997 2024-04-26T07:51:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907367+0000", 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4966999999999999e-05 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907397+0000", 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0392999999999999e-05 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907551+0000", 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015379900000000001 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.907597+0000", 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639000000000001e-05 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925587+0000", 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017990055000000001 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.925681+0000", 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4696000000000003e-05 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2764 3.34 3:2e573a11:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.185166707999997, 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031072567999999998, 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2764 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394430+0000", 2024-04-26T07:51:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.394434+0000", 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4240000000000002e-06 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400673+0000", 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062394210000000002 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400724+0000", 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1175999999999999e-05 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400760+0000", 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5123000000000002e-05 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.400955+0000", 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019514900000000001 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401423+0000", 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00046833999999999998 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.401840+0000", 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041720800000000002 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.423203+0000", 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021362641000000002 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425243+0000", 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0020403420000000001 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425403+0000", 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015975599999999999 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.425503+0000", 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9988000000000006e-05 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2980 3.34 3:2c27af06:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.765553536999999, 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023940217999999999, 2024-04-26T07:51:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2980 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814044+0000", 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.814047+0000", 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.49e-06 2024-04-26T07:51:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820559+0000", 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065114609999999996 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820595+0000", 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6919999999999999e-05 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820614+0000", 2024-04-26T07:51:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9017000000000001e-05 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.820759+0000", 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014448600000000001 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821025+0000", 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026618799999999999 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.821281+0000", 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000255388 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837756+0000", 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016475019 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837825+0000", 2024-04-26T07:51:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9529999999999993e-05 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837913+0000", 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8418000000000006e-05 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.837984+0000", 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0301000000000003e-05 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2988 3.f e78/17 3:f2e60fa8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_13:head v 78'11, mlcod=72'9)", 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.650042279000001, 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025247141000000001, 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929555+0000", 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.929557+0000", 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.812e-06 2024-04-26T07:51:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932701+0000", 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031440909999999999 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932727+0000", 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6485000000000001e-05 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932740+0000", 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2899e-05 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932846+0000", 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000106261 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.932884+0000", 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7150000000000002e-05 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954658+0000", 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.021774803999999998 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.954802+0000", 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014363900000000001 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3038 3.14 3:2b0c4970:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.067168250999998, 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02413448, 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3038 2024-04-26T07:51:05.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512429+0000", 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.512431+0000", 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0219999999999999e-06 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516443+0000", 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040121369999999998 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516479+0000", 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5921999999999999e-05 2024-04-26T07:51:05.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516498+0000", 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9434999999999999e-05 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516594+0000", 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5626999999999998e-05 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516761+0000", 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016746900000000001 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.516919+0000", 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157613 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.532325+0000", 2024-04-26T07:51:05.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015405785 2024-04-26T07:51:05.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536276+0000", 2024-04-26T07:51:05.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039511859999999998 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536433+0000", 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000156751 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:38.536563+0000", 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013053300000000001 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3312 3.14 3:28d42ed8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.991261578, 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02506968, 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3312 2024-04-26T07:51:05.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588336+0000", 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.588339+0000", 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8139999999999998e-06 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593503+0000", 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051636939999999999 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593552+0000", 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8644999999999999e-05 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593575+0000", 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3694999999999999e-05 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.593721+0000", 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014558099999999999 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594030+0000", 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000309084 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594362+0000", 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033205799999999998 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.602982+0000", 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086194410000000003 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613081+0000", 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010099385000000001 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613235+0000", 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153936 2024-04-26T07:51:05.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.613405+0000", 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170347 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3362 3.3 3:c21c3c88:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_377:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:51:05.663 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.429058879999999, 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027051006999999998, 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3362 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150538+0000", 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.150542+0000", 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4230000000000001e-06 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155196+0000", 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046542240000000002 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155241+0000", 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5188000000000002e-05 2024-04-26T07:51:05.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155264+0000", 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3243000000000001e-05 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155429+0000", 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016474099999999999 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155798+0000", 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036913799999999997 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156167+0000", 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036868699999999998 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177139+0000", 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020971996999999999 2024-04-26T07:51:05.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177402+0000", 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026307499999999998 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177513+0000", 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000110862 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.177589+0000", 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6428999999999996e-05 2024-04-26T07:51:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3364 3.9 3:93973eda:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_379:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.406612201000002, 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023680673999999999, 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.670 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3364 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172985+0000", 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.172989+0000", 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7479999999999999e-06 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178348+0000", 2024-04-26T07:51:05.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053593870000000002 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178375+0000", 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6948e-05 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178395+0000", 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9746e-05 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.178680+0000", 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028477199999999998 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179097+0000", 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041771700000000001 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179312+0000", 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021453499999999999 2024-04-26T07:51:05.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.194902+0000", 2024-04-26T07:51:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015590530999999999 2024-04-26T07:51:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196474+0000", 2024-04-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0015717610000000001 2024-04-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196592+0000", 2024-04-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118139 2024-04-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.196666+0000", 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.339e-05 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3649 3.14 3:28feebe7:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:01.874291+0000", 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.70530625, 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027361646999999999, 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.677 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3649 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.874291+0000", 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.874291+0000", 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.874294+0000", 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2799999999999999e-06 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.882605+0000", 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0083108790000000002 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.882644+0000", 2024-04-26T07:51:05.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9422999999999998e-05 2024-04-26T07:51:05.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.882663+0000", 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8444000000000002e-05 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.882865+0000", 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020240500000000001 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.883130+0000", 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026515099999999998 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.883364+0000", 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023324199999999999 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.900362+0000", 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016998035000000002 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.901480+0000", 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0011180319999999999 2024-04-26T07:51:05.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.901582+0000", 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102206 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:01.901653+0000", 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0549999999999994e-05 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3664 3.14 3:2ad3796e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:02.084336+0000", 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.495261202, 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025802996000000002, 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3664 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.084336+0000", 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.084336+0000", 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.084338+0000", 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3630000000000001e-06 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.088355+0000", 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040164270000000004 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.088387+0000", 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1979e-05 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.088403+0000", 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6198e-05 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.088578+0000", 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000175281 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.088996+0000", 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041771400000000002 2024-04-26T07:51:05.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.089422+0000", 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042626099999999999 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.104651+0000", 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015228764000000001 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.109957+0000", 2024-04-26T07:51:05.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053058300000000001 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.110067+0000", 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000109922 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.110139+0000", 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2256999999999996e-05 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3926 3.34 3:2d475e65:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_278:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:04.881402+0000", 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.69819491, 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024465306999999999, 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.690 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3926 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.881402+0000", 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.881402+0000", 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.881406+0000", 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9539999999999998e-06 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.885355+0000", 2024-04-26T07:51:05.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039486820000000002 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.885397+0000", 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2064000000000002e-05 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.885418+0000", 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0956000000000001e-05 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.885567+0000", 2024-04-26T07:51:05.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014959199999999999 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.885817+0000", 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000249425 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 6", 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.886096+0000", 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027940799999999998 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.899156+0000", 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013059408 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.905696+0000", 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065402050000000003 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.905787+0000", 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1355999999999997e-05 2024-04-26T07:51:05.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:04.905868+0000", 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0257000000000001e-05 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3943 3.9 3:9284b119:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:05.058902+0000", 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.52069492299999998, 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026097885000000001, 2024-04-26T07:51:05.696 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3943 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.058902+0000", 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.058902+0000", 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.058906+0000", 2024-04-26T07:51:05.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7309999999999999e-06 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.065028+0000", 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061216619999999999 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.065071+0000", 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3869999999999998e-05 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.065093+0000", 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1480000000000001e-05 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.065226+0000", 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000132602 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.065584+0000", 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000358081 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 2", 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.065990+0000", 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040675800000000001 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.077541+0000", 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011550717 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.084741+0000", 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007199609 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.084898+0000", 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157765 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.085000+0000", 2024-04-26T07:51:05.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010161 2024-04-26T07:51:05.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.706 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.706 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3961 3.f 3:f2dbc177:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_313:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:05.243715+0000", 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.335881708, 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025098988999999999, 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3961 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.243715+0000", 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.243715+0000", 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.243718+0000", 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.525e-06 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.248510+0000", 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047915809999999996 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.248541+0000", 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1869999999999998e-05 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:05.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.248559+0000", 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7643e-05 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.248655+0000", 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5965999999999996e-05 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.248817+0000", 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016236199999999999 2024-04-26T07:51:05.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.248980+0000", 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000162254 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.266115+0000", 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017135088 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.268688+0000", 2024-04-26T07:51:05.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002572862 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.268755+0000", 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7609999999999998e-05 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.268814+0000", 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9228000000000003e-05 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:05.712 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:05.713 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:05.714 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:51:05.715 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:05.709+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:05.815 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:05.813+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:05.852 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:05.852 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:05.852 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:51:05.853 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:05.870 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:51:05.917 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:05.913+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:06.000 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:06.000 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:06.000 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:51:06.000 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:51:06.000 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:06.016 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:51:06.017 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:51:06.014+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:51:06.118 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:06.113+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:06.156 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:06.156 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:51:06.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:51:06.156 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2204 3.5 3:a294f995:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 84.271588398000006, 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.03032317, 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2204 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.157 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881990+0000", 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.881994+0000", 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6330000000000002e-06 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888238+0000", 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062439069999999999 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888280+0000", 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2231999999999998e-05 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888305+0000", 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5060000000000001e-05 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888469+0000", 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016422499999999999 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.888479+0000", 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.008e-05 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.894701+0000", 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062219969999999999 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895063+0000", 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036214800000000002 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.895429+0000", 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00036549400000000001 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.909795+0000", 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.014366191 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912173+0000", 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0023778330000000002 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912250+0000", 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.6736000000000005e-05 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.912313+0000", 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3633999999999994e-05 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2206 3.16 3:6a8f0fb0:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 84.247679566000002, 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028443779999999998, 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.163 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2206 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905899+0000", 2024-04-26T07:51:06.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.905902+0000", 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9059999999999998e-06 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910333+0000", 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0044310299999999999 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910358+0000", 2024-04-26T07:51:06.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4683000000000001e-05 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910373+0000", 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5003e-05 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910466+0000", 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.3051000000000001e-05 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.910844+0000", 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037795800000000002 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.911110+0000", 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000266681 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.924934+0000", 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013823287 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.933975+0000", 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090409510000000002 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934161+0000", 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186276 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:41.934343+0000", 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00018195400000000001 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2643 3.d e71/17 3:b2fabe62:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_78:head v 71'6, mlcod=59'4)", 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 48.104588962000001, 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025933037999999999, 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048990+0000", 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.048993+0000", 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.05e-06 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054473+0000", 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054799530000000001 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054509+0000", 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6720000000000001e-05 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054527+0000", 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7643e-05 2024-04-26T07:51:06.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054673+0000", 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014575300000000001 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.054731+0000", 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8294999999999997e-05 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074792+0000", 2024-04-26T07:51:06.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020061208000000001 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.074923+0000", 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013041600000000001 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2685 3.2a 3:563d809b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.622407989000003, 2024-04-26T07:51:06.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024124367000000001, 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2685 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531171+0000", 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.531175+0000", 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2130000000000002e-06 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535309+0000", 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004133828 2024-04-26T07:51:06.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535341+0000", 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2583000000000003e-05 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535365+0000", 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4244e-05 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535513+0000", 2024-04-26T07:51:06.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000147152 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.535766+0000", 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025306800000000001 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.536027+0000", 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000260952 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.546828+0000", 2024-04-26T07:51:06.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010801471 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555090+0000", 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082623200000000001 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555189+0000", 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8157000000000002e-05 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.555295+0000", 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010637900000000001 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2718 3.2a 3:56cbd9c4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.244948645999997, 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025498831999999999, 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.179 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2718 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908630+0000", 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.908634+0000", 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7400000000000002e-06 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912808+0000", 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041748089999999998 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912847+0000", 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8367e-05 2024-04-26T07:51:06.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.912865+0000", 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7886000000000001e-05 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913036+0000", 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017147199999999999 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913465+0000", 2024-04-26T07:51:06.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000429071 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.913890+0000", 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042477999999999998 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.929103+0000", 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015213344 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.933821+0000", 2024-04-26T07:51:06.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047172480000000003 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.934000+0000", 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000178872 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.934129+0000", 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000129243 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2728 3.1d 3:b8ac35e8:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.138092450999999, 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026742152000000002, 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2728 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015486+0000", 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.015489+0000", 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0900000000000001e-06 2024-04-26T07:51:06.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021300+0000", 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058107380000000002 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021350+0000", 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9775999999999999e-05 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021375+0000", 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5113000000000002e-05 2024-04-26T07:51:06.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021530+0000", 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015508199999999999 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.021829+0000", 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029866499999999999 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.022068+0000", 2024-04-26T07:51:06.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023948200000000001 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.032120+0000", 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010051579 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042009+0000", 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0098892019999999997 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042110+0000", 2024-04-26T07:51:06.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010163299999999999 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.042228+0000", 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117792 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2765 3.3a 3:5c727248:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.746425698000003, 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029518037, 2024-04-26T07:51:06.190 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2765 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407153+0000", 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.407157+0000", 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5569999999999997e-06 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411821+0000", 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004664021 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411877+0000", 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.588e-05 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.411904+0000", 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6763000000000001e-05 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412067+0000", 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016272300000000001 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412462+0000", 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039559000000000003 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.412689+0000", 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022669500000000001 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.430894+0000", 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.018205063 2024-04-26T07:51:06.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436449+0000", 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0055546529999999997 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436582+0000", 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013349499999999999 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.436671+0000", 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8597000000000006e-05 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2979 3.1d 3:ba9645d5:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.358685905000002, 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030394228999999998, 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2979 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794893+0000", 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.794897+0000", 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2969999999999997e-06 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804170+0000", 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092730629999999998 2024-04-26T07:51:06.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804210+0000", 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0426999999999998e-05 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804229+0000", 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.893e-05 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804376+0000", 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014691500000000001 2024-04-26T07:51:06.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804637+0000", 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026043799999999999 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.804880+0000", 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024350500000000001 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.818402+0000", 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013521574999999999 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825159+0000", 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067568710000000002 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825217+0000", 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8604000000000003e-05 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.825287+0000", 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9604000000000006e-05 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3279 3.5 3:a273d8b6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_294:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.920701754, 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027017204999999999, 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.202 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3279 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232877+0000", 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.232880+0000", 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5700000000000001e-06 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237876+0000", 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049959890000000002 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237914+0000", 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7166000000000003e-05 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.237938+0000", 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4559999999999999e-05 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238136+0000", 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000197672 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238418+0000", 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028272200000000001 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.238667+0000", 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024804100000000001 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.248432+0000", 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097655169999999996 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259686+0000", 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011253582 2024-04-26T07:51:06.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259773+0000", 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.7689999999999996e-05 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.259894+0000", 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000120696 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.207 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3310 3.1d 3:bbab4933:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.584154956999999, 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024852018999999999, 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3310 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569424+0000", 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.569427+0000", 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3759999999999999e-06 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574227+0000", 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048002490000000004 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574263+0000", 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5366e-05 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574285+0000", 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2802999999999998e-05 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574407+0000", 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121827 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.574743+0000", 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033614199999999999 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.575020+0000", 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000276731 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.586811+0000", 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011791322 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594014+0000", 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072022680000000004 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594163+0000", 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000149605 2024-04-26T07:51:06.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.594276+0000", 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011233 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3337 3.2a 3:5576afd6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.274797526, 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024210850999999999, 2024-04-26T07:51:06.213 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3337 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878781+0000", 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.878785+0000", 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8e-06 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884461+0000", 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0056765080000000002 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884499+0000", 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8006999999999997e-05 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884528+0000", 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.8215999999999999e-05 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.884685+0000", 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015766900000000001 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.885092+0000", 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040696100000000001 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.885545+0000", 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045240299999999998 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.900806+0000", 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015261082 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902766+0000", 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001959854 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902868+0000", 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010214500000000001 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.902992+0000", 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000124206 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.218 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3358 3.2a 3:5403285b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_373:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.044707851999998, 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044350464999999999, 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3358 2024-04-26T07:51:06.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108871+0000", 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.108875+0000", 2024-04-26T07:51:06.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5700000000000003e-06 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117074+0000", 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081984469999999993 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117127+0000", 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3359000000000002e-05 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117156+0000", 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9312999999999999e-05 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117376+0000", 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000219946 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117397+0000", 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0449e-05 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131014+0000", 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013617304 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131236+0000", 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022168200000000001 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131455+0000", 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00021913100000000001 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.146752+0000", 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015297445 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.152923+0000", 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061707869999999996 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.153094+0000", 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017126899999999999 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.153221+0000", 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012676300000000001 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3359 3.3c 3:3d78e8bc:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.036259000000001, 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.038491746, 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.225 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3359 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117320+0000", 2024-04-26T07:51:06.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.117323+0000", 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0060000000000001e-06 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125017+0000", 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076944609999999997 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125056+0000", 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8819999999999998e-05 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125075+0000", 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9352999999999999e-05 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125215+0000", 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000139672 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.125234+0000", 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9386999999999999e-05 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131593+0000", 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0063589930000000003 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131791+0000", 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019822899999999999 2024-04-26T07:51:06.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.131988+0000", 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019633500000000001 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.149711+0000", 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017723161000000001 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155565+0000", 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058539200000000003 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155706+0000", 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000141252 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155811+0000", 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105157 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:3361 3.36 e80/17 3:6fb653d9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_376:head v 80'20, mlcod=79'18)", 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.997548104, 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024761258000000001, 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156030+0000", 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.156031+0000", 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0299999999999999e-07 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159443+0000", 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0034118960000000002 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159474+0000", 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1495000000000003e-05 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159491+0000", 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6625000000000001e-05 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159658+0000", 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016732699999999999 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.159731+0000", 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.2862999999999997e-05 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.180648+0000", 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020916396 2024-04-26T07:51:06.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.180792+0000", 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144053 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3405 3.16 3:68271ef4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_420:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.556206365000001, 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024793686999999998, 2024-04-26T07:51:06.236 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3405 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597372+0000", 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.597377+0000", 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1900000000000003e-06 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601615+0000", 2024-04-26T07:51:06.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042371880000000002 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601654+0000", 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9266e-05 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601672+0000", 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8406e-05 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.601846+0000", 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017330899999999999 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.602257+0000", 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041117399999999999 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.602699+0000", 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044251700000000002 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.615866+0000", 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013166862999999999 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.621980+0000", 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061141779999999996 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.622082+0000", 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000102036 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.622166+0000", 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.3560000000000006e-05 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3414 3.16 3:6ba6e04b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_429:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.461499922000002, 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029030314000000002, 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.242 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3414 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692079+0000", 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.692082+0000", 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1559999999999999e-06 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.696989+0000", 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004907649 2024-04-26T07:51:06.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697029+0000", 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.943e-05 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697049+0000", 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0574e-05 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697189+0000", 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013976900000000001 2024-04-26T07:51:06.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697460+0000", 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027075800000000001 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.697689+0000", 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00022929499999999999 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.718106+0000", 2024-04-26T07:51:06.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.020416863 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.720916+0000", 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.002809878 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.721031+0000", 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000115153 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.721109+0000", 2024-04-26T07:51:06.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7788999999999997e-05 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3668 3.d 3:b324830a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:02.127575+0000", 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.0260039130000003, 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029465804000000002, 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.248 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3668 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.127575+0000", 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.127575+0000", 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.127577+0000", 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4930000000000001e-06 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.131193+0000", 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0036161180000000002 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.131209+0000", 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6174000000000001e-05 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.131217+0000", 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7370000000000006e-06 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.131331+0000", 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011382099999999999 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.131490+0000", 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015900199999999999 2024-04-26T07:51:06.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.131637+0000", 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000146902 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.150922+0000", 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019284689000000001 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.156874+0000", 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059527149999999999 2024-04-26T07:51:06.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.156943+0000", 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8876999999999998e-05 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.157040+0000", 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7275999999999995e-05 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.253 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3941 3.c 3:3280ab96:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:05.040318+0000", 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.113260522, 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026742668000000001, 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.254 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3941 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.040318+0000", 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.040318+0000", 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.040322+0000", 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.827e-06 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.044575+0000", 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042529530000000003 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.044638+0000", 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3170000000000007e-05 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.044659+0000", 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0676999999999999e-05 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.044794+0000", 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013550899999999999 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.044807+0000", 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2782999999999999e-05 2024-04-26T07:51:06.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.052501+0000", 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076940899999999998 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.052782+0000", 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028074399999999998 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 3", 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.053075+0000", 2024-04-26T07:51:06.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000293515 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.062333+0000", 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092572360000000003 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.066800+0000", 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004467937 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.066948+0000", 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000147367 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.067061+0000", 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011286 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3942 3.d 3:b21bd4e9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_294:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:05.051801+0000", 2024-04-26T07:51:06.260 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.101777145, 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.031663131999999997, 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3942 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.051801+0000", 2024-04-26T07:51:06.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.051801+0000", 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.051804+0000", 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0699999999999998e-06 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.059917+0000", 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0081123140000000007 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.059968+0000", 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1096e-05 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.059988+0000", 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9826e-05 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.060189+0000", 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020127599999999999 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.060596+0000", 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040733700000000002 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.061049+0000", 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00045223399999999998 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.072165+0000", 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011116508000000001 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.083172+0000", 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011006637 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.083343+0000", 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000170865 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.083465+0000", 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121969 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3984 3.3a 3:5e6caefd:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_336:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:05.622953+0000", 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.53062578400000004, 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029626410999999998, 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.266 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3984 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.622953+0000", 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.622953+0000", 2024-04-26T07:51:06.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.622955+0000", 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6410000000000002e-06 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.627075+0000", 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041196560000000002 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.627099+0000", 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3913999999999998e-05 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.627109+0000", 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.9040000000000004e-06 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.627262+0000", 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000153005 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.627671+0000", 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040881700000000001 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.628070+0000", 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039956099999999999 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.639745+0000", 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011674929000000001 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.652252+0000", 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012506486000000001 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.652445+0000", 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000193098 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.652579+0000", 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013439999999999999 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.271 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.272 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.272 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.272 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:06.273 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:51:06.274 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:06.270+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:06.374 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:06.369+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:06.445 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:06.445 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:06.445 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:51:06.445 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:06.462 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:51:06.475 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:06.469+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:06.576 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:06.573+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:06.592 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:51:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:51:06.592 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:06.606 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:51:06.677 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:51:06.674+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:51:06.736 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:06.736 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-26T07:51:06.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 157.17881705900001, 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029997412000000001, 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 46 2024-04-26T07:51:06.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557745+0000", 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557748+0000", 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6070000000000002e-06 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557761+0000", 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3927000000000001e-05 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557793+0000", 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1340000000000001e-05 2024-04-26T07:51:06.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557816+0000", 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3016000000000001e-05 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.557988+0000", 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000172392 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.558001+0000", 2024-04-26T07:51:06.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.323e-05 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564035+0000", 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060339340000000003 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for peered", 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.564047+0000", 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.204e-05 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572042+0000", 2024-04-26T07:51:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079943619999999996 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572290+0000", 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024869399999999999 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.572572+0000", 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00028187500000000001 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.576278+0000", 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.003706099 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587480+0000", 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011201091999999999 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587629+0000", 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00014928599999999999 2024-04-26T07:51:06.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:48:29.587742+0000", 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011351800000000001 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2102 3.35 3:acfca6b4:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.490102281999995, 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025241564000000001, 2024-04-26T07:51:06.744 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2102 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246460+0000", 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.246463+0000", 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.106e-06 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252299+0000", 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058363080000000001 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252331+0000", 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1914e-05 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252346+0000", 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4829e-05 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252506+0000", 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015995500000000001 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.252872+0000", 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000365817 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.253249+0000", 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00037744100000000001 2024-04-26T07:51:06.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271215+0000", 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017965979 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271568+0000", 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035317600000000002 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271630+0000", 2024-04-26T07:51:06.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1853000000000006e-05 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:40.271701+0000", 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1186000000000006e-05 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4458.0:2218 3.34 e59/17 3:2c0297fe:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.9__shadow_.bsP4T2t8cxaviKvq6D4IRiD4GIqzXxo_107:head v 59'2, mlcod=0'0)", 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 84.700826550000002, 2024-04-26T07:51:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030663971000000002, 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035735+0000", 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.035737+0000", 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0869999999999999e-06 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039593+0000", 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0038566609999999999 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039642+0000", 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8699999999999998e-05 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039669+0000", 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.7350000000000001e-05 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039870+0000", 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020093199999999999 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.039931+0000", 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1294e-05 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066342+0000", 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026410869 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:49:42.066399+0000", 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7077999999999998e-05 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2642 3.26 3:660978ca:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 48.703692115000003, 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.028089177, 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2642 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032870+0000", 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.032873+0000", 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4599999999999999e-06 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038900+0000", 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060268300000000004 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038936+0000", 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5469999999999998e-05 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.038954+0000", 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7903000000000001e-05 2024-04-26T07:51:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039143+0000", 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000189118 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039587+0000", 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000444027 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.039995+0000", 2024-04-26T07:51:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00040862100000000002 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.050770+0000", 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010774327 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060672+0000", 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099018999999999999 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060837+0000", 2024-04-26T07:51:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000165885 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.060959+0000", 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121636 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2653 3.35 3:af769224:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 48.583054126, 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025812589, 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2653 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153508+0000", 2024-04-26T07:51:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.153512+0000", 2024-04-26T07:51:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1189999999999999e-06 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158218+0000", 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0047056720000000002 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158268+0000", 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0319999999999999e-05 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158299+0000", 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1189000000000002e-05 2024-04-26T07:51:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158465+0000", 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016535899999999999 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.158802+0000", 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00033700800000000002 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.159078+0000", 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027675200000000001 2024-04-26T07:51:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179029+0000", 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.019950658999999999 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179143+0000", 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000114245 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179234+0000", 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0305999999999999e-05 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.179320+0000", 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6959999999999994e-05 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2670 3.a 3:530171a9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_105:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 48.387517983999999, 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024254465999999999, 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2670 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349044+0000", 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.349047+0000", 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3969999999999998e-06 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.352981+0000", 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039336040000000003 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353021+0000", 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9932999999999999e-05 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353041+0000", 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9755999999999999e-05 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353179+0000", 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013804600000000001 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353464+0000", 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000285335 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.353706+0000", 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024165499999999999 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.362865+0000", 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00915967 2024-04-26T07:51:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.372976+0000", 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010110472000000001 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.373155+0000", 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000179469 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:18.373298+0000", 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000143129 2024-04-26T07:51:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2798 3.26 3:65c1d500:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.989734421999998, 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026073496000000002, 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2798 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746828+0000", 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.746831+0000", 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7270000000000001e-06 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.751974+0000", 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051423550000000004 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752019+0000", 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5729999999999998e-05 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752046+0000", 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6838999999999998e-05 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752177+0000", 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013056999999999999 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752428+0000", 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000250871 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.752665+0000", 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00023739799999999999 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.761126+0000", 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.008461049 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772651+0000", 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011525262999999999 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772796+0000", 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000144382 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.772901+0000", 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105312 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2799 3.26 3:67acbf7d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.979110085000002, 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026954779000000002, 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2799 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757452+0000", 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.757456+0000", 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5999999999999998e-06 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.764926+0000", 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074704230000000003 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.764973+0000", 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6922999999999998e-05 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765002+0000", 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9203000000000001e-05 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765131+0000", 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012904299999999999 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765396+0000", 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026475799999999997 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.765656+0000", 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00025973499999999998 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.774155+0000", 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084992799999999997 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784112+0000", 2024-04-26T07:51:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099569930000000008 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784289+0000", 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017662799999999999 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.784407+0000", 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000118193 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2806 3.35 3:ad99b9ab:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.10__shadow_.9Up3jBp5g-oPeeUSGvgkzmterWj9ndZ_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.905897295999999, 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025789340000000001, 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2806 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830665+0000", 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.830686+0000", 2024-04-26T07:51:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1763000000000002e-05 2024-04-26T07:51:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835651+0000", 2024-04-26T07:51:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049641529999999998 2024-04-26T07:51:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835681+0000", 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.9967e-05 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835699+0000", 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8065999999999999e-05 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.835867+0000", 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016876200000000001 2024-04-26T07:51:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.836266+0000", 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039829500000000001 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.836707+0000", 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00044176000000000003 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.847725+0000", 2024-04-26T07:51:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011017506 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856182+0000", 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084570960000000008 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856349+0000", 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000166439 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:19.856454+0000", 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010553299999999999 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:2976 3.2c 3:37a6e58a:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.983007739000001, 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027636029999999999, 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 2976 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753554+0000", 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.753557+0000", 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0400000000000001e-06 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759271+0000", 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0057135069999999996 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759308+0000", 2024-04-26T07:51:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7555999999999998e-05 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759327+0000", 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8277000000000001e-05 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759492+0000", 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016504900000000001 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.759922+0000", 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042981300000000003 2024-04-26T07:51:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.760383+0000", 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000461201 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.773654+0000", 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013270929000000001 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.780865+0000", 2024-04-26T07:51:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072115970000000001 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.781051+0000", 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000186109 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:37.781190+0000", 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013895199999999999 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3304 3.36 3:6d1acc3e:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_319:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.230739276000001, 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029248973000000001, 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3304 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505823+0000", 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.505827+0000", 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0439999999999997e-06 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511763+0000", 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059365820000000001 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511802+0000", 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8296000000000001e-05 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511820+0000", 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8377e-05 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.511984+0000", 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016365600000000001 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.512397+0000", 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041346699999999999 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.512819+0000", 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042219000000000002 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.525450+0000", 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.01263016 2024-04-26T07:51:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.534770+0000", 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0093202330000000007 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.534938+0000", 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000168245 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.535072+0000", 2024-04-26T07:51:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013372300000000001 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3323 3.2c 3:37b6bfd3:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_338:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.028217896000001, 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023969408000000001, 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3323 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708344+0000", 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.708347+0000", 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.14e-06 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712309+0000", 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039621760000000004 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712348+0000", 2024-04-26T07:51:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8386000000000001e-05 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712367+0000", 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9216999999999999e-05 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712506+0000", 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013908900000000001 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.712779+0000", 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027279799999999999 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.713020+0000", 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024111799999999999 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.722732+0000", 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0097123969999999994 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732000+0000", 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0092674999999999997 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732175+0000", 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017472200000000001 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:41.732314+0000", 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013886500000000001 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3349 3.2c 3:35dd8e5b:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_364:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.732651476000001, 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.025879333000000001, 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3349 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003911+0000", 2024-04-26T07:51:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.003913+0000", 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5469999999999999e-06 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.007957+0000", 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0040434219999999996 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.007988+0000", 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1473000000000002e-05 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008006+0000", 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7810000000000001e-05 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008139+0000", 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000133602 2024-04-26T07:51:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008409+0000", 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026979899999999998 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.008654+0000", 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024439200000000001 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.018119+0000", 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0094655439999999993 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029492+0000", 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.011372996 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029660+0000", 2024-04-26T07:51:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016761200000000001 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.029790+0000", 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013013599999999999 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3361 3.36 3:6fb653d9:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_376:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.599433884, 2024-04-26T07:51:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.044308437999999999, 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3361 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137128+0000", 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.137134+0000", 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6130000000000003e-06 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144821+0000", 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076868769999999999 2024-04-26T07:51:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144872+0000", 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.134e-05 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.144897+0000", 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5347e-05 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.145083+0000", 2024-04-26T07:51:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000185298 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.145101+0000", 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8026999999999999e-05 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155170+0000", 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010069794 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155500+0000", 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00032923400000000003 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.155731+0000", 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000231478 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.179162+0000", 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023431110000000002 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181138+0000", 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001975367 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181295+0000", 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000157742 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.181437+0000", 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000141211 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3366 3.35 3:ae42cef6:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_381:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.543485095000001, 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.024877366000000001, 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3366 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193077+0000", 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.193081+0000", 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6569999999999999e-06 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198183+0000", 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051024069999999998 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198218+0000", 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5240000000000001e-05 2024-04-26T07:51:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198244+0000", 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.563e-05 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198366+0000", 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000121758 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198662+0000", 2024-04-26T07:51:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00029598999999999999 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.198924+0000", 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026244300000000001 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.216160+0000", 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017236006000000002 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217729+0000", 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001568896 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217872+0000", 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000143382 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.217954+0000", 2024-04-26T07:51:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1957000000000002e-05 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3376 3.a 3:52d883ff:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_391:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.436440830999999, 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.030462698, 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3376 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300121+0000", 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.300125+0000", 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2339999999999996e-06 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306292+0000", 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006166721 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306332+0000", 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9888999999999997e-05 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306351+0000", 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8997000000000001e-05 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306477+0000", 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00012618199999999999 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.306761+0000", 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000283789 2024-04-26T07:51:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 4", 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.307034+0000", 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00027255399999999999 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.320094+0000", 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013060024 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330404+0000", 2024-04-26T07:51:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.010310685 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330506+0000", 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101686 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.330584+0000", 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7936999999999996e-05 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3425 3.36 3:6fcd7b97:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_440:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.92709739, 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.029676536, 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3425 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809465+0000", 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.809468+0000", 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3830000000000001e-06 2024-04-26T07:51:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.813970+0000", 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0045021530000000001 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814022+0000", 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2160000000000002e-05 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814043+0000", 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0472999999999999e-05 2024-04-26T07:51:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814184+0000", 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000140822 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814448+0000", 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00026465499999999998 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.814760+0000", 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00031151799999999999 2024-04-26T07:51:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.838297+0000", 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.023537215 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.838927+0000", 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00063033200000000005 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.839021+0000", 2024-04-26T07:51:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.4018999999999995e-05 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:42.839141+0000", 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000119806 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3470 3.36 3:6ccc0563:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.11__shadow_.XTRMv9FO-csa6qZ_4uepiR7FzDccwpL_485:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.265372779, 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.02579234, 2024-04-26T07:51:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3470 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471189+0000", 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.471192+0000", 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.357e-06 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475395+0000", 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0042034380000000003 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475446+0000", 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0726000000000002e-05 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475472+0000", 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6693e-05 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.475663+0000", 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00019097600000000001 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476091+0000", 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00042763399999999998 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 5", 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.476528+0000", 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00043667000000000001 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.492375+0000", 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015847421 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496686+0000", 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0043108030000000002 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496846+0000", 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000159739 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:50:43.496982+0000", 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000135883 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:3661 3.3f 3:fe38d32d:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:02.052294+0000", 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.6842684239999999, 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.026432180999999999, 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 3661 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.052294+0000", 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.052294+0000", 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.052296+0000", 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.835e-06 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.056287+0000", 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039907149999999997 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.056325+0000", 2024-04-26T07:51:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7691000000000002e-05 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.056342+0000", 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6823000000000001e-05 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.056455+0000", 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011320900000000001 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.056467+0000", 2024-04-26T07:51:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1651000000000001e-05 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.061360+0000", 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0048937679999999997 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.061525+0000", 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000164933 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 7", 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.061690+0000", 2024-04-26T07:51:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000164964 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.070575+0000", 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0088847059999999992 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.078515+0000", 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079403219999999997 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.078633+0000", 2024-04-26T07:51:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0001177 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:02.078726+0000", 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2863999999999997e-05 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4458.0:4010 3.10 3:0a5c6b57:::350b6854-d1dd-4485-9f33-ad1fad5247c8.4458.12__shadow_.QuhQnLeGmQgPXDzWKh8mokxAQ9xrfz7_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-26T07:51:05.984154+0000", 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.752408203, 2024-04-26T07:51:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.027962519000000002, 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4458", 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "172.21.15.53:0/909954941", 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 4010 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.984154+0000", 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.984154+0000", 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.984157+0000", 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.05e-06 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.988141+0000", 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039840889999999997 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.988180+0000", 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8840000000000001e-05 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.988202+0000", 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2486000000000001e-05 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.988300+0000", 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7505999999999998e-05 2024-04-26T07:51:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.988434+0000", 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00013429499999999999 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.988544+0000", 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010980300000000001 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:05.995356+0000", 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068118240000000002 2024-04-26T07:51:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:06.011987+0000", 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016631039 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:06.012066+0000", 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9684999999999993e-05 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-26T07:51:06.012116+0000", 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9901999999999998e-05 2024-04-26T07:51:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-26T07:51:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-26T07:51:06.856 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:06.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:51:06.858 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:06.853+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:06.920 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T07:51:06.958 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:06.954+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:07.040 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:07.040 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-26T07:51:07.041 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:07.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:51:07.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:51:07.099 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-26T07:51:07.098+0000 7f2cec7ce640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25243) UID: 0 2024-04-26T07:51:07.107 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0: {} 2024-04-26T07:51:07.107 INFO:teuthology.orchestra.run.smithi053.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T07:51:07.128 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1: {} 2024-04-26T07:51:07.128 INFO:teuthology.orchestra.run.smithi053.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T07:51:07.155 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2: {} 2024-04-26T07:51:07.155 INFO:teuthology.orchestra.run.smithi053.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T07:51:07.159 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:07.157+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:07.192 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3: {} 2024-04-26T07:51:07.192 INFO:teuthology.orchestra.run.smithi053.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T07:51:07.233 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4: {} 2024-04-26T07:51:07.234 INFO:teuthology.orchestra.run.smithi053.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T07:51:07.246 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-26T07:51:07.246 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-26T07:51:07.246 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-26T07:51:07.246 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-26T07:51:07.247 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-26T07:51:07.260 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:07.257+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:07.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:51:07.269 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5: {} 2024-04-26T07:51:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T07:51:07.308 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6: {} 2024-04-26T07:51:07.309 INFO:teuthology.orchestra.run.smithi053.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T07:51:07.336 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7: {} 2024-04-26T07:51:07.336 INFO:teuthology.orchestra.run.smithi053.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T07:51:07.360 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:07.358+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:07.401 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:07.401 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:07.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T07:51:07.466 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:07.466+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:07.563 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:07.562+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:07.578 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:07.578 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:07.605 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T07:51:07.663 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:07.661+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:07.765 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:07.761+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:07.767 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:07.767 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:07.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T07:51:07.879 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:07.877+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:07.967 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:07.966+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:07.988 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:07.988 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:08.011 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T07:51:08.103 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-04-26T07:51:08.101+0000 7f0f7f06f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25095) UID: 0 2024-04-26T07:51:08.139 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:51:08.168 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:08.166+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:08.191 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:08.191 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:08.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T07:51:08.234 INFO:tasks.workunit.client.0.smithi053.stdout:quota disabled for the bucket: buck_2024_03_26_07_50_57 2024-04-26T07:51:08.235 INFO:tasks.workunit.client.0.smithi053.stdout:adding file to bucket: 2Gb. 2024-04-26T07:51:08.235 INFO:tasks.workunit.client.0.smithi053.stdout:upload file successful 2024-04-26T07:51:08.235 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:51:08.235 INFO:tasks.workunit.client.0.smithi053.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-04-26T07:51:08.235 INFO:tasks.workunit.client.0.smithi053.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T07:51:08.283 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:08.281+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:08.354 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:08.354 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:08.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T07:51:08.370 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:08.370+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:08.471 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-04-26T07:51:08.469+0000 7fd8ee333640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25092) UID: 0 2024-04-26T07:51:08.503 INFO:tasks.workunit.client.0.smithi053.stdout:user qa_user deleted 2024-04-26T07:51:08.503 INFO:tasks.workunit.client.0.smithi053.stdout:bucket delete succeeded 2024-04-26T07:51:08.507 INFO:tasks.workunit.client.0.smithi053.stdout:OK 2024-04-26T07:51:08.507 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T07:51:08.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T07:51:08.528 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:08.528 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:08.538 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-04-26T07:51:08.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T07:51:08.543 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T07:51:08.573 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-26T07:51:08.570+0000 7f501d670640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25241) UID: 0 2024-04-26T07:51:08.674 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:08.669+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:08.701 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:08.702 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:08.715 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T07:51:08.803 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-04-26T07:51:08.801+0000 7f75e2e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25091) UID: 0 2024-04-26T07:51:08.876 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-04-26T07:51:08.873+0000 7fda5646b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25088) UID: 0 2024-04-26T07:51:08.884 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:08.884 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:08.885 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:08.886 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T07:51:08.898 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T07:51:08.949 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T07:51:08.949 DEBUG:teuthology.orchestra.run.smithi053:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-26T07:51:08.979 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-26T07:51:08.978+0000 7f19da55a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25239) UID: 0 2024-04-26T07:51:09.006 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T07:51:09.007 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T07:51:09.017 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T07:51:09.051 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:09.051 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:09.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T07:51:09.189 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:09.189 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:09.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T07:51:09.323 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:09.323 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:09.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T07:51:09.467 INFO:teuthology.orchestra.run.smithi053.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:09.467 INFO:teuthology.orchestra.run.smithi053.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:09.481 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T07:51:09.616 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:09.616 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:09.631 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T07:51:09.752 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:09.752 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:09.767 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T07:51:09.884 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:09.885 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:09.901 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T07:51:10.025 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:10.025 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:10.039 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T07:51:10.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T07:51:10.163 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:10.163 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:10.178 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T07:51:10.300 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:10.300 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:10.314 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T07:51:10.431 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:10.432 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:10.446 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T07:51:10.568 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:10.568 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:10.582 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T07:51:10.704 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:10.704 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:10.718 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T07:51:10.835 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:10.835 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:10.849 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T07:51:10.974 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:10.974 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:10.988 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T07:51:11.105 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-26T07:51:11.105 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T07:51:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:noscrub is unset 2024-04-26T07:51:11.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T07:51:12.167 INFO:teuthology.orchestra.run.smithi053.stderr:nodeep-scrub is unset 2024-04-26T07:51:22.964 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T07:51:23.115 INFO:teuthology.orchestra.run.smithi053.stdout:mon.a: {} 2024-04-26T07:51:23.115 INFO:teuthology.orchestra.run.smithi053.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T07:51:23.127 INFO:teuthology.orchestra.run.smithi053.stdout:mon.b: {} 2024-04-26T07:51:23.128 INFO:teuthology.orchestra.run.smithi053.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T07:51:23.138 INFO:teuthology.orchestra.run.smithi053.stdout:mon.c: {} 2024-04-26T07:51:23.138 INFO:teuthology.orchestra.run.smithi053.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T07:51:23.155 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T07:51:24.176 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T07:51:24.199 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T07:51:25.181 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T07:51:25.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T07:51:26.203 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T07:51:26.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T07:51:27.208 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T07:51:27.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T07:51:28.219 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T07:51:28.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T07:51:29.221 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T07:51:29.252 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T07:51:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T07:51:30.268 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-26T07:51:31.250 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-26T07:51:31.281 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T07:51:32.274 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T07:51:32.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-26T07:51:33.287 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-26T07:51:33.316 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T07:51:34.303 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T07:51:34.328 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-26T07:51:35.318 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-26T07:51:35.340 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T07:51:36.332 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T07:51:36.359 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-26T07:51:37.345 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-26T07:51:37.372 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T07:51:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T07:51:38.389 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-26T07:51:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-26T07:51:39.400 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T07:51:39.400 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T07:51:39.400 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T07:51:39.400 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T07:51:39.400 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T07:51:39.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:51:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:39.704 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":108,"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","created":"2024-04-26T07:48:02.780799+0000","modified":"2024-04-26T07:51:39.364219+0000","last_up_change":"2024-04-26T07:48:13.428691+0000","last_in_change":"2024-04-26T07:48:05.145685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T07:48:13.824353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:48:13.909036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T07:48:20.264760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T07:48:21.834004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T07:48:23.784334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T07:48:25.689056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T07:48:27.593594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T07:48:29.723741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c19b301-d4c3-4075-aea7-ab2ee53aaf3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6818","nonce":3522703831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6822","nonce":3522703831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6831","nonce":3522703831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6827","nonce":3522703831}]},"public_addr":"172.21.15.53:6818/3522703831","cluster_addr":"172.21.15.53:6822/3522703831","heartbeat_back_addr":"172.21.15.53:6831/3522703831","heartbeat_front_addr":"172.21.15.53:6827/3522703831","state":["exists","up"]},{"osd":1,"uuid":"639db176-ee73-4aa3-aa4b-e1e713fb0026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6802","nonce":4143904497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6806","nonce":4143904497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6814","nonce":4143904497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6810","nonce":4143904497}]},"public_addr":"172.21.15.53:6802/4143904497","cluster_addr":"172.21.15.53:6806/4143904497","heartbeat_back_addr":"172.21.15.53:6814/4143904497","heartbeat_front_addr":"172.21.15.53:6810/4143904497","state":["exists","up"]},{"osd":2,"uuid":"f2832add-3da3-4a41-b7eb-80c0b58a6166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6819","nonce":2446521991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6823","nonce":2446521991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6829","nonce":2446521991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6826","nonce":2446521991}]},"public_addr":"172.21.15.53:6819/2446521991","cluster_addr":"172.21.15.53:6823/2446521991","heartbeat_back_addr":"172.21.15.53:6829/2446521991","heartbeat_front_addr":"172.21.15.53:6826/2446521991","state":["exists","up"]},{"osd":3,"uuid":"e532d54a-ed1f-4177-8289-2eea90fe5d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6803","nonce":3123753498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6807","nonce":3123753498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6813","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6815","nonce":3123753498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6811","nonce":3123753498}]},"public_addr":"172.21.15.53:6803/3123753498","cluster_addr":"172.21.15.53:6807/3123753498","heartbeat_back_addr":"172.21.15.53:6815/3123753498","heartbeat_front_addr":"172.21.15.53:6811/3123753498","state":["exists","up"]},{"osd":4,"uuid":"17337c8b-3ed8-41fb-900b-e7068a4cc2e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6817","nonce":4225192245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6820","nonce":4225192245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6827","nonce":4225192245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6823","nonce":4225192245}]},"public_addr":"172.21.15.191:6817/4225192245","cluster_addr":"172.21.15.191:6820/4225192245","heartbeat_back_addr":"172.21.15.191:6827/4225192245","heartbeat_front_addr":"172.21.15.191:6823/4225192245","state":["exists","up"]},{"osd":5,"uuid":"99310d57-c1a3-4935-9bbf-908dd237036d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6801","nonce":1158804178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6803","nonce":1158804178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6808","nonce":1158804178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6805","nonce":1158804178}]},"public_addr":"172.21.15.191:6801/1158804178","cluster_addr":"172.21.15.191:6803/1158804178","heartbeat_back_addr":"172.21.15.191:6808/1158804178","heartbeat_front_addr":"172.21.15.191:6805/1158804178","state":["exists","up"]},{"osd":6,"uuid":"2fef5c6a-e83d-4ab2-b571-794295b6fe31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6809","nonce":451207779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6811","nonce":451207779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6815","nonce":451207779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6813","nonce":451207779}]},"public_addr":"172.21.15.191:6809/451207779","cluster_addr":"172.21.15.191:6811/451207779","heartbeat_back_addr":"172.21.15.191:6815/451207779","heartbeat_front_addr":"172.21.15.191:6813/451207779","state":["exists","up"]},{"osd":7,"uuid":"82fb2b9a-7a8d-4af8-ab0e-94da703625ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6819","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6821","nonce":2025100830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6826","nonce":2025100830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6831","nonce":2025100830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6829","nonce":2025100830}]},"public_addr":"172.21.15.191:6821/2025100830","cluster_addr":"172.21.15.191:6826/2025100830","heartbeat_back_addr":"172.21.15.191:6831/2025100830","heartbeat_front_addr":"172.21.15.191:6829/2025100830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.773775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751251+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.671594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.697516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.606898+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.566440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.783389+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.f","osds":[3,0]}],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:51:39.725 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T07:51:39.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:51:40.026 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:40.026 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":108,"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","created":"2024-04-26T07:48:02.780799+0000","modified":"2024-04-26T07:51:39.364219+0000","last_up_change":"2024-04-26T07:48:13.428691+0000","last_in_change":"2024-04-26T07:48:05.145685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T07:48:13.824353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:48:13.909036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T07:48:20.264760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T07:48:21.834004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T07:48:23.784334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T07:48:25.689056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T07:48:27.593594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T07:48:29.723741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c19b301-d4c3-4075-aea7-ab2ee53aaf3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6818","nonce":3522703831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6822","nonce":3522703831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6831","nonce":3522703831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6827","nonce":3522703831}]},"public_addr":"172.21.15.53:6818/3522703831","cluster_addr":"172.21.15.53:6822/3522703831","heartbeat_back_addr":"172.21.15.53:6831/3522703831","heartbeat_front_addr":"172.21.15.53:6827/3522703831","state":["exists","up"]},{"osd":1,"uuid":"639db176-ee73-4aa3-aa4b-e1e713fb0026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6802","nonce":4143904497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6806","nonce":4143904497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6814","nonce":4143904497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6810","nonce":4143904497}]},"public_addr":"172.21.15.53:6802/4143904497","cluster_addr":"172.21.15.53:6806/4143904497","heartbeat_back_addr":"172.21.15.53:6814/4143904497","heartbeat_front_addr":"172.21.15.53:6810/4143904497","state":["exists","up"]},{"osd":2,"uuid":"f2832add-3da3-4a41-b7eb-80c0b58a6166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6819","nonce":2446521991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6823","nonce":2446521991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6829","nonce":2446521991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6826","nonce":2446521991}]},"public_addr":"172.21.15.53:6819/2446521991","cluster_addr":"172.21.15.53:6823/2446521991","heartbeat_back_addr":"172.21.15.53:6829/2446521991","heartbeat_front_addr":"172.21.15.53:6826/2446521991","state":["exists","up"]},{"osd":3,"uuid":"e532d54a-ed1f-4177-8289-2eea90fe5d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6803","nonce":3123753498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6807","nonce":3123753498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6813","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6815","nonce":3123753498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6811","nonce":3123753498}]},"public_addr":"172.21.15.53:6803/3123753498","cluster_addr":"172.21.15.53:6807/3123753498","heartbeat_back_addr":"172.21.15.53:6815/3123753498","heartbeat_front_addr":"172.21.15.53:6811/3123753498","state":["exists","up"]},{"osd":4,"uuid":"17337c8b-3ed8-41fb-900b-e7068a4cc2e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6817","nonce":4225192245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6820","nonce":4225192245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6827","nonce":4225192245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6823","nonce":4225192245}]},"public_addr":"172.21.15.191:6817/4225192245","cluster_addr":"172.21.15.191:6820/4225192245","heartbeat_back_addr":"172.21.15.191:6827/4225192245","heartbeat_front_addr":"172.21.15.191:6823/4225192245","state":["exists","up"]},{"osd":5,"uuid":"99310d57-c1a3-4935-9bbf-908dd237036d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6801","nonce":1158804178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6803","nonce":1158804178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6808","nonce":1158804178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6805","nonce":1158804178}]},"public_addr":"172.21.15.191:6801/1158804178","cluster_addr":"172.21.15.191:6803/1158804178","heartbeat_back_addr":"172.21.15.191:6808/1158804178","heartbeat_front_addr":"172.21.15.191:6805/1158804178","state":["exists","up"]},{"osd":6,"uuid":"2fef5c6a-e83d-4ab2-b571-794295b6fe31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6809","nonce":451207779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6811","nonce":451207779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6815","nonce":451207779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6813","nonce":451207779}]},"public_addr":"172.21.15.191:6809/451207779","cluster_addr":"172.21.15.191:6811/451207779","heartbeat_back_addr":"172.21.15.191:6815/451207779","heartbeat_front_addr":"172.21.15.191:6813/451207779","state":["exists","up"]},{"osd":7,"uuid":"82fb2b9a-7a8d-4af8-ab0e-94da703625ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6819","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6821","nonce":2025100830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6826","nonce":2025100830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6831","nonce":2025100830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6829","nonce":2025100830}]},"public_addr":"172.21.15.191:6821/2025100830","cluster_addr":"172.21.15.191:6826/2025100830","heartbeat_back_addr":"172.21.15.191:6831/2025100830","heartbeat_front_addr":"172.21.15.191:6829/2025100830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.773775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751251+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.671594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.697516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.606898+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.566440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.783389+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.f","osds":[3,0]}],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:51:40.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T07:51:40.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T07:51:40.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T07:51:40.048 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T07:51:40.048 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T07:51:40.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T07:51:40.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T07:51:40.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T07:51:40.307 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:40.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T07:51:40.314 INFO:teuthology.orchestra.run.smithi053.stdout:55834574892 2024-04-26T07:51:40.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:51:40.320 INFO:teuthology.orchestra.run.smithi053.stdout:55834574894 2024-04-26T07:51:40.320 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T07:51:40.321 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:40.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:51:40.323 INFO:teuthology.orchestra.run.smithi053.stdout:55834574894 2024-04-26T07:51:40.324 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:51:40.337 INFO:teuthology.orchestra.run.smithi053.stdout:55834574892 2024-04-26T07:51:40.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T07:51:40.338 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:40.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:51:40.341 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:40.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T07:51:40.831 INFO:teuthology.orchestra.run.smithi053.stdout:55834574891 2024-04-26T07:51:40.831 INFO:teuthology.orchestra.run.smithi053.stdout:55834574892 2024-04-26T07:51:40.842 INFO:teuthology.orchestra.run.smithi053.stdout:55834574892 2024-04-26T07:51:40.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.0 2024-04-26T07:51:40.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.4 2024-04-26T07:51:40.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.1 2024-04-26T07:51:40.872 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:40.891 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:40.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574893 for osd.5 2024-04-26T07:51:40.910 INFO:teuthology.orchestra.run.smithi053.stdout:55834574892 2024-04-26T07:51:40.912 INFO:teuthology.orchestra.run.smithi053.stdout:55834574892 2024-04-26T07:51:40.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574893 for osd.2 2024-04-26T07:51:40.913 INFO:teuthology.orchestra.run.smithi053.stdout:55834574891 2024-04-26T07:51:40.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.7 2024-04-26T07:51:40.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.3 2024-04-26T07:51:40.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.6 2024-04-26T07:51:41.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:51:41.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T07:51:41.873 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T07:51:41.898 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T07:51:41.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T07:51:41.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T07:51:41.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T07:51:41.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T07:51:42.374 INFO:teuthology.orchestra.run.smithi053.stdout:55834574891 2024-04-26T07:51:42.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.0 2024-04-26T07:51:42.447 INFO:teuthology.orchestra.run.smithi053.stdout:55834574894 2024-04-26T07:51:42.447 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:42.447 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:42.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.1 2024-04-26T07:51:42.449 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:42.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574894 for osd.5 2024-04-26T07:51:42.449 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:42.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.4 2024-04-26T07:51:42.459 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:42.473 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:42.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.3 2024-04-26T07:51:42.491 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:55834574894 2024-04-26T07:51:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:55834574893 2024-04-26T07:51:42.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574894 for osd.2 2024-04-26T07:51:42.511 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:42.517 INFO:teuthology.orchestra.run.smithi053.stdout:55834574892 2024-04-26T07:51:42.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.7 2024-04-26T07:51:42.519 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:42.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.6 2024-04-26T07:51:42.534 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:43.447 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T07:51:43.759 INFO:teuthology.orchestra.run.smithi053.stdout:55834574892 2024-04-26T07:51:43.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.0 2024-04-26T07:51:43.777 DEBUG:teuthology.parallel:result is None 2024-04-26T07:51:43.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T07:51:43.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:51:44.080 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:44.087 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:51:44.095 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-04-26T07:51:43.849306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3272,"num_read_kb":2961,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3892,"ondisk_log_size":3892,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12582732,"kb_used_data":12316636,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":742391988,"statfs":{"total":773094113280,"available":760209395712,"internally_reserved":0,"allocated":12612235264,"data_stored":12607640672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001738"},"pg_stats":[{"pgid":"3.3f","version":"89'27","reported_seq":213,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.556686+0000","last_change":"2024-04-26T07:50:53.973250+0000","last_active":"2024-04-26T07:51:38.556686+0000","last_peered":"2024-04-26T07:51:38.556686+0000","last_clean":"2024-04-26T07:51:38.556686+0000","last_became_active":"2024-04-26T07:50:53.972389+0000","last_became_peered":"2024-04-26T07:50:53.972389+0000","last_unstale":"2024-04-26T07:51:38.556686+0000","last_undegraded":"2024-04-26T07:51:38.556686+0000","last_fullsized":"2024-04-26T07:51:38.556686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:52.226385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405394+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:51:39.405394+0000","last_peered":"2024-04-26T07:51:39.405394+0000","last_clean":"2024-04-26T07:51:39.405394+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:51:39.405394+0000","last_undegraded":"2024-04-26T07:51:39.405394+0000","last_fullsized":"2024-04-26T07:51:39.405394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'26","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373790+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:51:39.373790+0000","last_peered":"2024-04-26T07:51:39.373790+0000","last_clean":"2024-04-26T07:51:39.373790+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:51:39.373790+0000","last_undegraded":"2024-04-26T07:51:39.373790+0000","last_fullsized":"2024-04-26T07:51:39.373790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":136,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.387146+0000","last_change":"2024-04-26T07:50:52.943972+0000","last_active":"2024-04-26T07:48:22.491812+0000","last_peered":"2024-04-26T07:48:22.491812+0000","last_clean":"2024-04-26T07:48:22.491812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.387146+0000","last_undegraded":"2024-04-26T07:51:39.387146+0000","last_fullsized":"2024-04-26T07:51:39.387146+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'21","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389818+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:39.389818+0000","last_peered":"2024-04-26T07:51:39.389818+0000","last_clean":"2024-04-26T07:51:39.389818+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:39.389818+0000","last_undegraded":"2024-04-26T07:51:39.389818+0000","last_fullsized":"2024-04-26T07:51:39.389818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":224,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375710+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:51:39.375710+0000","last_peered":"2024-04-26T07:51:39.375710+0000","last_clean":"2024-04-26T07:51:39.375710+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:51:39.375710+0000","last_undegraded":"2024-04-26T07:51:39.375710+0000","last_fullsized":"2024-04-26T07:51:39.375710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'23","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400577+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:39.400577+0000","last_peered":"2024-04-26T07:51:39.400577+0000","last_clean":"2024-04-26T07:51:39.400577+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:39.400577+0000","last_undegraded":"2024-04-26T07:51:39.400577+0000","last_fullsized":"2024-04-26T07:51:39.400577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392215+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:39.392215+0000","last_peered":"2024-04-26T07:51:39.392215+0000","last_clean":"2024-04-26T07:51:39.392215+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:39.392215+0000","last_undegraded":"2024-04-26T07:51:39.392215+0000","last_fullsized":"2024-04-26T07:51:39.392215+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'23","reported_seq":171,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.387527+0000","last_change":"2024-04-26T07:51:39.387527+0000","last_active":"2024-04-26T07:51:39.387527+0000","last_peered":"2024-04-26T07:51:07.858168+0000","last_clean":"2024-04-26T07:51:07.858168+0000","last_became_active":"2024-04-26T07:50:53.969003+0000","last_became_peered":"2024-04-26T07:50:53.969003+0000","last_unstale":"2024-04-26T07:51:39.387527+0000","last_undegraded":"2024-04-26T07:51:39.387527+0000","last_fullsized":"2024-04-26T07:51:39.387527+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407983+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:51:39.407983+0000","last_peered":"2024-04-26T07:51:39.407983+0000","last_clean":"2024-04-26T07:51:39.407983+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:51:39.407983+0000","last_undegraded":"2024-04-26T07:51:39.407983+0000","last_fullsized":"2024-04-26T07:51:39.407983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'22","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400511+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:51:39.400511+0000","last_peered":"2024-04-26T07:51:39.400511+0000","last_clean":"2024-04-26T07:51:39.400511+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:51:39.400511+0000","last_undegraded":"2024-04-26T07:51:39.400511+0000","last_fullsized":"2024-04-26T07:51:39.400511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378607+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:51:39.378607+0000","last_peered":"2024-04-26T07:51:39.378607+0000","last_clean":"2024-04-26T07:51:39.378607+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:51:39.378607+0000","last_undegraded":"2024-04-26T07:51:39.378607+0000","last_fullsized":"2024-04-26T07:51:39.378607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'19","reported_seq":170,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.393997+0000","last_change":"2024-04-26T07:51:39.393997+0000","last_active":"2024-04-26T07:51:39.393997+0000","last_peered":"2024-04-26T07:51:05.051057+0000","last_clean":"2024-04-26T07:51:05.051057+0000","last_became_active":"2024-04-26T07:50:53.959397+0000","last_became_peered":"2024-04-26T07:50:53.959397+0000","last_unstale":"2024-04-26T07:51:39.393997+0000","last_undegraded":"2024-04-26T07:51:39.393997+0000","last_fullsized":"2024-04-26T07:51:39.393997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396568+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:51:39.396568+0000","last_peered":"2024-04-26T07:51:39.396568+0000","last_clean":"2024-04-26T07:51:39.396568+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:51:39.396568+0000","last_undegraded":"2024-04-26T07:51:39.396568+0000","last_fullsized":"2024-04-26T07:51:39.396568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"89'23","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378269+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:39.378269+0000","last_peered":"2024-04-26T07:51:39.378269+0000","last_clean":"2024-04-26T07:51:39.378269+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:39.378269+0000","last_undegraded":"2024-04-26T07:51:39.378269+0000","last_fullsized":"2024-04-26T07:51:39.378269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392491+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:51:39.392491+0000","last_peered":"2024-04-26T07:51:39.392491+0000","last_clean":"2024-04-26T07:51:39.392491+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:51:39.392491+0000","last_undegraded":"2024-04-26T07:51:39.392491+0000","last_fullsized":"2024-04-26T07:51:39.392491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":229,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374683+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:51:39.374683+0000","last_peered":"2024-04-26T07:51:39.374683+0000","last_clean":"2024-04-26T07:51:39.374683+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:51:39.374683+0000","last_undegraded":"2024-04-26T07:51:39.374683+0000","last_fullsized":"2024-04-26T07:51:39.374683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'25","reported_seq":207,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.057005+0000","last_change":"2024-04-26T07:50:53.980391+0000","last_active":"2024-04-26T07:51:38.057005+0000","last_peered":"2024-04-26T07:51:38.057005+0000","last_clean":"2024-04-26T07:51:38.057005+0000","last_became_active":"2024-04-26T07:50:53.979506+0000","last_became_peered":"2024-04-26T07:50:53.979506+0000","last_unstale":"2024-04-26T07:51:38.057005+0000","last_undegraded":"2024-04-26T07:51:38.057005+0000","last_fullsized":"2024-04-26T07:51:38.057005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:35.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":207,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.358550+0000","last_change":"2024-04-26T07:50:53.969837+0000","last_active":"2024-04-26T07:51:38.358550+0000","last_peered":"2024-04-26T07:51:38.358550+0000","last_clean":"2024-04-26T07:51:38.358550+0000","last_became_active":"2024-04-26T07:50:53.968777+0000","last_became_peered":"2024-04-26T07:50:53.968777+0000","last_unstale":"2024-04-26T07:51:38.358550+0000","last_undegraded":"2024-04-26T07:51:38.358550+0000","last_fullsized":"2024-04-26T07:51:38.358550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:12.769798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"89'31","reported_seq":222,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408337+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:51:39.408337+0000","last_peered":"2024-04-26T07:51:39.408337+0000","last_clean":"2024-04-26T07:51:39.408337+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:51:39.408337+0000","last_undegraded":"2024-04-26T07:51:39.408337+0000","last_fullsized":"2024-04-26T07:51:39.408337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":41,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400939+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:51:39.400939+0000","last_peered":"2024-04-26T07:51:39.400939+0000","last_clean":"2024-04-26T07:51:39.400939+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:51:39.400939+0000","last_undegraded":"2024-04-26T07:51:39.400939+0000","last_fullsized":"2024-04-26T07:51:39.400939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412523+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:51:39.412523+0000","last_peered":"2024-04-26T07:51:39.412523+0000","last_clean":"2024-04-26T07:51:39.412523+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:51:39.412523+0000","last_undegraded":"2024-04-26T07:51:39.412523+0000","last_fullsized":"2024-04-26T07:51:39.412523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":226,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386774+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:51:39.386774+0000","last_peered":"2024-04-26T07:51:39.386774+0000","last_clean":"2024-04-26T07:51:39.386774+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:51:39.386774+0000","last_undegraded":"2024-04-26T07:51:39.386774+0000","last_fullsized":"2024-04-26T07:51:39.386774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'24","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377431+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:39.377431+0000","last_peered":"2024-04-26T07:51:39.377431+0000","last_clean":"2024-04-26T07:51:39.377431+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:39.377431+0000","last_undegraded":"2024-04-26T07:51:39.377431+0000","last_fullsized":"2024-04-26T07:51:39.377431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387284+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:51:39.387284+0000","last_peered":"2024-04-26T07:51:39.387284+0000","last_clean":"2024-04-26T07:51:39.387284+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:51:39.387284+0000","last_undegraded":"2024-04-26T07:51:39.387284+0000","last_fullsized":"2024-04-26T07:51:39.387284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380785+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:39.380785+0000","last_peered":"2024-04-26T07:51:39.380785+0000","last_clean":"2024-04-26T07:51:39.380785+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:39.380785+0000","last_undegraded":"2024-04-26T07:51:39.380785+0000","last_fullsized":"2024-04-26T07:51:39.380785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378704+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:51:39.378704+0000","last_peered":"2024-04-26T07:51:39.378704+0000","last_clean":"2024-04-26T07:51:39.378704+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:51:39.378704+0000","last_undegraded":"2024-04-26T07:51:39.378704+0000","last_fullsized":"2024-04-26T07:51:39.378704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"90'24","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390410+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:39.390410+0000","last_peered":"2024-04-26T07:51:39.390410+0000","last_clean":"2024-04-26T07:51:39.390410+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:39.390410+0000","last_undegraded":"2024-04-26T07:51:39.390410+0000","last_fullsized":"2024-04-26T07:51:39.390410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374135+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:39.374135+0000","last_peered":"2024-04-26T07:51:39.374135+0000","last_clean":"2024-04-26T07:51:39.374135+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:39.374135+0000","last_undegraded":"2024-04-26T07:51:39.374135+0000","last_fullsized":"2024-04-26T07:51:39.374135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383068+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:39.383068+0000","last_peered":"2024-04-26T07:51:39.383068+0000","last_clean":"2024-04-26T07:51:39.383068+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:39.383068+0000","last_undegraded":"2024-04-26T07:51:39.383068+0000","last_fullsized":"2024-04-26T07:51:39.383068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'19","reported_seq":152,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386665+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:39.386665+0000","last_peered":"2024-04-26T07:51:39.386665+0000","last_clean":"2024-04-26T07:51:39.386665+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:39.386665+0000","last_undegraded":"2024-04-26T07:51:39.386665+0000","last_fullsized":"2024-04-26T07:51:39.386665+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:08.704021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396771+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:39.396771+0000","last_peered":"2024-04-26T07:51:39.396771+0000","last_clean":"2024-04-26T07:51:39.396771+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:39.396771+0000","last_undegraded":"2024-04-26T07:51:39.396771+0000","last_fullsized":"2024-04-26T07:51:39.396771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"90'17","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392064+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:39.392064+0000","last_peered":"2024-04-26T07:51:39.392064+0000","last_clean":"2024-04-26T07:51:39.392064+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:39.392064+0000","last_undegraded":"2024-04-26T07:51:39.392064+0000","last_fullsized":"2024-04-26T07:51:39.392064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":124,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.403124+0000","last_change":"2024-04-26T07:50:52.956904+0000","last_active":"2024-04-26T07:48:28.544638+0000","last_peered":"2024-04-26T07:48:28.544638+0000","last_clean":"2024-04-26T07:48:28.544638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.403124+0000","last_undegraded":"2024-04-26T07:51:39.403124+0000","last_fullsized":"2024-04-26T07:51:39.403124+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":240,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401254+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:39.401254+0000","last_peered":"2024-04-26T07:51:39.401254+0000","last_clean":"2024-04-26T07:51:39.401254+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:39.401254+0000","last_undegraded":"2024-04-26T07:51:39.401254+0000","last_fullsized":"2024-04-26T07:51:39.401254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.399848+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:51:39.399848+0000","last_peered":"2024-04-26T07:51:39.399848+0000","last_clean":"2024-04-26T07:51:39.399848+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:51:39.399848+0000","last_undegraded":"2024-04-26T07:51:39.399848+0000","last_fullsized":"2024-04-26T07:51:39.399848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'20","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390597+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:39.390597+0000","last_peered":"2024-04-26T07:51:39.390597+0000","last_clean":"2024-04-26T07:51:39.390597+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:39.390597+0000","last_undegraded":"2024-04-26T07:51:39.390597+0000","last_fullsized":"2024-04-26T07:51:39.390597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382864+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:39.382864+0000","last_peered":"2024-04-26T07:51:39.382864+0000","last_clean":"2024-04-26T07:51:39.382864+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:39.382864+0000","last_undegraded":"2024-04-26T07:51:39.382864+0000","last_fullsized":"2024-04-26T07:51:39.382864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"53'7","reported_seq":188,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381805+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:51:39.381805+0000","last_peered":"2024-04-26T07:51:39.381805+0000","last_clean":"2024-04-26T07:51:39.381805+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:51:39.381805+0000","last_undegraded":"2024-04-26T07:51:39.381805+0000","last_fullsized":"2024-04-26T07:51:39.381805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378856+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:39.378856+0000","last_peered":"2024-04-26T07:51:39.378856+0000","last_clean":"2024-04-26T07:51:39.378856+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:39.378856+0000","last_undegraded":"2024-04-26T07:51:39.378856+0000","last_fullsized":"2024-04-26T07:51:39.378856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389866+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:51:39.389866+0000","last_peered":"2024-04-26T07:51:39.389866+0000","last_clean":"2024-04-26T07:51:39.389866+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:51:39.389866+0000","last_undegraded":"2024-04-26T07:51:39.389866+0000","last_fullsized":"2024-04-26T07:51:39.389866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394120+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:51:39.394120+0000","last_peered":"2024-04-26T07:51:39.394120+0000","last_clean":"2024-04-26T07:51:39.394120+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:51:39.394120+0000","last_undegraded":"2024-04-26T07:51:39.394120+0000","last_fullsized":"2024-04-26T07:51:39.394120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'22","reported_seq":207,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.362701+0000","last_change":"2024-04-26T07:50:53.967597+0000","last_active":"2024-04-26T07:51:38.362701+0000","last_peered":"2024-04-26T07:51:38.362701+0000","last_clean":"2024-04-26T07:51:38.362701+0000","last_became_active":"2024-04-26T07:50:53.966791+0000","last_became_peered":"2024-04-26T07:50:53.966791+0000","last_unstale":"2024-04-26T07:51:38.362701+0000","last_undegraded":"2024-04-26T07:51:38.362701+0000","last_fullsized":"2024-04-26T07:51:38.362701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:26.519461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384379+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:39.384379+0000","last_peered":"2024-04-26T07:51:39.384379+0000","last_clean":"2024-04-26T07:51:39.384379+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:39.384379+0000","last_undegraded":"2024-04-26T07:51:39.384379+0000","last_fullsized":"2024-04-26T07:51:39.384379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386471+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:51:39.386471+0000","last_peered":"2024-04-26T07:51:39.386471+0000","last_clean":"2024-04-26T07:51:39.386471+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:51:39.386471+0000","last_undegraded":"2024-04-26T07:51:39.386471+0000","last_fullsized":"2024-04-26T07:51:39.386471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'135","reported_seq":300,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.391475+0000","last_change":"2024-04-26T07:51:39.391475+0000","last_active":"2024-04-26T07:51:39.391475+0000","last_peered":"2024-04-26T07:51:08.340110+0000","last_clean":"2024-04-26T07:51:08.340110+0000","last_became_active":"2024-04-26T07:50:53.968380+0000","last_became_peered":"2024-04-26T07:50:53.968380+0000","last_unstale":"2024-04-26T07:51:39.391475+0000","last_undegraded":"2024-04-26T07:51:39.391475+0000","last_fullsized":"2024-04-26T07:51:39.391475+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374803+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:39.374803+0000","last_peered":"2024-04-26T07:51:39.374803+0000","last_clean":"2024-04-26T07:51:39.374803+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:39.374803+0000","last_undegraded":"2024-04-26T07:51:39.374803+0000","last_fullsized":"2024-04-26T07:51:39.374803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384036+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:51:39.384036+0000","last_peered":"2024-04-26T07:51:39.384036+0000","last_clean":"2024-04-26T07:51:39.384036+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:51:39.384036+0000","last_undegraded":"2024-04-26T07:51:39.384036+0000","last_fullsized":"2024-04-26T07:51:39.384036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'17","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406890+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:51:39.406890+0000","last_peered":"2024-04-26T07:51:39.406890+0000","last_clean":"2024-04-26T07:51:39.406890+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:51:39.406890+0000","last_undegraded":"2024-04-26T07:51:39.406890+0000","last_fullsized":"2024-04-26T07:51:39.406890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396314+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:39.396314+0000","last_peered":"2024-04-26T07:51:39.396314+0000","last_clean":"2024-04-26T07:51:39.396314+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:39.396314+0000","last_undegraded":"2024-04-26T07:51:39.396314+0000","last_fullsized":"2024-04-26T07:51:39.396314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"90'17","reported_seq":151,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.401950+0000","last_change":"2024-04-26T07:51:39.401950+0000","last_active":"2024-04-26T07:51:39.401950+0000","last_peered":"2024-04-26T07:50:49.905105+0000","last_clean":"2024-04-26T07:50:49.905105+0000","last_became_active":"2024-04-26T07:48:27.655900+0000","last_became_peered":"2024-04-26T07:48:27.655900+0000","last_unstale":"2024-04-26T07:51:39.401950+0000","last_undegraded":"2024-04-26T07:51:39.401950+0000","last_fullsized":"2024-04-26T07:51:39.401950+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'134","reported_seq":347,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382488+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:51:39.382488+0000","last_peered":"2024-04-26T07:51:39.382488+0000","last_clean":"2024-04-26T07:51:39.382488+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:51:39.382488+0000","last_undegraded":"2024-04-26T07:51:39.382488+0000","last_fullsized":"2024-04-26T07:51:39.382488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":185,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405821+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:51:39.405821+0000","last_peered":"2024-04-26T07:51:39.405821+0000","last_clean":"2024-04-26T07:51:39.405821+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:51:39.405821+0000","last_undegraded":"2024-04-26T07:51:39.405821+0000","last_fullsized":"2024-04-26T07:51:39.405821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'27","reported_seq":213,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.362818+0000","last_change":"2024-04-26T07:50:53.967800+0000","last_active":"2024-04-26T07:51:38.362818+0000","last_peered":"2024-04-26T07:51:38.362818+0000","last_clean":"2024-04-26T07:51:38.362818+0000","last_became_active":"2024-04-26T07:50:53.966844+0000","last_became_peered":"2024-04-26T07:50:53.966844+0000","last_unstale":"2024-04-26T07:51:38.362818+0000","last_undegraded":"2024-04-26T07:51:38.362818+0000","last_fullsized":"2024-04-26T07:51:38.362818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:35.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.555154+0000","last_change":"2024-04-26T07:50:53.972931+0000","last_active":"2024-04-26T07:51:38.555154+0000","last_peered":"2024-04-26T07:51:38.555154+0000","last_clean":"2024-04-26T07:51:38.555154+0000","last_became_active":"2024-04-26T07:50:53.972133+0000","last_became_peered":"2024-04-26T07:50:53.972133+0000","last_unstale":"2024-04-26T07:51:38.555154+0000","last_undegraded":"2024-04-26T07:51:38.555154+0000","last_fullsized":"2024-04-26T07:51:38.555154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:14.805996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"90'27","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397583+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:51:39.397583+0000","last_peered":"2024-04-26T07:51:39.397583+0000","last_clean":"2024-04-26T07:51:39.397583+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:51:39.397583+0000","last_undegraded":"2024-04-26T07:51:39.397583+0000","last_fullsized":"2024-04-26T07:51:39.397583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372502+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:39.372502+0000","last_peered":"2024-04-26T07:51:39.372502+0000","last_clean":"2024-04-26T07:51:39.372502+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:39.372502+0000","last_undegraded":"2024-04-26T07:51:39.372502+0000","last_fullsized":"2024-04-26T07:51:39.372502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":179,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400253+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:39.400253+0000","last_peered":"2024-04-26T07:51:39.400253+0000","last_clean":"2024-04-26T07:51:39.400253+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:39.400253+0000","last_undegraded":"2024-04-26T07:51:39.400253+0000","last_fullsized":"2024-04-26T07:51:39.400253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374859+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:51:39.374859+0000","last_peered":"2024-04-26T07:51:39.374859+0000","last_clean":"2024-04-26T07:51:39.374859+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:51:39.374859+0000","last_undegraded":"2024-04-26T07:51:39.374859+0000","last_fullsized":"2024-04-26T07:51:39.374859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'24","reported_seq":210,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.363319+0000","last_change":"2024-04-26T07:50:53.953128+0000","last_active":"2024-04-26T07:51:38.363319+0000","last_peered":"2024-04-26T07:51:38.363319+0000","last_clean":"2024-04-26T07:51:38.363319+0000","last_became_active":"2024-04-26T07:50:53.952170+0000","last_became_peered":"2024-04-26T07:50:53.952170+0000","last_unstale":"2024-04-26T07:51:38.363319+0000","last_undegraded":"2024-04-26T07:51:38.363319+0000","last_fullsized":"2024-04-26T07:51:38.363319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:06.181214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385816+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:51:39.385816+0000","last_peered":"2024-04-26T07:51:39.385816+0000","last_clean":"2024-04-26T07:51:39.385816+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:51:39.385816+0000","last_undegraded":"2024-04-26T07:51:39.385816+0000","last_fullsized":"2024-04-26T07:51:39.385816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"90'17","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381410+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:51:39.381410+0000","last_peered":"2024-04-26T07:51:39.381410+0000","last_clean":"2024-04-26T07:51:39.381410+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:51:39.381410+0000","last_undegraded":"2024-04-26T07:51:39.381410+0000","last_fullsized":"2024-04-26T07:51:39.381410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379438+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:51:39.379438+0000","last_peered":"2024-04-26T07:51:39.379438+0000","last_clean":"2024-04-26T07:51:39.379438+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:51:39.379438+0000","last_undegraded":"2024-04-26T07:51:39.379438+0000","last_fullsized":"2024-04-26T07:51:39.379438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412119+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:39.412119+0000","last_peered":"2024-04-26T07:51:39.412119+0000","last_clean":"2024-04-26T07:51:39.412119+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:39.412119+0000","last_undegraded":"2024-04-26T07:51:39.412119+0000","last_fullsized":"2024-04-26T07:51:39.412119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407707+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:51:39.407707+0000","last_peered":"2024-04-26T07:51:39.407707+0000","last_clean":"2024-04-26T07:51:39.407707+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:51:39.407707+0000","last_undegraded":"2024-04-26T07:51:39.407707+0000","last_fullsized":"2024-04-26T07:51:39.407707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"89'25","reported_seq":208,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.056706+0000","last_change":"2024-04-26T07:50:53.981815+0000","last_active":"2024-04-26T07:51:38.056706+0000","last_peered":"2024-04-26T07:51:38.056706+0000","last_clean":"2024-04-26T07:51:38.056706+0000","last_became_active":"2024-04-26T07:50:53.981054+0000","last_became_peered":"2024-04-26T07:50:53.981054+0000","last_unstale":"2024-04-26T07:51:38.056706+0000","last_undegraded":"2024-04-26T07:51:38.056706+0000","last_fullsized":"2024-04-26T07:51:38.056706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:50.801176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.388088+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:51:39.388088+0000","last_peered":"2024-04-26T07:51:39.388088+0000","last_clean":"2024-04-26T07:51:39.388088+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:51:39.388088+0000","last_undegraded":"2024-04-26T07:51:39.388088+0000","last_fullsized":"2024-04-26T07:51:39.388088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"90'25","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.096867+0000","last_change":"2024-04-26T07:50:53.960437+0000","last_active":"2024-04-26T07:51:38.096867+0000","last_peered":"2024-04-26T07:51:38.096867+0000","last_clean":"2024-04-26T07:51:38.096867+0000","last_became_active":"2024-04-26T07:50:53.960163+0000","last_became_peered":"2024-04-26T07:50:53.960163+0000","last_unstale":"2024-04-26T07:51:38.096867+0000","last_undegraded":"2024-04-26T07:51:38.096867+0000","last_fullsized":"2024-04-26T07:51:38.096867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:09.908067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62803,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"90'134","reported_seq":345,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390378+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:51:39.390378+0000","last_peered":"2024-04-26T07:51:39.390378+0000","last_clean":"2024-04-26T07:51:39.390378+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:51:39.390378+0000","last_undegraded":"2024-04-26T07:51:39.390378+0000","last_fullsized":"2024-04-26T07:51:39.390378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392267+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:39.392267+0000","last_peered":"2024-04-26T07:51:39.392267+0000","last_clean":"2024-04-26T07:51:39.392267+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:39.392267+0000","last_undegraded":"2024-04-26T07:51:39.392267+0000","last_fullsized":"2024-04-26T07:51:39.392267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393052+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:39.393052+0000","last_peered":"2024-04-26T07:51:39.393052+0000","last_clean":"2024-04-26T07:51:39.393052+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:39.393052+0000","last_undegraded":"2024-04-26T07:51:39.393052+0000","last_fullsized":"2024-04-26T07:51:39.393052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401067+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:39.401067+0000","last_peered":"2024-04-26T07:51:39.401067+0000","last_clean":"2024-04-26T07:51:39.401067+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:39.401067+0000","last_undegraded":"2024-04-26T07:51:39.401067+0000","last_fullsized":"2024-04-26T07:51:39.401067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386484+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:51:39.386484+0000","last_peered":"2024-04-26T07:51:39.386484+0000","last_clean":"2024-04-26T07:51:39.386484+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:51:39.386484+0000","last_undegraded":"2024-04-26T07:51:39.386484+0000","last_fullsized":"2024-04-26T07:51:39.386484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'29","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391232+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:39.391232+0000","last_peered":"2024-04-26T07:51:39.391232+0000","last_clean":"2024-04-26T07:51:39.391232+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:39.391232+0000","last_undegraded":"2024-04-26T07:51:39.391232+0000","last_fullsized":"2024-04-26T07:51:39.391232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385638+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:51:39.385638+0000","last_peered":"2024-04-26T07:51:39.385638+0000","last_clean":"2024-04-26T07:51:39.385638+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:51:39.385638+0000","last_undegraded":"2024-04-26T07:51:39.385638+0000","last_fullsized":"2024-04-26T07:51:39.385638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":198,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373961+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:39.373961+0000","last_peered":"2024-04-26T07:51:39.373961+0000","last_clean":"2024-04-26T07:51:39.373961+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:39.373961+0000","last_undegraded":"2024-04-26T07:51:39.373961+0000","last_fullsized":"2024-04-26T07:51:39.373961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":240,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377873+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:39.377873+0000","last_peered":"2024-04-26T07:51:39.377873+0000","last_clean":"2024-04-26T07:51:39.377873+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:39.377873+0000","last_undegraded":"2024-04-26T07:51:39.377873+0000","last_fullsized":"2024-04-26T07:51:39.377873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380416+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:39.380416+0000","last_peered":"2024-04-26T07:51:39.380416+0000","last_clean":"2024-04-26T07:51:39.380416+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:39.380416+0000","last_undegraded":"2024-04-26T07:51:39.380416+0000","last_fullsized":"2024-04-26T07:51:39.380416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387388+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:51:39.387388+0000","last_peered":"2024-04-26T07:51:39.387388+0000","last_clean":"2024-04-26T07:51:39.387388+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:51:39.387388+0000","last_undegraded":"2024-04-26T07:51:39.387388+0000","last_fullsized":"2024-04-26T07:51:39.387388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"90'20","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379225+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:51:39.379225+0000","last_peered":"2024-04-26T07:51:39.379225+0000","last_clean":"2024-04-26T07:51:39.379225+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:51:39.379225+0000","last_undegraded":"2024-04-26T07:51:39.379225+0000","last_fullsized":"2024-04-26T07:51:39.379225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393340+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:51:39.393340+0000","last_peered":"2024-04-26T07:51:39.393340+0000","last_clean":"2024-04-26T07:51:39.393340+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:51:39.393340+0000","last_undegraded":"2024-04-26T07:51:39.393340+0000","last_fullsized":"2024-04-26T07:51:39.393340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377539+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:39.377539+0000","last_peered":"2024-04-26T07:51:39.377539+0000","last_clean":"2024-04-26T07:51:39.377539+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:39.377539+0000","last_undegraded":"2024-04-26T07:51:39.377539+0000","last_fullsized":"2024-04-26T07:51:39.377539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379014+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:39.379014+0000","last_peered":"2024-04-26T07:51:39.379014+0000","last_clean":"2024-04-26T07:51:39.379014+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:39.379014+0000","last_undegraded":"2024-04-26T07:51:39.379014+0000","last_fullsized":"2024-04-26T07:51:39.379014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'25","reported_seq":215,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407929+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:51:39.407929+0000","last_peered":"2024-04-26T07:51:39.407929+0000","last_clean":"2024-04-26T07:51:39.407929+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:51:39.407929+0000","last_undegraded":"2024-04-26T07:51:39.407929+0000","last_fullsized":"2024-04-26T07:51:39.407929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371914+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:51:39.371914+0000","last_peered":"2024-04-26T07:51:39.371914+0000","last_clean":"2024-04-26T07:51:39.371914+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:51:39.371914+0000","last_undegraded":"2024-04-26T07:51:39.371914+0000","last_fullsized":"2024-04-26T07:51:39.371914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"90'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392335+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:51:39.392335+0000","last_peered":"2024-04-26T07:51:39.392335+0000","last_clean":"2024-04-26T07:51:39.392335+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:51:39.392335+0000","last_undegraded":"2024-04-26T07:51:39.392335+0000","last_fullsized":"2024-04-26T07:51:39.392335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'134","reported_seq":362,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391679+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:51:39.391679+0000","last_peered":"2024-04-26T07:51:39.391679+0000","last_clean":"2024-04-26T07:51:39.391679+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:51:39.391679+0000","last_undegraded":"2024-04-26T07:51:39.391679+0000","last_fullsized":"2024-04-26T07:51:39.391679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371623+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:39.371623+0000","last_peered":"2024-04-26T07:51:39.371623+0000","last_clean":"2024-04-26T07:51:39.371623+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:39.371623+0000","last_undegraded":"2024-04-26T07:51:39.371623+0000","last_fullsized":"2024-04-26T07:51:39.371623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379771+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:51:39.379771+0000","last_peered":"2024-04-26T07:51:39.379771+0000","last_clean":"2024-04-26T07:51:39.379771+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:51:39.379771+0000","last_undegraded":"2024-04-26T07:51:39.379771+0000","last_fullsized":"2024-04-26T07:51:39.379771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"89'30","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377863+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:39.377863+0000","last_peered":"2024-04-26T07:51:39.377863+0000","last_clean":"2024-04-26T07:51:39.377863+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:39.377863+0000","last_undegraded":"2024-04-26T07:51:39.377863+0000","last_fullsized":"2024-04-26T07:51:39.377863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":361,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401426+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:51:39.401426+0000","last_peered":"2024-04-26T07:51:39.401426+0000","last_clean":"2024-04-26T07:51:39.401426+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:51:39.401426+0000","last_undegraded":"2024-04-26T07:51:39.401426+0000","last_fullsized":"2024-04-26T07:51:39.401426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382757+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:51:39.382757+0000","last_peered":"2024-04-26T07:51:39.382757+0000","last_clean":"2024-04-26T07:51:39.382757+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:51:39.382757+0000","last_undegraded":"2024-04-26T07:51:39.382757+0000","last_fullsized":"2024-04-26T07:51:39.382757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'134","reported_seq":397,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412379+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:39.412379+0000","last_peered":"2024-04-26T07:51:39.412379+0000","last_clean":"2024-04-26T07:51:39.412379+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:39.412379+0000","last_undegraded":"2024-04-26T07:51:39.412379+0000","last_fullsized":"2024-04-26T07:51:39.412379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":176,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375424+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:39.375424+0000","last_peered":"2024-04-26T07:51:39.375424+0000","last_clean":"2024-04-26T07:51:39.375424+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:39.375424+0000","last_undegraded":"2024-04-26T07:51:39.375424+0000","last_fullsized":"2024-04-26T07:51:39.375424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":163,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384155+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:39.384155+0000","last_peered":"2024-04-26T07:51:39.384155+0000","last_clean":"2024-04-26T07:51:39.384155+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:39.384155+0000","last_undegraded":"2024-04-26T07:51:39.384155+0000","last_fullsized":"2024-04-26T07:51:39.384155+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378411+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:39.378411+0000","last_peered":"2024-04-26T07:51:39.378411+0000","last_clean":"2024-04-26T07:51:39.378411+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:39.378411+0000","last_undegraded":"2024-04-26T07:51:39.378411+0000","last_fullsized":"2024-04-26T07:51:39.378411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379506+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:51:39.379506+0000","last_peered":"2024-04-26T07:51:39.379506+0000","last_clean":"2024-04-26T07:51:39.379506+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:51:39.379506+0000","last_undegraded":"2024-04-26T07:51:39.379506+0000","last_fullsized":"2024-04-26T07:51:39.379506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"90'26","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396517+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:51:39.396517+0000","last_peered":"2024-04-26T07:51:39.396517+0000","last_clean":"2024-04-26T07:51:39.396517+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:51:39.396517+0000","last_undegraded":"2024-04-26T07:51:39.396517+0000","last_fullsized":"2024-04-26T07:51:39.396517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407447+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:39.407447+0000","last_peered":"2024-04-26T07:51:39.407447+0000","last_clean":"2024-04-26T07:51:39.407447+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:39.407447+0000","last_undegraded":"2024-04-26T07:51:39.407447+0000","last_fullsized":"2024-04-26T07:51:39.407447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372350+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:39.372350+0000","last_peered":"2024-04-26T07:51:39.372350+0000","last_clean":"2024-04-26T07:51:39.372350+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:39.372350+0000","last_undegraded":"2024-04-26T07:51:39.372350+0000","last_fullsized":"2024-04-26T07:51:39.372350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412425+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:51:39.412425+0000","last_peered":"2024-04-26T07:51:39.412425+0000","last_clean":"2024-04-26T07:51:39.412425+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:51:39.412425+0000","last_undegraded":"2024-04-26T07:51:39.412425+0000","last_fullsized":"2024-04-26T07:51:39.412425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.185797+0000","last_change":"2024-04-26T07:50:53.965294+0000","last_active":"2024-04-26T07:51:38.185797+0000","last_peered":"2024-04-26T07:51:38.185797+0000","last_clean":"2024-04-26T07:51:38.185797+0000","last_became_active":"2024-04-26T07:50:53.964427+0000","last_became_peered":"2024-04-26T07:50:53.964427+0000","last_unstale":"2024-04-26T07:51:38.185797+0000","last_undegraded":"2024-04-26T07:51:38.185797+0000","last_fullsized":"2024-04-26T07:51:38.185797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:24.027532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397877+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:39.397877+0000","last_peered":"2024-04-26T07:51:39.397877+0000","last_clean":"2024-04-26T07:51:39.397877+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:39.397877+0000","last_undegraded":"2024-04-26T07:51:39.397877+0000","last_fullsized":"2024-04-26T07:51:39.397877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380033+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:39.380033+0000","last_peered":"2024-04-26T07:51:39.380033+0000","last_clean":"2024-04-26T07:51:39.380033+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:39.380033+0000","last_undegraded":"2024-04-26T07:51:39.380033+0000","last_fullsized":"2024-04-26T07:51:39.380033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":53,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.098260+0000","last_change":"2024-04-26T07:50:53.963193+0000","last_active":"2024-04-26T07:51:38.098260+0000","last_peered":"2024-04-26T07:51:38.098260+0000","last_clean":"2024-04-26T07:51:38.098260+0000","last_became_active":"2024-04-26T07:50:53.962624+0000","last_became_peered":"2024-04-26T07:50:53.962624+0000","last_unstale":"2024-04-26T07:51:38.098260+0000","last_undegraded":"2024-04-26T07:51:38.098260+0000","last_fullsized":"2024-04-26T07:51:38.098260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:34.031661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"90'39","reported_seq":230,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401761+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:51:39.401761+0000","last_peered":"2024-04-26T07:51:39.401761+0000","last_clean":"2024-04-26T07:51:39.401761+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:51:39.401761+0000","last_undegraded":"2024-04-26T07:51:39.401761+0000","last_fullsized":"2024-04-26T07:51:39.401761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392535+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:51:39.392535+0000","last_peered":"2024-04-26T07:51:39.392535+0000","last_clean":"2024-04-26T07:51:39.392535+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:51:39.392535+0000","last_undegraded":"2024-04-26T07:51:39.392535+0000","last_fullsized":"2024-04-26T07:51:39.392535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406290+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:39.406290+0000","last_peered":"2024-04-26T07:51:39.406290+0000","last_clean":"2024-04-26T07:51:39.406290+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:39.406290+0000","last_undegraded":"2024-04-26T07:51:39.406290+0000","last_fullsized":"2024-04-26T07:51:39.406290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":229,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393641+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:51:39.393641+0000","last_peered":"2024-04-26T07:51:39.393641+0000","last_clean":"2024-04-26T07:51:39.393641+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:51:39.393641+0000","last_undegraded":"2024-04-26T07:51:39.393641+0000","last_fullsized":"2024-04-26T07:51:39.393641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.357609+0000","last_change":"2024-04-26T07:50:53.968724+0000","last_active":"2024-04-26T07:51:38.357609+0000","last_peered":"2024-04-26T07:51:38.357609+0000","last_clean":"2024-04-26T07:51:38.357609+0000","last_became_active":"2024-04-26T07:50:53.968282+0000","last_became_peered":"2024-04-26T07:50:53.968282+0000","last_unstale":"2024-04-26T07:51:38.357609+0000","last_undegraded":"2024-04-26T07:51:38.357609+0000","last_fullsized":"2024-04-26T07:51:38.357609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:32.175509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"89'20","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391341+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:39.391341+0000","last_peered":"2024-04-26T07:51:39.391341+0000","last_clean":"2024-04-26T07:51:39.391341+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:39.391341+0000","last_undegraded":"2024-04-26T07:51:39.391341+0000","last_fullsized":"2024-04-26T07:51:39.391341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.402965+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:39.402965+0000","last_peered":"2024-04-26T07:51:39.402965+0000","last_clean":"2024-04-26T07:51:39.402965+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:39.402965+0000","last_undegraded":"2024-04-26T07:51:39.402965+0000","last_fullsized":"2024-04-26T07:51:39.402965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'137","reported_seq":415,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371759+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:51:39.371759+0000","last_peered":"2024-04-26T07:51:39.371759+0000","last_clean":"2024-04-26T07:51:39.371759+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:51:39.371759+0000","last_undegraded":"2024-04-26T07:51:39.371759+0000","last_fullsized":"2024-04-26T07:51:39.371759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":54,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.098156+0000","last_change":"2024-04-26T07:50:53.962915+0000","last_active":"2024-04-26T07:51:38.098156+0000","last_peered":"2024-04-26T07:51:38.098156+0000","last_clean":"2024-04-26T07:51:38.098156+0000","last_became_active":"2024-04-26T07:50:53.962553+0000","last_became_peered":"2024-04-26T07:50:53.962553+0000","last_unstale":"2024-04-26T07:51:38.098156+0000","last_undegraded":"2024-04-26T07:51:38.098156+0000","last_fullsized":"2024-04-26T07:51:38.098156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:24.357622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370516+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:39.370516+0000","last_peered":"2024-04-26T07:51:39.370516+0000","last_clean":"2024-04-26T07:51:39.370516+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:39.370516+0000","last_undegraded":"2024-04-26T07:51:39.370516+0000","last_fullsized":"2024-04-26T07:51:39.370516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374300+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:51:39.374300+0000","last_peered":"2024-04-26T07:51:39.374300+0000","last_clean":"2024-04-26T07:51:39.374300+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:51:39.374300+0000","last_undegraded":"2024-04-26T07:51:39.374300+0000","last_fullsized":"2024-04-26T07:51:39.374300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385985+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:51:39.385985+0000","last_peered":"2024-04-26T07:51:39.385985+0000","last_clean":"2024-04-26T07:51:39.385985+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:51:39.385985+0000","last_undegraded":"2024-04-26T07:51:39.385985+0000","last_fullsized":"2024-04-26T07:51:39.385985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'26","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370330+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:39.370330+0000","last_peered":"2024-04-26T07:51:39.370330+0000","last_clean":"2024-04-26T07:51:39.370330+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:39.370330+0000","last_undegraded":"2024-04-26T07:51:39.370330+0000","last_fullsized":"2024-04-26T07:51:39.370330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":184,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391902+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:51:39.391902+0000","last_peered":"2024-04-26T07:51:39.391902+0000","last_clean":"2024-04-26T07:51:39.391902+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:51:39.391902+0000","last_undegraded":"2024-04-26T07:51:39.391902+0000","last_fullsized":"2024-04-26T07:51:39.391902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"85'16","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.556506+0000","last_change":"2024-04-26T07:50:53.973436+0000","last_active":"2024-04-26T07:51:38.556506+0000","last_peered":"2024-04-26T07:51:38.556506+0000","last_clean":"2024-04-26T07:51:38.556506+0000","last_became_active":"2024-04-26T07:50:53.972444+0000","last_became_peered":"2024-04-26T07:50:53.972444+0000","last_unstale":"2024-04-26T07:51:38.556506+0000","last_undegraded":"2024-04-26T07:51:38.556506+0000","last_fullsized":"2024-04-26T07:51:38.556506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:34.553163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390613+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:51:39.390613+0000","last_peered":"2024-04-26T07:51:39.390613+0000","last_clean":"2024-04-26T07:51:39.390613+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:51:39.390613+0000","last_undegraded":"2024-04-26T07:51:39.390613+0000","last_fullsized":"2024-04-26T07:51:39.390613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381057+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:39.381057+0000","last_peered":"2024-04-26T07:51:39.381057+0000","last_clean":"2024-04-26T07:51:39.381057+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:39.381057+0000","last_undegraded":"2024-04-26T07:51:39.381057+0000","last_fullsized":"2024-04-26T07:51:39.381057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372050+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:51:39.372050+0000","last_peered":"2024-04-26T07:51:39.372050+0000","last_clean":"2024-04-26T07:51:39.372050+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:51:39.372050+0000","last_undegraded":"2024-04-26T07:51:39.372050+0000","last_fullsized":"2024-04-26T07:51:39.372050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401773+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:39.401773+0000","last_peered":"2024-04-26T07:51:39.401773+0000","last_clean":"2024-04-26T07:51:39.401773+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:39.401773+0000","last_undegraded":"2024-04-26T07:51:39.401773+0000","last_fullsized":"2024-04-26T07:51:39.401773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'20","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377573+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:39.377573+0000","last_peered":"2024-04-26T07:51:39.377573+0000","last_clean":"2024-04-26T07:51:39.377573+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:39.377573+0000","last_undegraded":"2024-04-26T07:51:39.377573+0000","last_fullsized":"2024-04-26T07:51:39.377573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389554+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:51:39.389554+0000","last_peered":"2024-04-26T07:51:39.389554+0000","last_clean":"2024-04-26T07:51:39.389554+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:51:39.389554+0000","last_undegraded":"2024-04-26T07:51:39.389554+0000","last_fullsized":"2024-04-26T07:51:39.389554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384109+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:39.384109+0000","last_peered":"2024-04-26T07:51:39.384109+0000","last_clean":"2024-04-26T07:51:39.384109+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:39.384109+0000","last_undegraded":"2024-04-26T07:51:39.384109+0000","last_fullsized":"2024-04-26T07:51:39.384109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412874+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:39.412874+0000","last_peered":"2024-04-26T07:51:39.412874+0000","last_clean":"2024-04-26T07:51:39.412874+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:39.412874+0000","last_undegraded":"2024-04-26T07:51:39.412874+0000","last_fullsized":"2024-04-26T07:51:39.412874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405058+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:39.405058+0000","last_peered":"2024-04-26T07:51:39.405058+0000","last_clean":"2024-04-26T07:51:39.405058+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:39.405058+0000","last_undegraded":"2024-04-26T07:51:39.405058+0000","last_fullsized":"2024-04-26T07:51:39.405058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371172+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:51:39.371172+0000","last_peered":"2024-04-26T07:51:39.371172+0000","last_clean":"2024-04-26T07:51:39.371172+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:51:39.371172+0000","last_undegraded":"2024-04-26T07:51:39.371172+0000","last_fullsized":"2024-04-26T07:51:39.371172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"88'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400610+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:39.400610+0000","last_peered":"2024-04-26T07:51:39.400610+0000","last_clean":"2024-04-26T07:51:39.400610+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:39.400610+0000","last_undegraded":"2024-04-26T07:51:39.400610+0000","last_fullsized":"2024-04-26T07:51:39.400610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372282+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:51:39.372282+0000","last_peered":"2024-04-26T07:51:39.372282+0000","last_clean":"2024-04-26T07:51:39.372282+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:51:39.372282+0000","last_undegraded":"2024-04-26T07:51:39.372282+0000","last_fullsized":"2024-04-26T07:51:39.372282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392473+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:51:39.392473+0000","last_peered":"2024-04-26T07:51:39.392473+0000","last_clean":"2024-04-26T07:51:39.392473+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:51:39.392473+0000","last_undegraded":"2024-04-26T07:51:39.392473+0000","last_fullsized":"2024-04-26T07:51:39.392473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"90'35","reported_seq":226,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389945+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:51:39.389945+0000","last_peered":"2024-04-26T07:51:39.389945+0000","last_clean":"2024-04-26T07:51:39.389945+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:51:39.389945+0000","last_undegraded":"2024-04-26T07:51:39.389945+0000","last_fullsized":"2024-04-26T07:51:39.389945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374284+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:39.374284+0000","last_peered":"2024-04-26T07:51:39.374284+0000","last_clean":"2024-04-26T07:51:39.374284+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:39.374284+0000","last_undegraded":"2024-04-26T07:51:39.374284+0000","last_fullsized":"2024-04-26T07:51:39.374284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389492+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:39.389492+0000","last_peered":"2024-04-26T07:51:39.389492+0000","last_clean":"2024-04-26T07:51:39.389492+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:39.389492+0000","last_undegraded":"2024-04-26T07:51:39.389492+0000","last_fullsized":"2024-04-26T07:51:39.389492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393090+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:51:39.393090+0000","last_peered":"2024-04-26T07:51:39.393090+0000","last_clean":"2024-04-26T07:51:39.393090+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:51:39.393090+0000","last_undegraded":"2024-04-26T07:51:39.393090+0000","last_fullsized":"2024-04-26T07:51:39.393090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372167+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:51:39.372167+0000","last_peered":"2024-04-26T07:51:39.372167+0000","last_clean":"2024-04-26T07:51:39.372167+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:51:39.372167+0000","last_undegraded":"2024-04-26T07:51:39.372167+0000","last_fullsized":"2024-04-26T07:51:39.372167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.186748+0000","last_change":"2024-04-26T07:50:53.967883+0000","last_active":"2024-04-26T07:51:38.186748+0000","last_peered":"2024-04-26T07:51:38.186748+0000","last_clean":"2024-04-26T07:51:38.186748+0000","last_became_active":"2024-04-26T07:50:53.967473+0000","last_became_peered":"2024-04-26T07:50:53.967473+0000","last_unstale":"2024-04-26T07:51:38.186748+0000","last_undegraded":"2024-04-26T07:51:38.186748+0000","last_fullsized":"2024-04-26T07:51:38.186748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:20.524401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407217+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:51:39.407217+0000","last_peered":"2024-04-26T07:51:39.407217+0000","last_clean":"2024-04-26T07:51:39.407217+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:51:39.407217+0000","last_undegraded":"2024-04-26T07:51:39.407217+0000","last_fullsized":"2024-04-26T07:51:39.407217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":200,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370492+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:39.370492+0000","last_peered":"2024-04-26T07:51:39.370492+0000","last_clean":"2024-04-26T07:51:39.370492+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:39.370492+0000","last_undegraded":"2024-04-26T07:51:39.370492+0000","last_fullsized":"2024-04-26T07:51:39.370492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'134","reported_seq":375,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405553+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:51:39.405553+0000","last_peered":"2024-04-26T07:51:39.405553+0000","last_clean":"2024-04-26T07:51:39.405553+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:51:39.405553+0000","last_undegraded":"2024-04-26T07:51:39.405553+0000","last_fullsized":"2024-04-26T07:51:39.405553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384142+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:39.384142+0000","last_peered":"2024-04-26T07:51:39.384142+0000","last_clean":"2024-04-26T07:51:39.384142+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:39.384142+0000","last_undegraded":"2024-04-26T07:51:39.384142+0000","last_fullsized":"2024-04-26T07:51:39.384142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377875+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:51:39.377875+0000","last_peered":"2024-04-26T07:51:39.377875+0000","last_clean":"2024-04-26T07:51:39.377875+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:51:39.377875+0000","last_undegraded":"2024-04-26T07:51:39.377875+0000","last_fullsized":"2024-04-26T07:51:39.377875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'19","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383860+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:39.383860+0000","last_peered":"2024-04-26T07:51:39.383860+0000","last_clean":"2024-04-26T07:51:39.383860+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:39.383860+0000","last_undegraded":"2024-04-26T07:51:39.383860+0000","last_fullsized":"2024-04-26T07:51:39.383860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373893+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:51:39.373893+0000","last_peered":"2024-04-26T07:51:39.373893+0000","last_clean":"2024-04-26T07:51:39.373893+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:51:39.373893+0000","last_undegraded":"2024-04-26T07:51:39.373893+0000","last_fullsized":"2024-04-26T07:51:39.373893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375376+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:39.375376+0000","last_peered":"2024-04-26T07:51:39.375376+0000","last_clean":"2024-04-26T07:51:39.375376+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:39.375376+0000","last_undegraded":"2024-04-26T07:51:39.375376+0000","last_fullsized":"2024-04-26T07:51:39.375376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375966+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:51:39.375966+0000","last_peered":"2024-04-26T07:51:39.375966+0000","last_clean":"2024-04-26T07:51:39.375966+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:51:39.375966+0000","last_undegraded":"2024-04-26T07:51:39.375966+0000","last_fullsized":"2024-04-26T07:51:39.375966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'134","reported_seq":347,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381796+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:51:39.381796+0000","last_peered":"2024-04-26T07:51:39.381796+0000","last_clean":"2024-04-26T07:51:39.381796+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:51:39.381796+0000","last_undegraded":"2024-04-26T07:51:39.381796+0000","last_fullsized":"2024-04-26T07:51:39.381796+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391088+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:39.391088+0000","last_peered":"2024-04-26T07:51:39.391088+0000","last_clean":"2024-04-26T07:51:39.391088+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:39.391088+0000","last_undegraded":"2024-04-26T07:51:39.391088+0000","last_fullsized":"2024-04-26T07:51:39.391088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":234,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375190+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:39.375190+0000","last_peered":"2024-04-26T07:51:39.375190+0000","last_clean":"2024-04-26T07:51:39.375190+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:39.375190+0000","last_undegraded":"2024-04-26T07:51:39.375190+0000","last_fullsized":"2024-04-26T07:51:39.375190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394463+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:39.394463+0000","last_peered":"2024-04-26T07:51:39.394463+0000","last_clean":"2024-04-26T07:51:39.394463+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:39.394463+0000","last_undegraded":"2024-04-26T07:51:39.394463+0000","last_fullsized":"2024-04-26T07:51:39.394463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.413288+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:51:39.413288+0000","last_peered":"2024-04-26T07:51:39.413288+0000","last_clean":"2024-04-26T07:51:39.413288+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:51:39.413288+0000","last_undegraded":"2024-04-26T07:51:39.413288+0000","last_fullsized":"2024-04-26T07:51:39.413288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377673+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:39.377673+0000","last_peered":"2024-04-26T07:51:39.377673+0000","last_clean":"2024-04-26T07:51:39.377673+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:39.377673+0000","last_undegraded":"2024-04-26T07:51:39.377673+0000","last_fullsized":"2024-04-26T07:51:39.377673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"90'44","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.555117+0000","last_change":"2024-04-26T07:50:53.973637+0000","last_active":"2024-04-26T07:51:38.555117+0000","last_peered":"2024-04-26T07:51:38.555117+0000","last_clean":"2024-04-26T07:51:38.555117+0000","last_became_active":"2024-04-26T07:50:53.972585+0000","last_became_peered":"2024-04-26T07:50:53.972585+0000","last_unstale":"2024-04-26T07:51:38.555117+0000","last_undegraded":"2024-04-26T07:51:38.555117+0000","last_fullsized":"2024-04-26T07:51:38.555117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:54.979556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379607+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:51:39.379607+0000","last_peered":"2024-04-26T07:51:39.379607+0000","last_clean":"2024-04-26T07:51:39.379607+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:51:39.379607+0000","last_undegraded":"2024-04-26T07:51:39.379607+0000","last_fullsized":"2024-04-26T07:51:39.379607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":177,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397667+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:39.397667+0000","last_peered":"2024-04-26T07:51:39.397667+0000","last_clean":"2024-04-26T07:51:39.397667+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:39.397667+0000","last_undegraded":"2024-04-26T07:51:39.397667+0000","last_fullsized":"2024-04-26T07:51:39.397667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392928+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:39.392928+0000","last_peered":"2024-04-26T07:51:39.392928+0000","last_clean":"2024-04-26T07:51:39.392928+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:39.392928+0000","last_undegraded":"2024-04-26T07:51:39.392928+0000","last_fullsized":"2024-04-26T07:51:39.392928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375375+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:51:39.375375+0000","last_peered":"2024-04-26T07:51:39.375375+0000","last_clean":"2024-04-26T07:51:39.375375+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:51:39.375375+0000","last_undegraded":"2024-04-26T07:51:39.375375+0000","last_fullsized":"2024-04-26T07:51:39.375375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"89'31","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377267+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:39.377267+0000","last_peered":"2024-04-26T07:51:39.377267+0000","last_clean":"2024-04-26T07:51:39.377267+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:39.377267+0000","last_undegraded":"2024-04-26T07:51:39.377267+0000","last_fullsized":"2024-04-26T07:51:39.377267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371320+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:51:39.371320+0000","last_peered":"2024-04-26T07:51:39.371320+0000","last_clean":"2024-04-26T07:51:39.371320+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:51:39.371320+0000","last_undegraded":"2024-04-26T07:51:39.371320+0000","last_fullsized":"2024-04-26T07:51:39.371320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"90'19","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377783+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:51:39.377783+0000","last_peered":"2024-04-26T07:51:39.377783+0000","last_clean":"2024-04-26T07:51:39.377783+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:51:39.377783+0000","last_undegraded":"2024-04-26T07:51:39.377783+0000","last_fullsized":"2024-04-26T07:51:39.377783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377604+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:51:39.377604+0000","last_peered":"2024-04-26T07:51:39.377604+0000","last_clean":"2024-04-26T07:51:39.377604+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:51:39.377604+0000","last_undegraded":"2024-04-26T07:51:39.377604+0000","last_fullsized":"2024-04-26T07:51:39.377604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":177,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380056+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:39.380056+0000","last_peered":"2024-04-26T07:51:39.380056+0000","last_clean":"2024-04-26T07:51:39.380056+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:39.380056+0000","last_undegraded":"2024-04-26T07:51:39.380056+0000","last_fullsized":"2024-04-26T07:51:39.380056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370943+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:51:39.370943+0000","last_peered":"2024-04-26T07:51:39.370943+0000","last_clean":"2024-04-26T07:51:39.370943+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:51:39.370943+0000","last_undegraded":"2024-04-26T07:51:39.370943+0000","last_fullsized":"2024-04-26T07:51:39.370943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'18","reported_seq":203,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.361166+0000","last_change":"2024-04-26T07:50:53.963894+0000","last_active":"2024-04-26T07:51:38.361166+0000","last_peered":"2024-04-26T07:51:38.361166+0000","last_clean":"2024-04-26T07:51:38.361166+0000","last_became_active":"2024-04-26T07:50:53.963007+0000","last_became_peered":"2024-04-26T07:50:53.963007+0000","last_unstale":"2024-04-26T07:51:38.361166+0000","last_undegraded":"2024-04-26T07:51:38.361166+0000","last_fullsized":"2024-04-26T07:51:38.361166+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:26.560585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380927+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:39.380927+0000","last_peered":"2024-04-26T07:51:39.380927+0000","last_clean":"2024-04-26T07:51:39.380927+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:39.380927+0000","last_undegraded":"2024-04-26T07:51:39.380927+0000","last_fullsized":"2024-04-26T07:51:39.380927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"101'10","reported_seq":189,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389777+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:51:39.389777+0000","last_peered":"2024-04-26T07:51:39.389777+0000","last_clean":"2024-04-26T07:51:39.389777+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:51:39.389777+0000","last_undegraded":"2024-04-26T07:51:39.389777+0000","last_fullsized":"2024-04-26T07:51:39.389777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":56,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.554776+0000","last_change":"2024-04-26T07:50:53.973397+0000","last_active":"2024-04-26T07:51:38.554776+0000","last_peered":"2024-04-26T07:51:38.554776+0000","last_clean":"2024-04-26T07:51:38.554776+0000","last_became_active":"2024-04-26T07:50:53.972614+0000","last_became_peered":"2024-04-26T07:50:53.972614+0000","last_unstale":"2024-04-26T07:51:38.554776+0000","last_undegraded":"2024-04-26T07:51:38.554776+0000","last_fullsized":"2024-04-26T07:51:38.554776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:21.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389427+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:39.389427+0000","last_peered":"2024-04-26T07:51:39.389427+0000","last_clean":"2024-04-26T07:51:39.389427+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:39.389427+0000","last_undegraded":"2024-04-26T07:51:39.389427+0000","last_fullsized":"2024-04-26T07:51:39.389427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379349+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:51:39.379349+0000","last_peered":"2024-04-26T07:51:39.379349+0000","last_clean":"2024-04-26T07:51:39.379349+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:51:39.379349+0000","last_undegraded":"2024-04-26T07:51:39.379349+0000","last_fullsized":"2024-04-26T07:51:39.379349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408423+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:39.408423+0000","last_peered":"2024-04-26T07:51:39.408423+0000","last_clean":"2024-04-26T07:51:39.408423+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:39.408423+0000","last_undegraded":"2024-04-26T07:51:39.408423+0000","last_fullsized":"2024-04-26T07:51:39.408423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.360898+0000","last_change":"2024-04-26T07:50:53.967849+0000","last_active":"2024-04-26T07:51:38.360898+0000","last_peered":"2024-04-26T07:51:38.360898+0000","last_clean":"2024-04-26T07:51:38.360898+0000","last_became_active":"2024-04-26T07:50:53.966926+0000","last_became_peered":"2024-04-26T07:50:53.966926+0000","last_unstale":"2024-04-26T07:51:38.360898+0000","last_undegraded":"2024-04-26T07:51:38.360898+0000","last_fullsized":"2024-04-26T07:51:38.360898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:54.861809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"90'20","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380656+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:51:39.380656+0000","last_peered":"2024-04-26T07:51:39.380656+0000","last_clean":"2024-04-26T07:51:39.380656+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:51:39.380656+0000","last_undegraded":"2024-04-26T07:51:39.380656+0000","last_fullsized":"2024-04-26T07:51:39.380656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407151+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:39.407151+0000","last_peered":"2024-04-26T07:51:39.407151+0000","last_clean":"2024-04-26T07:51:39.407151+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:39.407151+0000","last_undegraded":"2024-04-26T07:51:39.407151+0000","last_fullsized":"2024-04-26T07:51:39.407151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397451+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:39.397451+0000","last_peered":"2024-04-26T07:51:39.397451+0000","last_clean":"2024-04-26T07:51:39.397451+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:39.397451+0000","last_undegraded":"2024-04-26T07:51:39.397451+0000","last_fullsized":"2024-04-26T07:51:39.397451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378122+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:51:39.378122+0000","last_peered":"2024-04-26T07:51:39.378122+0000","last_clean":"2024-04-26T07:51:39.378122+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:51:39.378122+0000","last_undegraded":"2024-04-26T07:51:39.378122+0000","last_fullsized":"2024-04-26T07:51:39.378122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'25","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394144+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:39.394144+0000","last_peered":"2024-04-26T07:51:39.394144+0000","last_clean":"2024-04-26T07:51:39.394144+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:39.394144+0000","last_undegraded":"2024-04-26T07:51:39.394144+0000","last_fullsized":"2024-04-26T07:51:39.394144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407013+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:51:39.407013+0000","last_peered":"2024-04-26T07:51:39.407013+0000","last_clean":"2024-04-26T07:51:39.407013+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:51:39.407013+0000","last_undegraded":"2024-04-26T07:51:39.407013+0000","last_fullsized":"2024-04-26T07:51:39.407013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"90'18","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.097250+0000","last_change":"2024-04-26T07:50:53.965258+0000","last_active":"2024-04-26T07:51:38.097250+0000","last_peered":"2024-04-26T07:51:38.097250+0000","last_clean":"2024-04-26T07:51:38.097250+0000","last_became_active":"2024-04-26T07:50:53.964570+0000","last_became_peered":"2024-04-26T07:50:53.964570+0000","last_unstale":"2024-04-26T07:51:38.097250+0000","last_undegraded":"2024-04-26T07:51:38.097250+0000","last_fullsized":"2024-04-26T07:51:38.097250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:00.227690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391695+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:51:39.391695+0000","last_peered":"2024-04-26T07:51:39.391695+0000","last_clean":"2024-04-26T07:51:39.391695+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:51:39.391695+0000","last_undegraded":"2024-04-26T07:51:39.391695+0000","last_fullsized":"2024-04-26T07:51:39.391695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.413295+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:51:39.413295+0000","last_peered":"2024-04-26T07:51:39.413295+0000","last_clean":"2024-04-26T07:51:39.413295+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:51:39.413295+0000","last_undegraded":"2024-04-26T07:51:39.413295+0000","last_fullsized":"2024-04-26T07:51:39.413295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'23","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378325+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:39.378325+0000","last_peered":"2024-04-26T07:51:39.378325+0000","last_clean":"2024-04-26T07:51:39.378325+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:39.378325+0000","last_undegraded":"2024-04-26T07:51:39.378325+0000","last_fullsized":"2024-04-26T07:51:39.378325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394247+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:51:39.394247+0000","last_peered":"2024-04-26T07:51:39.394247+0000","last_clean":"2024-04-26T07:51:39.394247+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:51:39.394247+0000","last_undegraded":"2024-04-26T07:51:39.394247+0000","last_fullsized":"2024-04-26T07:51:39.394247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"90'29","reported_seq":218,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373437+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:51:39.373437+0000","last_peered":"2024-04-26T07:51:39.373437+0000","last_clean":"2024-04-26T07:51:39.373437+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:51:39.373437+0000","last_undegraded":"2024-04-26T07:51:39.373437+0000","last_fullsized":"2024-04-26T07:51:39.373437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397735+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:39.397735+0000","last_peered":"2024-04-26T07:51:39.397735+0000","last_clean":"2024-04-26T07:51:39.397735+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:39.397735+0000","last_undegraded":"2024-04-26T07:51:39.397735+0000","last_fullsized":"2024-04-26T07:51:39.397735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380112+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:39.380112+0000","last_peered":"2024-04-26T07:51:39.380112+0000","last_clean":"2024-04-26T07:51:39.380112+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:39.380112+0000","last_undegraded":"2024-04-26T07:51:39.380112+0000","last_fullsized":"2024-04-26T07:51:39.380112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393319+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:51:39.393319+0000","last_peered":"2024-04-26T07:51:39.393319+0000","last_clean":"2024-04-26T07:51:39.393319+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:51:39.393319+0000","last_undegraded":"2024-04-26T07:51:39.393319+0000","last_fullsized":"2024-04-26T07:51:39.393319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'16","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373938+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:51:39.373938+0000","last_peered":"2024-04-26T07:51:39.373938+0000","last_clean":"2024-04-26T07:51:39.373938+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:51:39.373938+0000","last_undegraded":"2024-04-26T07:51:39.373938+0000","last_fullsized":"2024-04-26T07:51:39.373938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412868+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:51:39.412868+0000","last_peered":"2024-04-26T07:51:39.412868+0000","last_clean":"2024-04-26T07:51:39.412868+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:51:39.412868+0000","last_undegraded":"2024-04-26T07:51:39.412868+0000","last_fullsized":"2024-04-26T07:51:39.412868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"90'25","reported_seq":162,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.401018+0000","last_change":"2024-04-26T07:51:39.401018+0000","last_active":"2024-04-26T07:51:39.401018+0000","last_peered":"2024-04-26T07:50:49.904013+0000","last_clean":"2024-04-26T07:50:49.904013+0000","last_became_active":"2024-04-26T07:48:27.577870+0000","last_became_peered":"2024-04-26T07:48:27.577870+0000","last_unstale":"2024-04-26T07:51:39.401018+0000","last_undegraded":"2024-04-26T07:51:39.401018+0000","last_fullsized":"2024-04-26T07:51:39.401018+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373623+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:39.373623+0000","last_peered":"2024-04-26T07:51:39.373623+0000","last_clean":"2024-04-26T07:51:39.373623+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:39.373623+0000","last_undegraded":"2024-04-26T07:51:39.373623+0000","last_fullsized":"2024-04-26T07:51:39.373623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406561+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:39.406561+0000","last_peered":"2024-04-26T07:51:39.406561+0000","last_clean":"2024-04-26T07:51:39.406561+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:39.406561+0000","last_undegraded":"2024-04-26T07:51:39.406561+0000","last_fullsized":"2024-04-26T07:51:39.406561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380723+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:51:39.380723+0000","last_peered":"2024-04-26T07:51:39.380723+0000","last_clean":"2024-04-26T07:51:39.380723+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:51:39.380723+0000","last_undegraded":"2024-04-26T07:51:39.380723+0000","last_fullsized":"2024-04-26T07:51:39.380723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'31","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376544+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:39.376544+0000","last_peered":"2024-04-26T07:51:39.376544+0000","last_clean":"2024-04-26T07:51:39.376544+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:39.376544+0000","last_undegraded":"2024-04-26T07:51:39.376544+0000","last_fullsized":"2024-04-26T07:51:39.376544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378631+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:51:39.378631+0000","last_peered":"2024-04-26T07:51:39.378631+0000","last_clean":"2024-04-26T07:51:39.378631+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:51:39.378631+0000","last_undegraded":"2024-04-26T07:51:39.378631+0000","last_fullsized":"2024-04-26T07:51:39.378631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"90'19","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384277+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:51:39.384277+0000","last_peered":"2024-04-26T07:51:39.384277+0000","last_clean":"2024-04-26T07:51:39.384277+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:51:39.384277+0000","last_undegraded":"2024-04-26T07:51:39.384277+0000","last_fullsized":"2024-04-26T07:51:39.384277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373433+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:39.373433+0000","last_peered":"2024-04-26T07:51:39.373433+0000","last_clean":"2024-04-26T07:51:39.373433+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:39.373433+0000","last_undegraded":"2024-04-26T07:51:39.373433+0000","last_fullsized":"2024-04-26T07:51:39.373433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.399982+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:39.399982+0000","last_peered":"2024-04-26T07:51:39.399982+0000","last_clean":"2024-04-26T07:51:39.399982+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:39.399982+0000","last_undegraded":"2024-04-26T07:51:39.399982+0000","last_fullsized":"2024-04-26T07:51:39.399982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387435+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:51:39.387435+0000","last_peered":"2024-04-26T07:51:39.387435+0000","last_clean":"2024-04-26T07:51:39.387435+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:51:39.387435+0000","last_undegraded":"2024-04-26T07:51:39.387435+0000","last_fullsized":"2024-04-26T07:51:39.387435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"88'18","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392037+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:39.392037+0000","last_peered":"2024-04-26T07:51:39.392037+0000","last_clean":"2024-04-26T07:51:39.392037+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:39.392037+0000","last_undegraded":"2024-04-26T07:51:39.392037+0000","last_fullsized":"2024-04-26T07:51:39.392037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374068+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:51:39.374068+0000","last_peered":"2024-04-26T07:51:39.374068+0000","last_clean":"2024-04-26T07:51:39.374068+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:51:39.374068+0000","last_undegraded":"2024-04-26T07:51:39.374068+0000","last_fullsized":"2024-04-26T07:51:39.374068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379379+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:51:39.379379+0000","last_peered":"2024-04-26T07:51:39.379379+0000","last_clean":"2024-04-26T07:51:39.379379+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:51:39.379379+0000","last_undegraded":"2024-04-26T07:51:39.379379+0000","last_fullsized":"2024-04-26T07:51:39.379379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'134","reported_seq":424,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412386+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:51:39.412386+0000","last_peered":"2024-04-26T07:51:39.412386+0000","last_clean":"2024-04-26T07:51:39.412386+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:51:39.412386+0000","last_undegraded":"2024-04-26T07:51:39.412386+0000","last_fullsized":"2024-04-26T07:51:39.412386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":128,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.386998+0000","last_change":"2024-04-26T07:51:39.386998+0000","last_active":"2024-04-26T07:51:39.386998+0000","last_peered":"2024-04-26T07:50:49.902583+0000","last_clean":"2024-04-26T07:50:49.902583+0000","last_became_active":"2024-04-26T07:48:31.604886+0000","last_became_peered":"2024-04-26T07:48:31.604886+0000","last_unstale":"2024-04-26T07:51:39.386998+0000","last_undegraded":"2024-04-26T07:51:39.386998+0000","last_fullsized":"2024-04-26T07:51:39.386998+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375071+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:39.375071+0000","last_peered":"2024-04-26T07:51:39.375071+0000","last_clean":"2024-04-26T07:51:39.375071+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:39.375071+0000","last_undegraded":"2024-04-26T07:51:39.375071+0000","last_fullsized":"2024-04-26T07:51:39.375071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"89'14","reported_seq":147,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386364+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:39.386364+0000","last_peered":"2024-04-26T07:51:39.386364+0000","last_clean":"2024-04-26T07:51:39.386364+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:39.386364+0000","last_undegraded":"2024-04-26T07:51:39.386364+0000","last_fullsized":"2024-04-26T07:51:39.386364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:16.352834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":132,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.383133+0000","last_change":"2024-04-26T07:50:52.952271+0000","last_active":"2024-04-26T07:48:24.527456+0000","last_peered":"2024-04-26T07:48:24.527456+0000","last_clean":"2024-04-26T07:48:24.527456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.383133+0000","last_undegraded":"2024-04-26T07:51:39.383133+0000","last_fullsized":"2024-04-26T07:51:39.383133+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"90'23","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400652+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:51:39.400652+0000","last_peered":"2024-04-26T07:51:39.400652+0000","last_clean":"2024-04-26T07:51:39.400652+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:51:39.400652+0000","last_undegraded":"2024-04-26T07:51:39.400652+0000","last_fullsized":"2024-04-26T07:51:39.400652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.388932+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:51:39.388932+0000","last_peered":"2024-04-26T07:51:39.388932+0000","last_clean":"2024-04-26T07:51:39.388932+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:51:39.388932+0000","last_undegraded":"2024-04-26T07:51:39.388932+0000","last_fullsized":"2024-04-26T07:51:39.388932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":124,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.408976+0000","last_change":"2024-04-26T07:51:39.408976+0000","last_active":"2024-04-26T07:51:39.408976+0000","last_peered":"2024-04-26T07:50:49.905210+0000","last_clean":"2024-04-26T07:50:49.905210+0000","last_became_active":"2024-04-26T07:48:31.597882+0000","last_became_peered":"2024-04-26T07:48:31.597882+0000","last_unstale":"2024-04-26T07:51:39.408976+0000","last_undegraded":"2024-04-26T07:51:39.408976+0000","last_fullsized":"2024-04-26T07:51:39.408976+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376230+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:51:39.376230+0000","last_peered":"2024-04-26T07:51:39.376230+0000","last_clean":"2024-04-26T07:51:39.376230+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:51:39.376230+0000","last_undegraded":"2024-04-26T07:51:39.376230+0000","last_fullsized":"2024-04-26T07:51:39.376230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"90'28","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400325+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:51:39.400325+0000","last_peered":"2024-04-26T07:51:39.400325+0000","last_clean":"2024-04-26T07:51:39.400325+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:51:39.400325+0000","last_undegraded":"2024-04-26T07:51:39.400325+0000","last_fullsized":"2024-04-26T07:51:39.400325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397583+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:51:39.397583+0000","last_peered":"2024-04-26T07:51:39.397583+0000","last_clean":"2024-04-26T07:51:39.397583+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:51:39.397583+0000","last_undegraded":"2024-04-26T07:51:39.397583+0000","last_fullsized":"2024-04-26T07:51:39.397583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"90'18","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389206+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:39.389206+0000","last_peered":"2024-04-26T07:51:39.389206+0000","last_clean":"2024-04-26T07:51:39.389206+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:39.389206+0000","last_undegraded":"2024-04-26T07:51:39.389206+0000","last_fullsized":"2024-04-26T07:51:39.389206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406639+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:39.406639+0000","last_peered":"2024-04-26T07:51:39.406639+0000","last_clean":"2024-04-26T07:51:39.406639+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:39.406639+0000","last_undegraded":"2024-04-26T07:51:39.406639+0000","last_fullsized":"2024-04-26T07:51:39.406639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383761+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:39.383761+0000","last_peered":"2024-04-26T07:51:39.383761+0000","last_clean":"2024-04-26T07:51:39.383761+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:39.383761+0000","last_undegraded":"2024-04-26T07:51:39.383761+0000","last_fullsized":"2024-04-26T07:51:39.383761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379469+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:39.379469+0000","last_peered":"2024-04-26T07:51:39.379469+0000","last_clean":"2024-04-26T07:51:39.379469+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:39.379469+0000","last_undegraded":"2024-04-26T07:51:39.379469+0000","last_fullsized":"2024-04-26T07:51:39.379469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'27","reported_seq":161,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391787+0000","last_change":"2024-04-26T07:49:08.971107+0000","last_active":"2024-04-26T07:51:39.391787+0000","last_peered":"2024-04-26T07:51:39.391787+0000","last_clean":"2024-04-26T07:51:39.391787+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:51:39.391787+0000","last_undegraded":"2024-04-26T07:51:39.391787+0000","last_fullsized":"2024-04-26T07:51:39.391787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:06.980641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374176+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:39.374176+0000","last_peered":"2024-04-26T07:51:39.374176+0000","last_clean":"2024-04-26T07:51:39.374176+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:39.374176+0000","last_undegraded":"2024-04-26T07:51:39.374176+0000","last_fullsized":"2024-04-26T07:51:39.374176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"90'13","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381600+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:51:39.381600+0000","last_peered":"2024-04-26T07:51:39.381600+0000","last_clean":"2024-04-26T07:51:39.381600+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:51:39.381600+0000","last_undegraded":"2024-04-26T07:51:39.381600+0000","last_fullsized":"2024-04-26T07:51:39.381600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374528+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:39.374528+0000","last_peered":"2024-04-26T07:51:39.374528+0000","last_clean":"2024-04-26T07:51:39.374528+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:39.374528+0000","last_undegraded":"2024-04-26T07:51:39.374528+0000","last_fullsized":"2024-04-26T07:51:39.374528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":120,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.388033+0000","last_change":"2024-04-26T07:50:52.943695+0000","last_active":"2024-04-26T07:48:30.551424+0000","last_peered":"2024-04-26T07:48:30.551424+0000","last_clean":"2024-04-26T07:48:30.551424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.388033+0000","last_undegraded":"2024-04-26T07:51:39.388033+0000","last_fullsized":"2024-04-26T07:51:39.388033+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":252,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374974+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:39.374974+0000","last_peered":"2024-04-26T07:51:39.374974+0000","last_clean":"2024-04-26T07:51:39.374974+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:39.374974+0000","last_undegraded":"2024-04-26T07:51:39.374974+0000","last_fullsized":"2024-04-26T07:51:39.374974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'25","reported_seq":219,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393997+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:39.393997+0000","last_peered":"2024-04-26T07:51:39.393997+0000","last_clean":"2024-04-26T07:51:39.393997+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:39.393997+0000","last_undegraded":"2024-04-26T07:51:39.393997+0000","last_fullsized":"2024-04-26T07:51:39.393997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:34.437375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370649+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:51:39.370649+0000","last_peered":"2024-04-26T07:51:39.370649+0000","last_clean":"2024-04-26T07:51:39.370649+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:51:39.370649+0000","last_undegraded":"2024-04-26T07:51:39.370649+0000","last_fullsized":"2024-04-26T07:51:39.370649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"90'17","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375011+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:51:39.375011+0000","last_peered":"2024-04-26T07:51:39.375011+0000","last_clean":"2024-04-26T07:51:39.375011+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:51:39.375011+0000","last_undegraded":"2024-04-26T07:51:39.375011+0000","last_fullsized":"2024-04-26T07:51:39.375011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391487+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:51:39.391487+0000","last_peered":"2024-04-26T07:51:39.391487+0000","last_clean":"2024-04-26T07:51:39.391487+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:39.391487+0000","last_undegraded":"2024-04-26T07:51:39.391487+0000","last_fullsized":"2024-04-26T07:51:39.391487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378701+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:39.378701+0000","last_peered":"2024-04-26T07:51:39.378701+0000","last_clean":"2024-04-26T07:51:39.378701+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:39.378701+0000","last_undegraded":"2024-04-26T07:51:39.378701+0000","last_fullsized":"2024-04-26T07:51:39.378701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":227,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374241+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:51:39.374241+0000","last_peered":"2024-04-26T07:51:39.374241+0000","last_clean":"2024-04-26T07:51:39.374241+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:51:39.374241+0000","last_undegraded":"2024-04-26T07:51:39.374241+0000","last_fullsized":"2024-04-26T07:51:39.374241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406611+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:51:39.406611+0000","last_peered":"2024-04-26T07:51:39.406611+0000","last_clean":"2024-04-26T07:51:39.406611+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:51:39.406611+0000","last_undegraded":"2024-04-26T07:51:39.406611+0000","last_fullsized":"2024-04-26T07:51:39.406611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373707+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:51:39.373707+0000","last_peered":"2024-04-26T07:51:39.373707+0000","last_clean":"2024-04-26T07:51:39.373707+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:51:39.373707+0000","last_undegraded":"2024-04-26T07:51:39.373707+0000","last_fullsized":"2024-04-26T07:51:39.373707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'26","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385843+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:51:39.385843+0000","last_peered":"2024-04-26T07:51:39.385843+0000","last_clean":"2024-04-26T07:51:39.385843+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:51:39.385843+0000","last_undegraded":"2024-04-26T07:51:39.385843+0000","last_fullsized":"2024-04-26T07:51:39.385843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397011+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:51:39.397011+0000","last_peered":"2024-04-26T07:51:39.397011+0000","last_clean":"2024-04-26T07:51:39.397011+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:51:39.397011+0000","last_undegraded":"2024-04-26T07:51:39.397011+0000","last_fullsized":"2024-04-26T07:51:39.397011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"89'18","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401510+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:39.401510+0000","last_peered":"2024-04-26T07:51:39.401510+0000","last_clean":"2024-04-26T07:51:39.401510+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:39.401510+0000","last_undegraded":"2024-04-26T07:51:39.401510+0000","last_fullsized":"2024-04-26T07:51:39.401510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372213+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:51:39.372213+0000","last_peered":"2024-04-26T07:51:39.372213+0000","last_clean":"2024-04-26T07:51:39.372213+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:51:39.372213+0000","last_undegraded":"2024-04-26T07:51:39.372213+0000","last_fullsized":"2024-04-26T07:51:39.372213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'23","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392390+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:39.392390+0000","last_peered":"2024-04-26T07:51:39.392390+0000","last_clean":"2024-04-26T07:51:39.392390+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:39.392390+0000","last_undegraded":"2024-04-26T07:51:39.392390+0000","last_fullsized":"2024-04-26T07:51:39.392390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381281+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:51:39.381281+0000","last_peered":"2024-04-26T07:51:39.381281+0000","last_clean":"2024-04-26T07:51:39.381281+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:51:39.381281+0000","last_undegraded":"2024-04-26T07:51:39.381281+0000","last_fullsized":"2024-04-26T07:51:39.381281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'32","reported_seq":223,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383336+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:39.383336+0000","last_peered":"2024-04-26T07:51:39.383336+0000","last_clean":"2024-04-26T07:51:39.383336+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:39.383336+0000","last_undegraded":"2024-04-26T07:51:39.383336+0000","last_fullsized":"2024-04-26T07:51:39.383336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376481+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:51:39.376481+0000","last_peered":"2024-04-26T07:51:39.376481+0000","last_clean":"2024-04-26T07:51:39.376481+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:51:39.376481+0000","last_undegraded":"2024-04-26T07:51:39.376481+0000","last_fullsized":"2024-04-26T07:51:39.376481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"89'35","reported_seq":225,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375268+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:39.375268+0000","last_peered":"2024-04-26T07:51:39.375268+0000","last_clean":"2024-04-26T07:51:39.375268+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:39.375268+0000","last_undegraded":"2024-04-26T07:51:39.375268+0000","last_fullsized":"2024-04-26T07:51:39.375268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379302+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:51:39.379302+0000","last_peered":"2024-04-26T07:51:39.379302+0000","last_clean":"2024-04-26T07:51:39.379302+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:51:39.379302+0000","last_undegraded":"2024-04-26T07:51:39.379302+0000","last_fullsized":"2024-04-26T07:51:39.379302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"89'23","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.411733+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:51:39.411733+0000","last_peered":"2024-04-26T07:51:39.411733+0000","last_clean":"2024-04-26T07:51:39.411733+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:51:39.411733+0000","last_undegraded":"2024-04-26T07:51:39.411733+0000","last_fullsized":"2024-04-26T07:51:39.411733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396261+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:51:39.396261+0000","last_peered":"2024-04-26T07:51:39.396261+0000","last_clean":"2024-04-26T07:51:39.396261+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:51:39.396261+0000","last_undegraded":"2024-04-26T07:51:39.396261+0000","last_fullsized":"2024-04-26T07:51:39.396261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384030+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:39.384030+0000","last_peered":"2024-04-26T07:51:39.384030+0000","last_clean":"2024-04-26T07:51:39.384030+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:39.384030+0000","last_undegraded":"2024-04-26T07:51:39.384030+0000","last_fullsized":"2024-04-26T07:51:39.384030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393842+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:51:39.393842+0000","last_peered":"2024-04-26T07:51:39.393842+0000","last_clean":"2024-04-26T07:51:39.393842+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:51:39.393842+0000","last_undegraded":"2024-04-26T07:51:39.393842+0000","last_fullsized":"2024-04-26T07:51:39.393842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406065+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:39.406065+0000","last_peered":"2024-04-26T07:51:39.406065+0000","last_clean":"2024-04-26T07:51:39.406065+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:39.406065+0000","last_undegraded":"2024-04-26T07:51:39.406065+0000","last_fullsized":"2024-04-26T07:51:39.406065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379645+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:51:39.379645+0000","last_peered":"2024-04-26T07:51:39.379645+0000","last_clean":"2024-04-26T07:51:39.379645+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:51:39.379645+0000","last_undegraded":"2024-04-26T07:51:39.379645+0000","last_fullsized":"2024-04-26T07:51:39.379645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379508+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:39.379508+0000","last_peered":"2024-04-26T07:51:39.379508+0000","last_clean":"2024-04-26T07:51:39.379508+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:39.379508+0000","last_undegraded":"2024-04-26T07:51:39.379508+0000","last_fullsized":"2024-04-26T07:51:39.379508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389268+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:51:39.389268+0000","last_peered":"2024-04-26T07:51:39.389268+0000","last_clean":"2024-04-26T07:51:39.389268+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:51:39.389268+0000","last_undegraded":"2024-04-26T07:51:39.389268+0000","last_fullsized":"2024-04-26T07:51:39.389268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'14","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401211+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:51:39.401211+0000","last_peered":"2024-04-26T07:51:39.401211+0000","last_clean":"2024-04-26T07:51:39.401211+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:51:39.401211+0000","last_undegraded":"2024-04-26T07:51:39.401211+0000","last_fullsized":"2024-04-26T07:51:39.401211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378331+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:51:39.378331+0000","last_peered":"2024-04-26T07:51:39.378331+0000","last_clean":"2024-04-26T07:51:39.378331+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:51:39.378331+0000","last_undegraded":"2024-04-26T07:51:39.378331+0000","last_fullsized":"2024-04-26T07:51:39.378331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'27","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392576+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:39.392576+0000","last_peered":"2024-04-26T07:51:39.392576+0000","last_clean":"2024-04-26T07:51:39.392576+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:39.392576+0000","last_undegraded":"2024-04-26T07:51:39.392576+0000","last_fullsized":"2024-04-26T07:51:39.392576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":147,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.360637+0000","last_change":"2024-04-26T07:50:53.964033+0000","last_active":"2024-04-26T07:51:38.360637+0000","last_peered":"2024-04-26T07:51:38.360637+0000","last_clean":"2024-04-26T07:51:38.360637+0000","last_became_active":"2024-04-26T07:50:53.963208+0000","last_became_peered":"2024-04-26T07:50:53.963208+0000","last_unstale":"2024-04-26T07:51:38.360637+0000","last_undegraded":"2024-04-26T07:51:38.360637+0000","last_fullsized":"2024-04-26T07:51:38.360637+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:39.310959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408368+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:39.408368+0000","last_peered":"2024-04-26T07:51:39.408368+0000","last_clean":"2024-04-26T07:51:39.408368+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:39.408368+0000","last_undegraded":"2024-04-26T07:51:39.408368+0000","last_fullsized":"2024-04-26T07:51:39.408368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389677+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:51:39.389677+0000","last_peered":"2024-04-26T07:51:39.389677+0000","last_clean":"2024-04-26T07:51:39.389677+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:51:39.389677+0000","last_undegraded":"2024-04-26T07:51:39.389677+0000","last_fullsized":"2024-04-26T07:51:39.389677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'27","reported_seq":211,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.099005+0000","last_change":"2024-04-26T07:50:53.969078+0000","last_active":"2024-04-26T07:51:38.099005+0000","last_peered":"2024-04-26T07:51:38.099005+0000","last_clean":"2024-04-26T07:51:38.099005+0000","last_became_active":"2024-04-26T07:50:53.968768+0000","last_became_peered":"2024-04-26T07:50:53.968768+0000","last_unstale":"2024-04-26T07:51:38.099005+0000","last_undegraded":"2024-04-26T07:51:38.099005+0000","last_fullsized":"2024-04-26T07:51:38.099005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:53.217128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378100+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:51:39.378100+0000","last_peered":"2024-04-26T07:51:39.378100+0000","last_clean":"2024-04-26T07:51:39.378100+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:51:39.378100+0000","last_undegraded":"2024-04-26T07:51:39.378100+0000","last_fullsized":"2024-04-26T07:51:39.378100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"89'32","reported_seq":223,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392389+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:51:39.392389+0000","last_peered":"2024-04-26T07:51:39.392389+0000","last_clean":"2024-04-26T07:51:39.392389+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:51:39.392389+0000","last_undegraded":"2024-04-26T07:51:39.392389+0000","last_fullsized":"2024-04-26T07:51:39.392389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":164,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.359917+0000","last_change":"2024-04-26T07:50:53.947377+0000","last_active":"2024-04-26T07:51:38.359917+0000","last_peered":"2024-04-26T07:51:38.359917+0000","last_clean":"2024-04-26T07:51:38.359917+0000","last_became_active":"2024-04-26T07:50:53.946376+0000","last_became_peered":"2024-04-26T07:50:53.946376+0000","last_unstale":"2024-04-26T07:51:38.359917+0000","last_undegraded":"2024-04-26T07:51:38.359917+0000","last_fullsized":"2024-04-26T07:51:38.359917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:38.286898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.403358+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:39.403358+0000","last_peered":"2024-04-26T07:51:39.403358+0000","last_clean":"2024-04-26T07:51:39.403358+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:39.403358+0000","last_undegraded":"2024-04-26T07:51:39.403358+0000","last_fullsized":"2024-04-26T07:51:39.403358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"89'21","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405844+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:39.405844+0000","last_peered":"2024-04-26T07:51:39.405844+0000","last_clean":"2024-04-26T07:51:39.405844+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:39.405844+0000","last_undegraded":"2024-04-26T07:51:39.405844+0000","last_fullsized":"2024-04-26T07:51:39.405844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":185,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393607+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:51:39.393607+0000","last_peered":"2024-04-26T07:51:39.393607+0000","last_clean":"2024-04-26T07:51:39.393607+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:51:39.393607+0000","last_undegraded":"2024-04-26T07:51:39.393607+0000","last_fullsized":"2024-04-26T07:51:39.393607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'29","reported_seq":219,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373428+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:51:39.373428+0000","last_peered":"2024-04-26T07:51:39.373428+0000","last_clean":"2024-04-26T07:51:39.373428+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:51:39.373428+0000","last_undegraded":"2024-04-26T07:51:39.373428+0000","last_fullsized":"2024-04-26T07:51:39.373428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":198,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396985+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:51:39.396985+0000","last_peered":"2024-04-26T07:51:39.396985+0000","last_clean":"2024-04-26T07:51:39.396985+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:51:39.396985+0000","last_undegraded":"2024-04-26T07:51:39.396985+0000","last_fullsized":"2024-04-26T07:51:39.396985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1073,"ondisk_log_size":1073,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":850,"num_read_kb":615,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":1435,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716652,"kb_used_data":1685468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92655188,"statfs":{"total":96636764160,"available":94878912512,"internally_reserved":0,"allocated":1725919232,"data_stored":1725325760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203980,"kb_used_data":1172800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93167860,"statfs":{"total":96636764160,"available":95403888640,"internally_reserved":0,"allocated":1200947200,"data_stored":1200387469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1808360,"kb_used_data":1777180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92563480,"statfs":{"total":96636764160,"available":94785003520,"internally_reserved":0,"allocated":1819832320,"data_stored":1819224899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1935044,"kb_used_data":1903864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92436796,"statfs":{"total":96636764160,"available":94655279104,"internally_reserved":0,"allocated":1949556736,"data_stored":1949012579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1877928,"kb_used_data":1842588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92493912,"statfs":{"total":96636764160,"available":94713765888,"internally_reserved":0,"allocated":1886810112,"data_stored":1886217956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1122108,"kb_used_data":1086760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93249732,"statfs":{"total":96636764160,"available":95487725568,"internally_reserved":0,"allocated":1112842240,"data_stored":1112299854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185692,"kb_used_data":1150352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93186148,"statfs":{"total":96636764160,"available":95422615552,"internally_reserved":0,"allocated":1177960448,"data_stored":1177379431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1732968,"kb_used_data":1697624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92638872,"statfs":{"total":96636764160,"available":94862204928,"internally_reserved":0,"allocated":1738366976,"data_stored":1737792724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1736441856,"data_stored":1736441856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1176502272,"data_stored":1176502272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1885339648,"data_stored":1885339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1948254208,"data_stored":1948254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1199570944,"data_stored":1199570944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1723858944,"data_stored":1723858944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":118389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:51:44.107 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:51:44.445 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:44.450 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:51:44.460 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-04-26T07:51:43.849306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3272,"num_read_kb":2961,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3892,"ondisk_log_size":3892,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12582732,"kb_used_data":12316636,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":742391988,"statfs":{"total":773094113280,"available":760209395712,"internally_reserved":0,"allocated":12612235264,"data_stored":12607640672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001738"},"pg_stats":[{"pgid":"3.3f","version":"89'27","reported_seq":213,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.556686+0000","last_change":"2024-04-26T07:50:53.973250+0000","last_active":"2024-04-26T07:51:38.556686+0000","last_peered":"2024-04-26T07:51:38.556686+0000","last_clean":"2024-04-26T07:51:38.556686+0000","last_became_active":"2024-04-26T07:50:53.972389+0000","last_became_peered":"2024-04-26T07:50:53.972389+0000","last_unstale":"2024-04-26T07:51:38.556686+0000","last_undegraded":"2024-04-26T07:51:38.556686+0000","last_fullsized":"2024-04-26T07:51:38.556686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:52.226385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405394+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:51:39.405394+0000","last_peered":"2024-04-26T07:51:39.405394+0000","last_clean":"2024-04-26T07:51:39.405394+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:51:39.405394+0000","last_undegraded":"2024-04-26T07:51:39.405394+0000","last_fullsized":"2024-04-26T07:51:39.405394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'26","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373790+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:51:39.373790+0000","last_peered":"2024-04-26T07:51:39.373790+0000","last_clean":"2024-04-26T07:51:39.373790+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:51:39.373790+0000","last_undegraded":"2024-04-26T07:51:39.373790+0000","last_fullsized":"2024-04-26T07:51:39.373790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":136,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.387146+0000","last_change":"2024-04-26T07:50:52.943972+0000","last_active":"2024-04-26T07:48:22.491812+0000","last_peered":"2024-04-26T07:48:22.491812+0000","last_clean":"2024-04-26T07:48:22.491812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.387146+0000","last_undegraded":"2024-04-26T07:51:39.387146+0000","last_fullsized":"2024-04-26T07:51:39.387146+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'21","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389818+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:39.389818+0000","last_peered":"2024-04-26T07:51:39.389818+0000","last_clean":"2024-04-26T07:51:39.389818+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:39.389818+0000","last_undegraded":"2024-04-26T07:51:39.389818+0000","last_fullsized":"2024-04-26T07:51:39.389818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":224,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375710+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:51:39.375710+0000","last_peered":"2024-04-26T07:51:39.375710+0000","last_clean":"2024-04-26T07:51:39.375710+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:51:39.375710+0000","last_undegraded":"2024-04-26T07:51:39.375710+0000","last_fullsized":"2024-04-26T07:51:39.375710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'23","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400577+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:39.400577+0000","last_peered":"2024-04-26T07:51:39.400577+0000","last_clean":"2024-04-26T07:51:39.400577+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:39.400577+0000","last_undegraded":"2024-04-26T07:51:39.400577+0000","last_fullsized":"2024-04-26T07:51:39.400577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392215+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:39.392215+0000","last_peered":"2024-04-26T07:51:39.392215+0000","last_clean":"2024-04-26T07:51:39.392215+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:39.392215+0000","last_undegraded":"2024-04-26T07:51:39.392215+0000","last_fullsized":"2024-04-26T07:51:39.392215+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'23","reported_seq":171,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.387527+0000","last_change":"2024-04-26T07:51:39.387527+0000","last_active":"2024-04-26T07:51:39.387527+0000","last_peered":"2024-04-26T07:51:07.858168+0000","last_clean":"2024-04-26T07:51:07.858168+0000","last_became_active":"2024-04-26T07:50:53.969003+0000","last_became_peered":"2024-04-26T07:50:53.969003+0000","last_unstale":"2024-04-26T07:51:39.387527+0000","last_undegraded":"2024-04-26T07:51:39.387527+0000","last_fullsized":"2024-04-26T07:51:39.387527+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407983+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:51:39.407983+0000","last_peered":"2024-04-26T07:51:39.407983+0000","last_clean":"2024-04-26T07:51:39.407983+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:51:39.407983+0000","last_undegraded":"2024-04-26T07:51:39.407983+0000","last_fullsized":"2024-04-26T07:51:39.407983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'22","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400511+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:51:39.400511+0000","last_peered":"2024-04-26T07:51:39.400511+0000","last_clean":"2024-04-26T07:51:39.400511+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:51:39.400511+0000","last_undegraded":"2024-04-26T07:51:39.400511+0000","last_fullsized":"2024-04-26T07:51:39.400511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378607+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:51:39.378607+0000","last_peered":"2024-04-26T07:51:39.378607+0000","last_clean":"2024-04-26T07:51:39.378607+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:51:39.378607+0000","last_undegraded":"2024-04-26T07:51:39.378607+0000","last_fullsized":"2024-04-26T07:51:39.378607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'19","reported_seq":170,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.393997+0000","last_change":"2024-04-26T07:51:39.393997+0000","last_active":"2024-04-26T07:51:39.393997+0000","last_peered":"2024-04-26T07:51:05.051057+0000","last_clean":"2024-04-26T07:51:05.051057+0000","last_became_active":"2024-04-26T07:50:53.959397+0000","last_became_peered":"2024-04-26T07:50:53.959397+0000","last_unstale":"2024-04-26T07:51:39.393997+0000","last_undegraded":"2024-04-26T07:51:39.393997+0000","last_fullsized":"2024-04-26T07:51:39.393997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396568+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:51:39.396568+0000","last_peered":"2024-04-26T07:51:39.396568+0000","last_clean":"2024-04-26T07:51:39.396568+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:51:39.396568+0000","last_undegraded":"2024-04-26T07:51:39.396568+0000","last_fullsized":"2024-04-26T07:51:39.396568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"89'23","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378269+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:39.378269+0000","last_peered":"2024-04-26T07:51:39.378269+0000","last_clean":"2024-04-26T07:51:39.378269+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:39.378269+0000","last_undegraded":"2024-04-26T07:51:39.378269+0000","last_fullsized":"2024-04-26T07:51:39.378269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392491+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:51:39.392491+0000","last_peered":"2024-04-26T07:51:39.392491+0000","last_clean":"2024-04-26T07:51:39.392491+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:51:39.392491+0000","last_undegraded":"2024-04-26T07:51:39.392491+0000","last_fullsized":"2024-04-26T07:51:39.392491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":229,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374683+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:51:39.374683+0000","last_peered":"2024-04-26T07:51:39.374683+0000","last_clean":"2024-04-26T07:51:39.374683+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:51:39.374683+0000","last_undegraded":"2024-04-26T07:51:39.374683+0000","last_fullsized":"2024-04-26T07:51:39.374683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'25","reported_seq":207,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.057005+0000","last_change":"2024-04-26T07:50:53.980391+0000","last_active":"2024-04-26T07:51:38.057005+0000","last_peered":"2024-04-26T07:51:38.057005+0000","last_clean":"2024-04-26T07:51:38.057005+0000","last_became_active":"2024-04-26T07:50:53.979506+0000","last_became_peered":"2024-04-26T07:50:53.979506+0000","last_unstale":"2024-04-26T07:51:38.057005+0000","last_undegraded":"2024-04-26T07:51:38.057005+0000","last_fullsized":"2024-04-26T07:51:38.057005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:35.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":207,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.358550+0000","last_change":"2024-04-26T07:50:53.969837+0000","last_active":"2024-04-26T07:51:38.358550+0000","last_peered":"2024-04-26T07:51:38.358550+0000","last_clean":"2024-04-26T07:51:38.358550+0000","last_became_active":"2024-04-26T07:50:53.968777+0000","last_became_peered":"2024-04-26T07:50:53.968777+0000","last_unstale":"2024-04-26T07:51:38.358550+0000","last_undegraded":"2024-04-26T07:51:38.358550+0000","last_fullsized":"2024-04-26T07:51:38.358550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:12.769798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"89'31","reported_seq":222,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408337+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:51:39.408337+0000","last_peered":"2024-04-26T07:51:39.408337+0000","last_clean":"2024-04-26T07:51:39.408337+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:51:39.408337+0000","last_undegraded":"2024-04-26T07:51:39.408337+0000","last_fullsized":"2024-04-26T07:51:39.408337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":41,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400939+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:51:39.400939+0000","last_peered":"2024-04-26T07:51:39.400939+0000","last_clean":"2024-04-26T07:51:39.400939+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:51:39.400939+0000","last_undegraded":"2024-04-26T07:51:39.400939+0000","last_fullsized":"2024-04-26T07:51:39.400939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412523+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:51:39.412523+0000","last_peered":"2024-04-26T07:51:39.412523+0000","last_clean":"2024-04-26T07:51:39.412523+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:51:39.412523+0000","last_undegraded":"2024-04-26T07:51:39.412523+0000","last_fullsized":"2024-04-26T07:51:39.412523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":226,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386774+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:51:39.386774+0000","last_peered":"2024-04-26T07:51:39.386774+0000","last_clean":"2024-04-26T07:51:39.386774+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:51:39.386774+0000","last_undegraded":"2024-04-26T07:51:39.386774+0000","last_fullsized":"2024-04-26T07:51:39.386774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'24","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377431+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:39.377431+0000","last_peered":"2024-04-26T07:51:39.377431+0000","last_clean":"2024-04-26T07:51:39.377431+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:39.377431+0000","last_undegraded":"2024-04-26T07:51:39.377431+0000","last_fullsized":"2024-04-26T07:51:39.377431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387284+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:51:39.387284+0000","last_peered":"2024-04-26T07:51:39.387284+0000","last_clean":"2024-04-26T07:51:39.387284+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:51:39.387284+0000","last_undegraded":"2024-04-26T07:51:39.387284+0000","last_fullsized":"2024-04-26T07:51:39.387284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380785+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:39.380785+0000","last_peered":"2024-04-26T07:51:39.380785+0000","last_clean":"2024-04-26T07:51:39.380785+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:39.380785+0000","last_undegraded":"2024-04-26T07:51:39.380785+0000","last_fullsized":"2024-04-26T07:51:39.380785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378704+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:51:39.378704+0000","last_peered":"2024-04-26T07:51:39.378704+0000","last_clean":"2024-04-26T07:51:39.378704+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:51:39.378704+0000","last_undegraded":"2024-04-26T07:51:39.378704+0000","last_fullsized":"2024-04-26T07:51:39.378704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"90'24","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390410+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:39.390410+0000","last_peered":"2024-04-26T07:51:39.390410+0000","last_clean":"2024-04-26T07:51:39.390410+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:39.390410+0000","last_undegraded":"2024-04-26T07:51:39.390410+0000","last_fullsized":"2024-04-26T07:51:39.390410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374135+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:39.374135+0000","last_peered":"2024-04-26T07:51:39.374135+0000","last_clean":"2024-04-26T07:51:39.374135+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:39.374135+0000","last_undegraded":"2024-04-26T07:51:39.374135+0000","last_fullsized":"2024-04-26T07:51:39.374135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383068+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:39.383068+0000","last_peered":"2024-04-26T07:51:39.383068+0000","last_clean":"2024-04-26T07:51:39.383068+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:39.383068+0000","last_undegraded":"2024-04-26T07:51:39.383068+0000","last_fullsized":"2024-04-26T07:51:39.383068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'19","reported_seq":152,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386665+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:39.386665+0000","last_peered":"2024-04-26T07:51:39.386665+0000","last_clean":"2024-04-26T07:51:39.386665+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:39.386665+0000","last_undegraded":"2024-04-26T07:51:39.386665+0000","last_fullsized":"2024-04-26T07:51:39.386665+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:08.704021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396771+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:39.396771+0000","last_peered":"2024-04-26T07:51:39.396771+0000","last_clean":"2024-04-26T07:51:39.396771+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:39.396771+0000","last_undegraded":"2024-04-26T07:51:39.396771+0000","last_fullsized":"2024-04-26T07:51:39.396771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"90'17","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392064+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:39.392064+0000","last_peered":"2024-04-26T07:51:39.392064+0000","last_clean":"2024-04-26T07:51:39.392064+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:39.392064+0000","last_undegraded":"2024-04-26T07:51:39.392064+0000","last_fullsized":"2024-04-26T07:51:39.392064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":124,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.403124+0000","last_change":"2024-04-26T07:50:52.956904+0000","last_active":"2024-04-26T07:48:28.544638+0000","last_peered":"2024-04-26T07:48:28.544638+0000","last_clean":"2024-04-26T07:48:28.544638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.403124+0000","last_undegraded":"2024-04-26T07:51:39.403124+0000","last_fullsized":"2024-04-26T07:51:39.403124+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":240,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401254+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:39.401254+0000","last_peered":"2024-04-26T07:51:39.401254+0000","last_clean":"2024-04-26T07:51:39.401254+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:39.401254+0000","last_undegraded":"2024-04-26T07:51:39.401254+0000","last_fullsized":"2024-04-26T07:51:39.401254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.399848+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:51:39.399848+0000","last_peered":"2024-04-26T07:51:39.399848+0000","last_clean":"2024-04-26T07:51:39.399848+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:51:39.399848+0000","last_undegraded":"2024-04-26T07:51:39.399848+0000","last_fullsized":"2024-04-26T07:51:39.399848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'20","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390597+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:39.390597+0000","last_peered":"2024-04-26T07:51:39.390597+0000","last_clean":"2024-04-26T07:51:39.390597+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:39.390597+0000","last_undegraded":"2024-04-26T07:51:39.390597+0000","last_fullsized":"2024-04-26T07:51:39.390597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382864+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:39.382864+0000","last_peered":"2024-04-26T07:51:39.382864+0000","last_clean":"2024-04-26T07:51:39.382864+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:39.382864+0000","last_undegraded":"2024-04-26T07:51:39.382864+0000","last_fullsized":"2024-04-26T07:51:39.382864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"53'7","reported_seq":188,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381805+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:51:39.381805+0000","last_peered":"2024-04-26T07:51:39.381805+0000","last_clean":"2024-04-26T07:51:39.381805+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:51:39.381805+0000","last_undegraded":"2024-04-26T07:51:39.381805+0000","last_fullsized":"2024-04-26T07:51:39.381805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378856+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:39.378856+0000","last_peered":"2024-04-26T07:51:39.378856+0000","last_clean":"2024-04-26T07:51:39.378856+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:39.378856+0000","last_undegraded":"2024-04-26T07:51:39.378856+0000","last_fullsized":"2024-04-26T07:51:39.378856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389866+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:51:39.389866+0000","last_peered":"2024-04-26T07:51:39.389866+0000","last_clean":"2024-04-26T07:51:39.389866+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:51:39.389866+0000","last_undegraded":"2024-04-26T07:51:39.389866+0000","last_fullsized":"2024-04-26T07:51:39.389866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394120+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:51:39.394120+0000","last_peered":"2024-04-26T07:51:39.394120+0000","last_clean":"2024-04-26T07:51:39.394120+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:51:39.394120+0000","last_undegraded":"2024-04-26T07:51:39.394120+0000","last_fullsized":"2024-04-26T07:51:39.394120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'22","reported_seq":207,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.362701+0000","last_change":"2024-04-26T07:50:53.967597+0000","last_active":"2024-04-26T07:51:38.362701+0000","last_peered":"2024-04-26T07:51:38.362701+0000","last_clean":"2024-04-26T07:51:38.362701+0000","last_became_active":"2024-04-26T07:50:53.966791+0000","last_became_peered":"2024-04-26T07:50:53.966791+0000","last_unstale":"2024-04-26T07:51:38.362701+0000","last_undegraded":"2024-04-26T07:51:38.362701+0000","last_fullsized":"2024-04-26T07:51:38.362701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:26.519461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384379+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:39.384379+0000","last_peered":"2024-04-26T07:51:39.384379+0000","last_clean":"2024-04-26T07:51:39.384379+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:39.384379+0000","last_undegraded":"2024-04-26T07:51:39.384379+0000","last_fullsized":"2024-04-26T07:51:39.384379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386471+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:51:39.386471+0000","last_peered":"2024-04-26T07:51:39.386471+0000","last_clean":"2024-04-26T07:51:39.386471+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:51:39.386471+0000","last_undegraded":"2024-04-26T07:51:39.386471+0000","last_fullsized":"2024-04-26T07:51:39.386471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'135","reported_seq":300,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.391475+0000","last_change":"2024-04-26T07:51:39.391475+0000","last_active":"2024-04-26T07:51:39.391475+0000","last_peered":"2024-04-26T07:51:08.340110+0000","last_clean":"2024-04-26T07:51:08.340110+0000","last_became_active":"2024-04-26T07:50:53.968380+0000","last_became_peered":"2024-04-26T07:50:53.968380+0000","last_unstale":"2024-04-26T07:51:39.391475+0000","last_undegraded":"2024-04-26T07:51:39.391475+0000","last_fullsized":"2024-04-26T07:51:39.391475+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374803+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:39.374803+0000","last_peered":"2024-04-26T07:51:39.374803+0000","last_clean":"2024-04-26T07:51:39.374803+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:39.374803+0000","last_undegraded":"2024-04-26T07:51:39.374803+0000","last_fullsized":"2024-04-26T07:51:39.374803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384036+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:51:39.384036+0000","last_peered":"2024-04-26T07:51:39.384036+0000","last_clean":"2024-04-26T07:51:39.384036+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:51:39.384036+0000","last_undegraded":"2024-04-26T07:51:39.384036+0000","last_fullsized":"2024-04-26T07:51:39.384036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'17","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406890+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:51:39.406890+0000","last_peered":"2024-04-26T07:51:39.406890+0000","last_clean":"2024-04-26T07:51:39.406890+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:51:39.406890+0000","last_undegraded":"2024-04-26T07:51:39.406890+0000","last_fullsized":"2024-04-26T07:51:39.406890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396314+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:39.396314+0000","last_peered":"2024-04-26T07:51:39.396314+0000","last_clean":"2024-04-26T07:51:39.396314+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:39.396314+0000","last_undegraded":"2024-04-26T07:51:39.396314+0000","last_fullsized":"2024-04-26T07:51:39.396314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"90'17","reported_seq":151,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.401950+0000","last_change":"2024-04-26T07:51:39.401950+0000","last_active":"2024-04-26T07:51:39.401950+0000","last_peered":"2024-04-26T07:50:49.905105+0000","last_clean":"2024-04-26T07:50:49.905105+0000","last_became_active":"2024-04-26T07:48:27.655900+0000","last_became_peered":"2024-04-26T07:48:27.655900+0000","last_unstale":"2024-04-26T07:51:39.401950+0000","last_undegraded":"2024-04-26T07:51:39.401950+0000","last_fullsized":"2024-04-26T07:51:39.401950+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'134","reported_seq":347,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382488+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:51:39.382488+0000","last_peered":"2024-04-26T07:51:39.382488+0000","last_clean":"2024-04-26T07:51:39.382488+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:51:39.382488+0000","last_undegraded":"2024-04-26T07:51:39.382488+0000","last_fullsized":"2024-04-26T07:51:39.382488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":185,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405821+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:51:39.405821+0000","last_peered":"2024-04-26T07:51:39.405821+0000","last_clean":"2024-04-26T07:51:39.405821+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:51:39.405821+0000","last_undegraded":"2024-04-26T07:51:39.405821+0000","last_fullsized":"2024-04-26T07:51:39.405821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'27","reported_seq":213,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.362818+0000","last_change":"2024-04-26T07:50:53.967800+0000","last_active":"2024-04-26T07:51:38.362818+0000","last_peered":"2024-04-26T07:51:38.362818+0000","last_clean":"2024-04-26T07:51:38.362818+0000","last_became_active":"2024-04-26T07:50:53.966844+0000","last_became_peered":"2024-04-26T07:50:53.966844+0000","last_unstale":"2024-04-26T07:51:38.362818+0000","last_undegraded":"2024-04-26T07:51:38.362818+0000","last_fullsized":"2024-04-26T07:51:38.362818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:35.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.555154+0000","last_change":"2024-04-26T07:50:53.972931+0000","last_active":"2024-04-26T07:51:38.555154+0000","last_peered":"2024-04-26T07:51:38.555154+0000","last_clean":"2024-04-26T07:51:38.555154+0000","last_became_active":"2024-04-26T07:50:53.972133+0000","last_became_peered":"2024-04-26T07:50:53.972133+0000","last_unstale":"2024-04-26T07:51:38.555154+0000","last_undegraded":"2024-04-26T07:51:38.555154+0000","last_fullsized":"2024-04-26T07:51:38.555154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:14.805996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"90'27","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397583+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:51:39.397583+0000","last_peered":"2024-04-26T07:51:39.397583+0000","last_clean":"2024-04-26T07:51:39.397583+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:51:39.397583+0000","last_undegraded":"2024-04-26T07:51:39.397583+0000","last_fullsized":"2024-04-26T07:51:39.397583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372502+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:39.372502+0000","last_peered":"2024-04-26T07:51:39.372502+0000","last_clean":"2024-04-26T07:51:39.372502+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:39.372502+0000","last_undegraded":"2024-04-26T07:51:39.372502+0000","last_fullsized":"2024-04-26T07:51:39.372502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":179,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400253+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:39.400253+0000","last_peered":"2024-04-26T07:51:39.400253+0000","last_clean":"2024-04-26T07:51:39.400253+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:39.400253+0000","last_undegraded":"2024-04-26T07:51:39.400253+0000","last_fullsized":"2024-04-26T07:51:39.400253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374859+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:51:39.374859+0000","last_peered":"2024-04-26T07:51:39.374859+0000","last_clean":"2024-04-26T07:51:39.374859+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:51:39.374859+0000","last_undegraded":"2024-04-26T07:51:39.374859+0000","last_fullsized":"2024-04-26T07:51:39.374859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'24","reported_seq":210,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.363319+0000","last_change":"2024-04-26T07:50:53.953128+0000","last_active":"2024-04-26T07:51:38.363319+0000","last_peered":"2024-04-26T07:51:38.363319+0000","last_clean":"2024-04-26T07:51:38.363319+0000","last_became_active":"2024-04-26T07:50:53.952170+0000","last_became_peered":"2024-04-26T07:50:53.952170+0000","last_unstale":"2024-04-26T07:51:38.363319+0000","last_undegraded":"2024-04-26T07:51:38.363319+0000","last_fullsized":"2024-04-26T07:51:38.363319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:06.181214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385816+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:51:39.385816+0000","last_peered":"2024-04-26T07:51:39.385816+0000","last_clean":"2024-04-26T07:51:39.385816+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:51:39.385816+0000","last_undegraded":"2024-04-26T07:51:39.385816+0000","last_fullsized":"2024-04-26T07:51:39.385816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"90'17","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381410+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:51:39.381410+0000","last_peered":"2024-04-26T07:51:39.381410+0000","last_clean":"2024-04-26T07:51:39.381410+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:51:39.381410+0000","last_undegraded":"2024-04-26T07:51:39.381410+0000","last_fullsized":"2024-04-26T07:51:39.381410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379438+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:51:39.379438+0000","last_peered":"2024-04-26T07:51:39.379438+0000","last_clean":"2024-04-26T07:51:39.379438+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:51:39.379438+0000","last_undegraded":"2024-04-26T07:51:39.379438+0000","last_fullsized":"2024-04-26T07:51:39.379438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412119+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:39.412119+0000","last_peered":"2024-04-26T07:51:39.412119+0000","last_clean":"2024-04-26T07:51:39.412119+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:39.412119+0000","last_undegraded":"2024-04-26T07:51:39.412119+0000","last_fullsized":"2024-04-26T07:51:39.412119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407707+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:51:39.407707+0000","last_peered":"2024-04-26T07:51:39.407707+0000","last_clean":"2024-04-26T07:51:39.407707+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:51:39.407707+0000","last_undegraded":"2024-04-26T07:51:39.407707+0000","last_fullsized":"2024-04-26T07:51:39.407707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"89'25","reported_seq":208,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.056706+0000","last_change":"2024-04-26T07:50:53.981815+0000","last_active":"2024-04-26T07:51:38.056706+0000","last_peered":"2024-04-26T07:51:38.056706+0000","last_clean":"2024-04-26T07:51:38.056706+0000","last_became_active":"2024-04-26T07:50:53.981054+0000","last_became_peered":"2024-04-26T07:50:53.981054+0000","last_unstale":"2024-04-26T07:51:38.056706+0000","last_undegraded":"2024-04-26T07:51:38.056706+0000","last_fullsized":"2024-04-26T07:51:38.056706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:50.801176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.388088+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:51:39.388088+0000","last_peered":"2024-04-26T07:51:39.388088+0000","last_clean":"2024-04-26T07:51:39.388088+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:51:39.388088+0000","last_undegraded":"2024-04-26T07:51:39.388088+0000","last_fullsized":"2024-04-26T07:51:39.388088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"90'25","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.096867+0000","last_change":"2024-04-26T07:50:53.960437+0000","last_active":"2024-04-26T07:51:38.096867+0000","last_peered":"2024-04-26T07:51:38.096867+0000","last_clean":"2024-04-26T07:51:38.096867+0000","last_became_active":"2024-04-26T07:50:53.960163+0000","last_became_peered":"2024-04-26T07:50:53.960163+0000","last_unstale":"2024-04-26T07:51:38.096867+0000","last_undegraded":"2024-04-26T07:51:38.096867+0000","last_fullsized":"2024-04-26T07:51:38.096867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:09.908067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62803,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"90'134","reported_seq":345,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390378+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:51:39.390378+0000","last_peered":"2024-04-26T07:51:39.390378+0000","last_clean":"2024-04-26T07:51:39.390378+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:51:39.390378+0000","last_undegraded":"2024-04-26T07:51:39.390378+0000","last_fullsized":"2024-04-26T07:51:39.390378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392267+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:39.392267+0000","last_peered":"2024-04-26T07:51:39.392267+0000","last_clean":"2024-04-26T07:51:39.392267+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:39.392267+0000","last_undegraded":"2024-04-26T07:51:39.392267+0000","last_fullsized":"2024-04-26T07:51:39.392267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393052+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:39.393052+0000","last_peered":"2024-04-26T07:51:39.393052+0000","last_clean":"2024-04-26T07:51:39.393052+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:39.393052+0000","last_undegraded":"2024-04-26T07:51:39.393052+0000","last_fullsized":"2024-04-26T07:51:39.393052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401067+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:39.401067+0000","last_peered":"2024-04-26T07:51:39.401067+0000","last_clean":"2024-04-26T07:51:39.401067+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:39.401067+0000","last_undegraded":"2024-04-26T07:51:39.401067+0000","last_fullsized":"2024-04-26T07:51:39.401067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386484+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:51:39.386484+0000","last_peered":"2024-04-26T07:51:39.386484+0000","last_clean":"2024-04-26T07:51:39.386484+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:51:39.386484+0000","last_undegraded":"2024-04-26T07:51:39.386484+0000","last_fullsized":"2024-04-26T07:51:39.386484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'29","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391232+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:39.391232+0000","last_peered":"2024-04-26T07:51:39.391232+0000","last_clean":"2024-04-26T07:51:39.391232+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:39.391232+0000","last_undegraded":"2024-04-26T07:51:39.391232+0000","last_fullsized":"2024-04-26T07:51:39.391232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385638+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:51:39.385638+0000","last_peered":"2024-04-26T07:51:39.385638+0000","last_clean":"2024-04-26T07:51:39.385638+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:51:39.385638+0000","last_undegraded":"2024-04-26T07:51:39.385638+0000","last_fullsized":"2024-04-26T07:51:39.385638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":198,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373961+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:39.373961+0000","last_peered":"2024-04-26T07:51:39.373961+0000","last_clean":"2024-04-26T07:51:39.373961+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:39.373961+0000","last_undegraded":"2024-04-26T07:51:39.373961+0000","last_fullsized":"2024-04-26T07:51:39.373961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":240,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377873+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:39.377873+0000","last_peered":"2024-04-26T07:51:39.377873+0000","last_clean":"2024-04-26T07:51:39.377873+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:39.377873+0000","last_undegraded":"2024-04-26T07:51:39.377873+0000","last_fullsized":"2024-04-26T07:51:39.377873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380416+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:39.380416+0000","last_peered":"2024-04-26T07:51:39.380416+0000","last_clean":"2024-04-26T07:51:39.380416+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:39.380416+0000","last_undegraded":"2024-04-26T07:51:39.380416+0000","last_fullsized":"2024-04-26T07:51:39.380416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387388+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:51:39.387388+0000","last_peered":"2024-04-26T07:51:39.387388+0000","last_clean":"2024-04-26T07:51:39.387388+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:51:39.387388+0000","last_undegraded":"2024-04-26T07:51:39.387388+0000","last_fullsized":"2024-04-26T07:51:39.387388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"90'20","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379225+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:51:39.379225+0000","last_peered":"2024-04-26T07:51:39.379225+0000","last_clean":"2024-04-26T07:51:39.379225+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:51:39.379225+0000","last_undegraded":"2024-04-26T07:51:39.379225+0000","last_fullsized":"2024-04-26T07:51:39.379225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393340+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:51:39.393340+0000","last_peered":"2024-04-26T07:51:39.393340+0000","last_clean":"2024-04-26T07:51:39.393340+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:51:39.393340+0000","last_undegraded":"2024-04-26T07:51:39.393340+0000","last_fullsized":"2024-04-26T07:51:39.393340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377539+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:39.377539+0000","last_peered":"2024-04-26T07:51:39.377539+0000","last_clean":"2024-04-26T07:51:39.377539+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:39.377539+0000","last_undegraded":"2024-04-26T07:51:39.377539+0000","last_fullsized":"2024-04-26T07:51:39.377539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379014+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:39.379014+0000","last_peered":"2024-04-26T07:51:39.379014+0000","last_clean":"2024-04-26T07:51:39.379014+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:39.379014+0000","last_undegraded":"2024-04-26T07:51:39.379014+0000","last_fullsized":"2024-04-26T07:51:39.379014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'25","reported_seq":215,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407929+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:51:39.407929+0000","last_peered":"2024-04-26T07:51:39.407929+0000","last_clean":"2024-04-26T07:51:39.407929+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:51:39.407929+0000","last_undegraded":"2024-04-26T07:51:39.407929+0000","last_fullsized":"2024-04-26T07:51:39.407929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371914+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:51:39.371914+0000","last_peered":"2024-04-26T07:51:39.371914+0000","last_clean":"2024-04-26T07:51:39.371914+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:51:39.371914+0000","last_undegraded":"2024-04-26T07:51:39.371914+0000","last_fullsized":"2024-04-26T07:51:39.371914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"90'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392335+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:51:39.392335+0000","last_peered":"2024-04-26T07:51:39.392335+0000","last_clean":"2024-04-26T07:51:39.392335+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:51:39.392335+0000","last_undegraded":"2024-04-26T07:51:39.392335+0000","last_fullsized":"2024-04-26T07:51:39.392335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'134","reported_seq":362,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391679+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:51:39.391679+0000","last_peered":"2024-04-26T07:51:39.391679+0000","last_clean":"2024-04-26T07:51:39.391679+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:51:39.391679+0000","last_undegraded":"2024-04-26T07:51:39.391679+0000","last_fullsized":"2024-04-26T07:51:39.391679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371623+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:39.371623+0000","last_peered":"2024-04-26T07:51:39.371623+0000","last_clean":"2024-04-26T07:51:39.371623+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:39.371623+0000","last_undegraded":"2024-04-26T07:51:39.371623+0000","last_fullsized":"2024-04-26T07:51:39.371623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379771+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:51:39.379771+0000","last_peered":"2024-04-26T07:51:39.379771+0000","last_clean":"2024-04-26T07:51:39.379771+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:51:39.379771+0000","last_undegraded":"2024-04-26T07:51:39.379771+0000","last_fullsized":"2024-04-26T07:51:39.379771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"89'30","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377863+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:39.377863+0000","last_peered":"2024-04-26T07:51:39.377863+0000","last_clean":"2024-04-26T07:51:39.377863+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:39.377863+0000","last_undegraded":"2024-04-26T07:51:39.377863+0000","last_fullsized":"2024-04-26T07:51:39.377863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":361,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401426+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:51:39.401426+0000","last_peered":"2024-04-26T07:51:39.401426+0000","last_clean":"2024-04-26T07:51:39.401426+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:51:39.401426+0000","last_undegraded":"2024-04-26T07:51:39.401426+0000","last_fullsized":"2024-04-26T07:51:39.401426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382757+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:51:39.382757+0000","last_peered":"2024-04-26T07:51:39.382757+0000","last_clean":"2024-04-26T07:51:39.382757+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:51:39.382757+0000","last_undegraded":"2024-04-26T07:51:39.382757+0000","last_fullsized":"2024-04-26T07:51:39.382757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'134","reported_seq":397,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412379+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:39.412379+0000","last_peered":"2024-04-26T07:51:39.412379+0000","last_clean":"2024-04-26T07:51:39.412379+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:39.412379+0000","last_undegraded":"2024-04-26T07:51:39.412379+0000","last_fullsized":"2024-04-26T07:51:39.412379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":176,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375424+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:39.375424+0000","last_peered":"2024-04-26T07:51:39.375424+0000","last_clean":"2024-04-26T07:51:39.375424+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:39.375424+0000","last_undegraded":"2024-04-26T07:51:39.375424+0000","last_fullsized":"2024-04-26T07:51:39.375424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":163,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384155+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:39.384155+0000","last_peered":"2024-04-26T07:51:39.384155+0000","last_clean":"2024-04-26T07:51:39.384155+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:39.384155+0000","last_undegraded":"2024-04-26T07:51:39.384155+0000","last_fullsized":"2024-04-26T07:51:39.384155+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378411+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:39.378411+0000","last_peered":"2024-04-26T07:51:39.378411+0000","last_clean":"2024-04-26T07:51:39.378411+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:39.378411+0000","last_undegraded":"2024-04-26T07:51:39.378411+0000","last_fullsized":"2024-04-26T07:51:39.378411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379506+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:51:39.379506+0000","last_peered":"2024-04-26T07:51:39.379506+0000","last_clean":"2024-04-26T07:51:39.379506+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:51:39.379506+0000","last_undegraded":"2024-04-26T07:51:39.379506+0000","last_fullsized":"2024-04-26T07:51:39.379506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"90'26","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396517+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:51:39.396517+0000","last_peered":"2024-04-26T07:51:39.396517+0000","last_clean":"2024-04-26T07:51:39.396517+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:51:39.396517+0000","last_undegraded":"2024-04-26T07:51:39.396517+0000","last_fullsized":"2024-04-26T07:51:39.396517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407447+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:39.407447+0000","last_peered":"2024-04-26T07:51:39.407447+0000","last_clean":"2024-04-26T07:51:39.407447+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:39.407447+0000","last_undegraded":"2024-04-26T07:51:39.407447+0000","last_fullsized":"2024-04-26T07:51:39.407447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372350+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:39.372350+0000","last_peered":"2024-04-26T07:51:39.372350+0000","last_clean":"2024-04-26T07:51:39.372350+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:39.372350+0000","last_undegraded":"2024-04-26T07:51:39.372350+0000","last_fullsized":"2024-04-26T07:51:39.372350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412425+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:51:39.412425+0000","last_peered":"2024-04-26T07:51:39.412425+0000","last_clean":"2024-04-26T07:51:39.412425+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:51:39.412425+0000","last_undegraded":"2024-04-26T07:51:39.412425+0000","last_fullsized":"2024-04-26T07:51:39.412425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.185797+0000","last_change":"2024-04-26T07:50:53.965294+0000","last_active":"2024-04-26T07:51:38.185797+0000","last_peered":"2024-04-26T07:51:38.185797+0000","last_clean":"2024-04-26T07:51:38.185797+0000","last_became_active":"2024-04-26T07:50:53.964427+0000","last_became_peered":"2024-04-26T07:50:53.964427+0000","last_unstale":"2024-04-26T07:51:38.185797+0000","last_undegraded":"2024-04-26T07:51:38.185797+0000","last_fullsized":"2024-04-26T07:51:38.185797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:24.027532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397877+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:39.397877+0000","last_peered":"2024-04-26T07:51:39.397877+0000","last_clean":"2024-04-26T07:51:39.397877+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:39.397877+0000","last_undegraded":"2024-04-26T07:51:39.397877+0000","last_fullsized":"2024-04-26T07:51:39.397877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380033+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:39.380033+0000","last_peered":"2024-04-26T07:51:39.380033+0000","last_clean":"2024-04-26T07:51:39.380033+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:39.380033+0000","last_undegraded":"2024-04-26T07:51:39.380033+0000","last_fullsized":"2024-04-26T07:51:39.380033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":53,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.098260+0000","last_change":"2024-04-26T07:50:53.963193+0000","last_active":"2024-04-26T07:51:38.098260+0000","last_peered":"2024-04-26T07:51:38.098260+0000","last_clean":"2024-04-26T07:51:38.098260+0000","last_became_active":"2024-04-26T07:50:53.962624+0000","last_became_peered":"2024-04-26T07:50:53.962624+0000","last_unstale":"2024-04-26T07:51:38.098260+0000","last_undegraded":"2024-04-26T07:51:38.098260+0000","last_fullsized":"2024-04-26T07:51:38.098260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:34.031661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"90'39","reported_seq":230,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401761+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:51:39.401761+0000","last_peered":"2024-04-26T07:51:39.401761+0000","last_clean":"2024-04-26T07:51:39.401761+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:51:39.401761+0000","last_undegraded":"2024-04-26T07:51:39.401761+0000","last_fullsized":"2024-04-26T07:51:39.401761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392535+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:51:39.392535+0000","last_peered":"2024-04-26T07:51:39.392535+0000","last_clean":"2024-04-26T07:51:39.392535+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:51:39.392535+0000","last_undegraded":"2024-04-26T07:51:39.392535+0000","last_fullsized":"2024-04-26T07:51:39.392535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406290+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:39.406290+0000","last_peered":"2024-04-26T07:51:39.406290+0000","last_clean":"2024-04-26T07:51:39.406290+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:39.406290+0000","last_undegraded":"2024-04-26T07:51:39.406290+0000","last_fullsized":"2024-04-26T07:51:39.406290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":229,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393641+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:51:39.393641+0000","last_peered":"2024-04-26T07:51:39.393641+0000","last_clean":"2024-04-26T07:51:39.393641+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:51:39.393641+0000","last_undegraded":"2024-04-26T07:51:39.393641+0000","last_fullsized":"2024-04-26T07:51:39.393641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.357609+0000","last_change":"2024-04-26T07:50:53.968724+0000","last_active":"2024-04-26T07:51:38.357609+0000","last_peered":"2024-04-26T07:51:38.357609+0000","last_clean":"2024-04-26T07:51:38.357609+0000","last_became_active":"2024-04-26T07:50:53.968282+0000","last_became_peered":"2024-04-26T07:50:53.968282+0000","last_unstale":"2024-04-26T07:51:38.357609+0000","last_undegraded":"2024-04-26T07:51:38.357609+0000","last_fullsized":"2024-04-26T07:51:38.357609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:32.175509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"89'20","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391341+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:39.391341+0000","last_peered":"2024-04-26T07:51:39.391341+0000","last_clean":"2024-04-26T07:51:39.391341+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:39.391341+0000","last_undegraded":"2024-04-26T07:51:39.391341+0000","last_fullsized":"2024-04-26T07:51:39.391341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.402965+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:39.402965+0000","last_peered":"2024-04-26T07:51:39.402965+0000","last_clean":"2024-04-26T07:51:39.402965+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:39.402965+0000","last_undegraded":"2024-04-26T07:51:39.402965+0000","last_fullsized":"2024-04-26T07:51:39.402965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'137","reported_seq":415,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371759+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:51:39.371759+0000","last_peered":"2024-04-26T07:51:39.371759+0000","last_clean":"2024-04-26T07:51:39.371759+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:51:39.371759+0000","last_undegraded":"2024-04-26T07:51:39.371759+0000","last_fullsized":"2024-04-26T07:51:39.371759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":54,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.098156+0000","last_change":"2024-04-26T07:50:53.962915+0000","last_active":"2024-04-26T07:51:38.098156+0000","last_peered":"2024-04-26T07:51:38.098156+0000","last_clean":"2024-04-26T07:51:38.098156+0000","last_became_active":"2024-04-26T07:50:53.962553+0000","last_became_peered":"2024-04-26T07:50:53.962553+0000","last_unstale":"2024-04-26T07:51:38.098156+0000","last_undegraded":"2024-04-26T07:51:38.098156+0000","last_fullsized":"2024-04-26T07:51:38.098156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:24.357622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370516+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:39.370516+0000","last_peered":"2024-04-26T07:51:39.370516+0000","last_clean":"2024-04-26T07:51:39.370516+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:39.370516+0000","last_undegraded":"2024-04-26T07:51:39.370516+0000","last_fullsized":"2024-04-26T07:51:39.370516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374300+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:51:39.374300+0000","last_peered":"2024-04-26T07:51:39.374300+0000","last_clean":"2024-04-26T07:51:39.374300+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:51:39.374300+0000","last_undegraded":"2024-04-26T07:51:39.374300+0000","last_fullsized":"2024-04-26T07:51:39.374300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385985+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:51:39.385985+0000","last_peered":"2024-04-26T07:51:39.385985+0000","last_clean":"2024-04-26T07:51:39.385985+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:51:39.385985+0000","last_undegraded":"2024-04-26T07:51:39.385985+0000","last_fullsized":"2024-04-26T07:51:39.385985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'26","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370330+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:39.370330+0000","last_peered":"2024-04-26T07:51:39.370330+0000","last_clean":"2024-04-26T07:51:39.370330+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:39.370330+0000","last_undegraded":"2024-04-26T07:51:39.370330+0000","last_fullsized":"2024-04-26T07:51:39.370330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":184,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391902+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:51:39.391902+0000","last_peered":"2024-04-26T07:51:39.391902+0000","last_clean":"2024-04-26T07:51:39.391902+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:51:39.391902+0000","last_undegraded":"2024-04-26T07:51:39.391902+0000","last_fullsized":"2024-04-26T07:51:39.391902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"85'16","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.556506+0000","last_change":"2024-04-26T07:50:53.973436+0000","last_active":"2024-04-26T07:51:38.556506+0000","last_peered":"2024-04-26T07:51:38.556506+0000","last_clean":"2024-04-26T07:51:38.556506+0000","last_became_active":"2024-04-26T07:50:53.972444+0000","last_became_peered":"2024-04-26T07:50:53.972444+0000","last_unstale":"2024-04-26T07:51:38.556506+0000","last_undegraded":"2024-04-26T07:51:38.556506+0000","last_fullsized":"2024-04-26T07:51:38.556506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:34.553163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390613+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:51:39.390613+0000","last_peered":"2024-04-26T07:51:39.390613+0000","last_clean":"2024-04-26T07:51:39.390613+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:51:39.390613+0000","last_undegraded":"2024-04-26T07:51:39.390613+0000","last_fullsized":"2024-04-26T07:51:39.390613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381057+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:39.381057+0000","last_peered":"2024-04-26T07:51:39.381057+0000","last_clean":"2024-04-26T07:51:39.381057+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:39.381057+0000","last_undegraded":"2024-04-26T07:51:39.381057+0000","last_fullsized":"2024-04-26T07:51:39.381057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372050+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:51:39.372050+0000","last_peered":"2024-04-26T07:51:39.372050+0000","last_clean":"2024-04-26T07:51:39.372050+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:51:39.372050+0000","last_undegraded":"2024-04-26T07:51:39.372050+0000","last_fullsized":"2024-04-26T07:51:39.372050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401773+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:39.401773+0000","last_peered":"2024-04-26T07:51:39.401773+0000","last_clean":"2024-04-26T07:51:39.401773+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:39.401773+0000","last_undegraded":"2024-04-26T07:51:39.401773+0000","last_fullsized":"2024-04-26T07:51:39.401773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'20","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377573+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:39.377573+0000","last_peered":"2024-04-26T07:51:39.377573+0000","last_clean":"2024-04-26T07:51:39.377573+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:39.377573+0000","last_undegraded":"2024-04-26T07:51:39.377573+0000","last_fullsized":"2024-04-26T07:51:39.377573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389554+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:51:39.389554+0000","last_peered":"2024-04-26T07:51:39.389554+0000","last_clean":"2024-04-26T07:51:39.389554+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:51:39.389554+0000","last_undegraded":"2024-04-26T07:51:39.389554+0000","last_fullsized":"2024-04-26T07:51:39.389554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384109+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:39.384109+0000","last_peered":"2024-04-26T07:51:39.384109+0000","last_clean":"2024-04-26T07:51:39.384109+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:39.384109+0000","last_undegraded":"2024-04-26T07:51:39.384109+0000","last_fullsized":"2024-04-26T07:51:39.384109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412874+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:39.412874+0000","last_peered":"2024-04-26T07:51:39.412874+0000","last_clean":"2024-04-26T07:51:39.412874+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:39.412874+0000","last_undegraded":"2024-04-26T07:51:39.412874+0000","last_fullsized":"2024-04-26T07:51:39.412874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405058+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:39.405058+0000","last_peered":"2024-04-26T07:51:39.405058+0000","last_clean":"2024-04-26T07:51:39.405058+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:39.405058+0000","last_undegraded":"2024-04-26T07:51:39.405058+0000","last_fullsized":"2024-04-26T07:51:39.405058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371172+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:51:39.371172+0000","last_peered":"2024-04-26T07:51:39.371172+0000","last_clean":"2024-04-26T07:51:39.371172+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:51:39.371172+0000","last_undegraded":"2024-04-26T07:51:39.371172+0000","last_fullsized":"2024-04-26T07:51:39.371172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"88'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400610+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:39.400610+0000","last_peered":"2024-04-26T07:51:39.400610+0000","last_clean":"2024-04-26T07:51:39.400610+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:39.400610+0000","last_undegraded":"2024-04-26T07:51:39.400610+0000","last_fullsized":"2024-04-26T07:51:39.400610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372282+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:51:39.372282+0000","last_peered":"2024-04-26T07:51:39.372282+0000","last_clean":"2024-04-26T07:51:39.372282+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:51:39.372282+0000","last_undegraded":"2024-04-26T07:51:39.372282+0000","last_fullsized":"2024-04-26T07:51:39.372282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392473+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:51:39.392473+0000","last_peered":"2024-04-26T07:51:39.392473+0000","last_clean":"2024-04-26T07:51:39.392473+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:51:39.392473+0000","last_undegraded":"2024-04-26T07:51:39.392473+0000","last_fullsized":"2024-04-26T07:51:39.392473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"90'35","reported_seq":226,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389945+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:51:39.389945+0000","last_peered":"2024-04-26T07:51:39.389945+0000","last_clean":"2024-04-26T07:51:39.389945+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:51:39.389945+0000","last_undegraded":"2024-04-26T07:51:39.389945+0000","last_fullsized":"2024-04-26T07:51:39.389945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374284+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:39.374284+0000","last_peered":"2024-04-26T07:51:39.374284+0000","last_clean":"2024-04-26T07:51:39.374284+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:39.374284+0000","last_undegraded":"2024-04-26T07:51:39.374284+0000","last_fullsized":"2024-04-26T07:51:39.374284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389492+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:39.389492+0000","last_peered":"2024-04-26T07:51:39.389492+0000","last_clean":"2024-04-26T07:51:39.389492+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:39.389492+0000","last_undegraded":"2024-04-26T07:51:39.389492+0000","last_fullsized":"2024-04-26T07:51:39.389492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393090+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:51:39.393090+0000","last_peered":"2024-04-26T07:51:39.393090+0000","last_clean":"2024-04-26T07:51:39.393090+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:51:39.393090+0000","last_undegraded":"2024-04-26T07:51:39.393090+0000","last_fullsized":"2024-04-26T07:51:39.393090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372167+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:51:39.372167+0000","last_peered":"2024-04-26T07:51:39.372167+0000","last_clean":"2024-04-26T07:51:39.372167+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:51:39.372167+0000","last_undegraded":"2024-04-26T07:51:39.372167+0000","last_fullsized":"2024-04-26T07:51:39.372167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.186748+0000","last_change":"2024-04-26T07:50:53.967883+0000","last_active":"2024-04-26T07:51:38.186748+0000","last_peered":"2024-04-26T07:51:38.186748+0000","last_clean":"2024-04-26T07:51:38.186748+0000","last_became_active":"2024-04-26T07:50:53.967473+0000","last_became_peered":"2024-04-26T07:50:53.967473+0000","last_unstale":"2024-04-26T07:51:38.186748+0000","last_undegraded":"2024-04-26T07:51:38.186748+0000","last_fullsized":"2024-04-26T07:51:38.186748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:20.524401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407217+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:51:39.407217+0000","last_peered":"2024-04-26T07:51:39.407217+0000","last_clean":"2024-04-26T07:51:39.407217+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:51:39.407217+0000","last_undegraded":"2024-04-26T07:51:39.407217+0000","last_fullsized":"2024-04-26T07:51:39.407217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":200,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370492+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:39.370492+0000","last_peered":"2024-04-26T07:51:39.370492+0000","last_clean":"2024-04-26T07:51:39.370492+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:39.370492+0000","last_undegraded":"2024-04-26T07:51:39.370492+0000","last_fullsized":"2024-04-26T07:51:39.370492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'134","reported_seq":375,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405553+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:51:39.405553+0000","last_peered":"2024-04-26T07:51:39.405553+0000","last_clean":"2024-04-26T07:51:39.405553+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:51:39.405553+0000","last_undegraded":"2024-04-26T07:51:39.405553+0000","last_fullsized":"2024-04-26T07:51:39.405553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384142+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:39.384142+0000","last_peered":"2024-04-26T07:51:39.384142+0000","last_clean":"2024-04-26T07:51:39.384142+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:39.384142+0000","last_undegraded":"2024-04-26T07:51:39.384142+0000","last_fullsized":"2024-04-26T07:51:39.384142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377875+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:51:39.377875+0000","last_peered":"2024-04-26T07:51:39.377875+0000","last_clean":"2024-04-26T07:51:39.377875+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:51:39.377875+0000","last_undegraded":"2024-04-26T07:51:39.377875+0000","last_fullsized":"2024-04-26T07:51:39.377875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'19","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383860+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:39.383860+0000","last_peered":"2024-04-26T07:51:39.383860+0000","last_clean":"2024-04-26T07:51:39.383860+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:39.383860+0000","last_undegraded":"2024-04-26T07:51:39.383860+0000","last_fullsized":"2024-04-26T07:51:39.383860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373893+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:51:39.373893+0000","last_peered":"2024-04-26T07:51:39.373893+0000","last_clean":"2024-04-26T07:51:39.373893+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:51:39.373893+0000","last_undegraded":"2024-04-26T07:51:39.373893+0000","last_fullsized":"2024-04-26T07:51:39.373893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375376+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:39.375376+0000","last_peered":"2024-04-26T07:51:39.375376+0000","last_clean":"2024-04-26T07:51:39.375376+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:39.375376+0000","last_undegraded":"2024-04-26T07:51:39.375376+0000","last_fullsized":"2024-04-26T07:51:39.375376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375966+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:51:39.375966+0000","last_peered":"2024-04-26T07:51:39.375966+0000","last_clean":"2024-04-26T07:51:39.375966+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:51:39.375966+0000","last_undegraded":"2024-04-26T07:51:39.375966+0000","last_fullsized":"2024-04-26T07:51:39.375966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'134","reported_seq":347,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381796+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:51:39.381796+0000","last_peered":"2024-04-26T07:51:39.381796+0000","last_clean":"2024-04-26T07:51:39.381796+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:51:39.381796+0000","last_undegraded":"2024-04-26T07:51:39.381796+0000","last_fullsized":"2024-04-26T07:51:39.381796+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391088+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:39.391088+0000","last_peered":"2024-04-26T07:51:39.391088+0000","last_clean":"2024-04-26T07:51:39.391088+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:39.391088+0000","last_undegraded":"2024-04-26T07:51:39.391088+0000","last_fullsized":"2024-04-26T07:51:39.391088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":234,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375190+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:39.375190+0000","last_peered":"2024-04-26T07:51:39.375190+0000","last_clean":"2024-04-26T07:51:39.375190+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:39.375190+0000","last_undegraded":"2024-04-26T07:51:39.375190+0000","last_fullsized":"2024-04-26T07:51:39.375190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394463+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:39.394463+0000","last_peered":"2024-04-26T07:51:39.394463+0000","last_clean":"2024-04-26T07:51:39.394463+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:39.394463+0000","last_undegraded":"2024-04-26T07:51:39.394463+0000","last_fullsized":"2024-04-26T07:51:39.394463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.413288+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:51:39.413288+0000","last_peered":"2024-04-26T07:51:39.413288+0000","last_clean":"2024-04-26T07:51:39.413288+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:51:39.413288+0000","last_undegraded":"2024-04-26T07:51:39.413288+0000","last_fullsized":"2024-04-26T07:51:39.413288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377673+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:39.377673+0000","last_peered":"2024-04-26T07:51:39.377673+0000","last_clean":"2024-04-26T07:51:39.377673+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:39.377673+0000","last_undegraded":"2024-04-26T07:51:39.377673+0000","last_fullsized":"2024-04-26T07:51:39.377673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"90'44","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.555117+0000","last_change":"2024-04-26T07:50:53.973637+0000","last_active":"2024-04-26T07:51:38.555117+0000","last_peered":"2024-04-26T07:51:38.555117+0000","last_clean":"2024-04-26T07:51:38.555117+0000","last_became_active":"2024-04-26T07:50:53.972585+0000","last_became_peered":"2024-04-26T07:50:53.972585+0000","last_unstale":"2024-04-26T07:51:38.555117+0000","last_undegraded":"2024-04-26T07:51:38.555117+0000","last_fullsized":"2024-04-26T07:51:38.555117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:54.979556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379607+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:51:39.379607+0000","last_peered":"2024-04-26T07:51:39.379607+0000","last_clean":"2024-04-26T07:51:39.379607+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:51:39.379607+0000","last_undegraded":"2024-04-26T07:51:39.379607+0000","last_fullsized":"2024-04-26T07:51:39.379607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":177,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397667+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:39.397667+0000","last_peered":"2024-04-26T07:51:39.397667+0000","last_clean":"2024-04-26T07:51:39.397667+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:39.397667+0000","last_undegraded":"2024-04-26T07:51:39.397667+0000","last_fullsized":"2024-04-26T07:51:39.397667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392928+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:39.392928+0000","last_peered":"2024-04-26T07:51:39.392928+0000","last_clean":"2024-04-26T07:51:39.392928+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:39.392928+0000","last_undegraded":"2024-04-26T07:51:39.392928+0000","last_fullsized":"2024-04-26T07:51:39.392928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375375+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:51:39.375375+0000","last_peered":"2024-04-26T07:51:39.375375+0000","last_clean":"2024-04-26T07:51:39.375375+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:51:39.375375+0000","last_undegraded":"2024-04-26T07:51:39.375375+0000","last_fullsized":"2024-04-26T07:51:39.375375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"89'31","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377267+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:39.377267+0000","last_peered":"2024-04-26T07:51:39.377267+0000","last_clean":"2024-04-26T07:51:39.377267+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:39.377267+0000","last_undegraded":"2024-04-26T07:51:39.377267+0000","last_fullsized":"2024-04-26T07:51:39.377267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371320+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:51:39.371320+0000","last_peered":"2024-04-26T07:51:39.371320+0000","last_clean":"2024-04-26T07:51:39.371320+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:51:39.371320+0000","last_undegraded":"2024-04-26T07:51:39.371320+0000","last_fullsized":"2024-04-26T07:51:39.371320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"90'19","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377783+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:51:39.377783+0000","last_peered":"2024-04-26T07:51:39.377783+0000","last_clean":"2024-04-26T07:51:39.377783+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:51:39.377783+0000","last_undegraded":"2024-04-26T07:51:39.377783+0000","last_fullsized":"2024-04-26T07:51:39.377783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377604+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:51:39.377604+0000","last_peered":"2024-04-26T07:51:39.377604+0000","last_clean":"2024-04-26T07:51:39.377604+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:51:39.377604+0000","last_undegraded":"2024-04-26T07:51:39.377604+0000","last_fullsized":"2024-04-26T07:51:39.377604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":177,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380056+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:39.380056+0000","last_peered":"2024-04-26T07:51:39.380056+0000","last_clean":"2024-04-26T07:51:39.380056+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:39.380056+0000","last_undegraded":"2024-04-26T07:51:39.380056+0000","last_fullsized":"2024-04-26T07:51:39.380056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370943+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:51:39.370943+0000","last_peered":"2024-04-26T07:51:39.370943+0000","last_clean":"2024-04-26T07:51:39.370943+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:51:39.370943+0000","last_undegraded":"2024-04-26T07:51:39.370943+0000","last_fullsized":"2024-04-26T07:51:39.370943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'18","reported_seq":203,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.361166+0000","last_change":"2024-04-26T07:50:53.963894+0000","last_active":"2024-04-26T07:51:38.361166+0000","last_peered":"2024-04-26T07:51:38.361166+0000","last_clean":"2024-04-26T07:51:38.361166+0000","last_became_active":"2024-04-26T07:50:53.963007+0000","last_became_peered":"2024-04-26T07:50:53.963007+0000","last_unstale":"2024-04-26T07:51:38.361166+0000","last_undegraded":"2024-04-26T07:51:38.361166+0000","last_fullsized":"2024-04-26T07:51:38.361166+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:26.560585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380927+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:39.380927+0000","last_peered":"2024-04-26T07:51:39.380927+0000","last_clean":"2024-04-26T07:51:39.380927+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:39.380927+0000","last_undegraded":"2024-04-26T07:51:39.380927+0000","last_fullsized":"2024-04-26T07:51:39.380927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"101'10","reported_seq":189,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389777+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:51:39.389777+0000","last_peered":"2024-04-26T07:51:39.389777+0000","last_clean":"2024-04-26T07:51:39.389777+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:51:39.389777+0000","last_undegraded":"2024-04-26T07:51:39.389777+0000","last_fullsized":"2024-04-26T07:51:39.389777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":56,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.554776+0000","last_change":"2024-04-26T07:50:53.973397+0000","last_active":"2024-04-26T07:51:38.554776+0000","last_peered":"2024-04-26T07:51:38.554776+0000","last_clean":"2024-04-26T07:51:38.554776+0000","last_became_active":"2024-04-26T07:50:53.972614+0000","last_became_peered":"2024-04-26T07:50:53.972614+0000","last_unstale":"2024-04-26T07:51:38.554776+0000","last_undegraded":"2024-04-26T07:51:38.554776+0000","last_fullsized":"2024-04-26T07:51:38.554776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:21.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389427+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:39.389427+0000","last_peered":"2024-04-26T07:51:39.389427+0000","last_clean":"2024-04-26T07:51:39.389427+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:39.389427+0000","last_undegraded":"2024-04-26T07:51:39.389427+0000","last_fullsized":"2024-04-26T07:51:39.389427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379349+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:51:39.379349+0000","last_peered":"2024-04-26T07:51:39.379349+0000","last_clean":"2024-04-26T07:51:39.379349+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:51:39.379349+0000","last_undegraded":"2024-04-26T07:51:39.379349+0000","last_fullsized":"2024-04-26T07:51:39.379349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408423+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:39.408423+0000","last_peered":"2024-04-26T07:51:39.408423+0000","last_clean":"2024-04-26T07:51:39.408423+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:39.408423+0000","last_undegraded":"2024-04-26T07:51:39.408423+0000","last_fullsized":"2024-04-26T07:51:39.408423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.360898+0000","last_change":"2024-04-26T07:50:53.967849+0000","last_active":"2024-04-26T07:51:38.360898+0000","last_peered":"2024-04-26T07:51:38.360898+0000","last_clean":"2024-04-26T07:51:38.360898+0000","last_became_active":"2024-04-26T07:50:53.966926+0000","last_became_peered":"2024-04-26T07:50:53.966926+0000","last_unstale":"2024-04-26T07:51:38.360898+0000","last_undegraded":"2024-04-26T07:51:38.360898+0000","last_fullsized":"2024-04-26T07:51:38.360898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:54.861809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"90'20","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380656+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:51:39.380656+0000","last_peered":"2024-04-26T07:51:39.380656+0000","last_clean":"2024-04-26T07:51:39.380656+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:51:39.380656+0000","last_undegraded":"2024-04-26T07:51:39.380656+0000","last_fullsized":"2024-04-26T07:51:39.380656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407151+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:39.407151+0000","last_peered":"2024-04-26T07:51:39.407151+0000","last_clean":"2024-04-26T07:51:39.407151+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:39.407151+0000","last_undegraded":"2024-04-26T07:51:39.407151+0000","last_fullsized":"2024-04-26T07:51:39.407151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397451+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:39.397451+0000","last_peered":"2024-04-26T07:51:39.397451+0000","last_clean":"2024-04-26T07:51:39.397451+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:39.397451+0000","last_undegraded":"2024-04-26T07:51:39.397451+0000","last_fullsized":"2024-04-26T07:51:39.397451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378122+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:51:39.378122+0000","last_peered":"2024-04-26T07:51:39.378122+0000","last_clean":"2024-04-26T07:51:39.378122+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:51:39.378122+0000","last_undegraded":"2024-04-26T07:51:39.378122+0000","last_fullsized":"2024-04-26T07:51:39.378122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'25","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394144+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:39.394144+0000","last_peered":"2024-04-26T07:51:39.394144+0000","last_clean":"2024-04-26T07:51:39.394144+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:39.394144+0000","last_undegraded":"2024-04-26T07:51:39.394144+0000","last_fullsized":"2024-04-26T07:51:39.394144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407013+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:51:39.407013+0000","last_peered":"2024-04-26T07:51:39.407013+0000","last_clean":"2024-04-26T07:51:39.407013+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:51:39.407013+0000","last_undegraded":"2024-04-26T07:51:39.407013+0000","last_fullsized":"2024-04-26T07:51:39.407013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"90'18","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.097250+0000","last_change":"2024-04-26T07:50:53.965258+0000","last_active":"2024-04-26T07:51:38.097250+0000","last_peered":"2024-04-26T07:51:38.097250+0000","last_clean":"2024-04-26T07:51:38.097250+0000","last_became_active":"2024-04-26T07:50:53.964570+0000","last_became_peered":"2024-04-26T07:50:53.964570+0000","last_unstale":"2024-04-26T07:51:38.097250+0000","last_undegraded":"2024-04-26T07:51:38.097250+0000","last_fullsized":"2024-04-26T07:51:38.097250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:00.227690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391695+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:51:39.391695+0000","last_peered":"2024-04-26T07:51:39.391695+0000","last_clean":"2024-04-26T07:51:39.391695+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:51:39.391695+0000","last_undegraded":"2024-04-26T07:51:39.391695+0000","last_fullsized":"2024-04-26T07:51:39.391695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.413295+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:51:39.413295+0000","last_peered":"2024-04-26T07:51:39.413295+0000","last_clean":"2024-04-26T07:51:39.413295+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:51:39.413295+0000","last_undegraded":"2024-04-26T07:51:39.413295+0000","last_fullsized":"2024-04-26T07:51:39.413295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'23","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378325+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:39.378325+0000","last_peered":"2024-04-26T07:51:39.378325+0000","last_clean":"2024-04-26T07:51:39.378325+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:39.378325+0000","last_undegraded":"2024-04-26T07:51:39.378325+0000","last_fullsized":"2024-04-26T07:51:39.378325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394247+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:51:39.394247+0000","last_peered":"2024-04-26T07:51:39.394247+0000","last_clean":"2024-04-26T07:51:39.394247+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:51:39.394247+0000","last_undegraded":"2024-04-26T07:51:39.394247+0000","last_fullsized":"2024-04-26T07:51:39.394247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"90'29","reported_seq":218,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373437+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:51:39.373437+0000","last_peered":"2024-04-26T07:51:39.373437+0000","last_clean":"2024-04-26T07:51:39.373437+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:51:39.373437+0000","last_undegraded":"2024-04-26T07:51:39.373437+0000","last_fullsized":"2024-04-26T07:51:39.373437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397735+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:39.397735+0000","last_peered":"2024-04-26T07:51:39.397735+0000","last_clean":"2024-04-26T07:51:39.397735+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:39.397735+0000","last_undegraded":"2024-04-26T07:51:39.397735+0000","last_fullsized":"2024-04-26T07:51:39.397735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380112+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:39.380112+0000","last_peered":"2024-04-26T07:51:39.380112+0000","last_clean":"2024-04-26T07:51:39.380112+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:39.380112+0000","last_undegraded":"2024-04-26T07:51:39.380112+0000","last_fullsized":"2024-04-26T07:51:39.380112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393319+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:51:39.393319+0000","last_peered":"2024-04-26T07:51:39.393319+0000","last_clean":"2024-04-26T07:51:39.393319+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:51:39.393319+0000","last_undegraded":"2024-04-26T07:51:39.393319+0000","last_fullsized":"2024-04-26T07:51:39.393319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'16","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373938+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:51:39.373938+0000","last_peered":"2024-04-26T07:51:39.373938+0000","last_clean":"2024-04-26T07:51:39.373938+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:51:39.373938+0000","last_undegraded":"2024-04-26T07:51:39.373938+0000","last_fullsized":"2024-04-26T07:51:39.373938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412868+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:51:39.412868+0000","last_peered":"2024-04-26T07:51:39.412868+0000","last_clean":"2024-04-26T07:51:39.412868+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:51:39.412868+0000","last_undegraded":"2024-04-26T07:51:39.412868+0000","last_fullsized":"2024-04-26T07:51:39.412868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"90'25","reported_seq":162,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.401018+0000","last_change":"2024-04-26T07:51:39.401018+0000","last_active":"2024-04-26T07:51:39.401018+0000","last_peered":"2024-04-26T07:50:49.904013+0000","last_clean":"2024-04-26T07:50:49.904013+0000","last_became_active":"2024-04-26T07:48:27.577870+0000","last_became_peered":"2024-04-26T07:48:27.577870+0000","last_unstale":"2024-04-26T07:51:39.401018+0000","last_undegraded":"2024-04-26T07:51:39.401018+0000","last_fullsized":"2024-04-26T07:51:39.401018+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373623+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:39.373623+0000","last_peered":"2024-04-26T07:51:39.373623+0000","last_clean":"2024-04-26T07:51:39.373623+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:39.373623+0000","last_undegraded":"2024-04-26T07:51:39.373623+0000","last_fullsized":"2024-04-26T07:51:39.373623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406561+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:39.406561+0000","last_peered":"2024-04-26T07:51:39.406561+0000","last_clean":"2024-04-26T07:51:39.406561+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:39.406561+0000","last_undegraded":"2024-04-26T07:51:39.406561+0000","last_fullsized":"2024-04-26T07:51:39.406561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380723+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:51:39.380723+0000","last_peered":"2024-04-26T07:51:39.380723+0000","last_clean":"2024-04-26T07:51:39.380723+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:51:39.380723+0000","last_undegraded":"2024-04-26T07:51:39.380723+0000","last_fullsized":"2024-04-26T07:51:39.380723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'31","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376544+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:39.376544+0000","last_peered":"2024-04-26T07:51:39.376544+0000","last_clean":"2024-04-26T07:51:39.376544+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:39.376544+0000","last_undegraded":"2024-04-26T07:51:39.376544+0000","last_fullsized":"2024-04-26T07:51:39.376544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378631+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:51:39.378631+0000","last_peered":"2024-04-26T07:51:39.378631+0000","last_clean":"2024-04-26T07:51:39.378631+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:51:39.378631+0000","last_undegraded":"2024-04-26T07:51:39.378631+0000","last_fullsized":"2024-04-26T07:51:39.378631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"90'19","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384277+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:51:39.384277+0000","last_peered":"2024-04-26T07:51:39.384277+0000","last_clean":"2024-04-26T07:51:39.384277+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:51:39.384277+0000","last_undegraded":"2024-04-26T07:51:39.384277+0000","last_fullsized":"2024-04-26T07:51:39.384277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373433+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:39.373433+0000","last_peered":"2024-04-26T07:51:39.373433+0000","last_clean":"2024-04-26T07:51:39.373433+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:39.373433+0000","last_undegraded":"2024-04-26T07:51:39.373433+0000","last_fullsized":"2024-04-26T07:51:39.373433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.399982+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:39.399982+0000","last_peered":"2024-04-26T07:51:39.399982+0000","last_clean":"2024-04-26T07:51:39.399982+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:39.399982+0000","last_undegraded":"2024-04-26T07:51:39.399982+0000","last_fullsized":"2024-04-26T07:51:39.399982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387435+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:51:39.387435+0000","last_peered":"2024-04-26T07:51:39.387435+0000","last_clean":"2024-04-26T07:51:39.387435+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:51:39.387435+0000","last_undegraded":"2024-04-26T07:51:39.387435+0000","last_fullsized":"2024-04-26T07:51:39.387435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"88'18","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392037+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:39.392037+0000","last_peered":"2024-04-26T07:51:39.392037+0000","last_clean":"2024-04-26T07:51:39.392037+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:39.392037+0000","last_undegraded":"2024-04-26T07:51:39.392037+0000","last_fullsized":"2024-04-26T07:51:39.392037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374068+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:51:39.374068+0000","last_peered":"2024-04-26T07:51:39.374068+0000","last_clean":"2024-04-26T07:51:39.374068+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:51:39.374068+0000","last_undegraded":"2024-04-26T07:51:39.374068+0000","last_fullsized":"2024-04-26T07:51:39.374068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379379+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:51:39.379379+0000","last_peered":"2024-04-26T07:51:39.379379+0000","last_clean":"2024-04-26T07:51:39.379379+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:51:39.379379+0000","last_undegraded":"2024-04-26T07:51:39.379379+0000","last_fullsized":"2024-04-26T07:51:39.379379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'134","reported_seq":424,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412386+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:51:39.412386+0000","last_peered":"2024-04-26T07:51:39.412386+0000","last_clean":"2024-04-26T07:51:39.412386+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:51:39.412386+0000","last_undegraded":"2024-04-26T07:51:39.412386+0000","last_fullsized":"2024-04-26T07:51:39.412386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":128,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.386998+0000","last_change":"2024-04-26T07:51:39.386998+0000","last_active":"2024-04-26T07:51:39.386998+0000","last_peered":"2024-04-26T07:50:49.902583+0000","last_clean":"2024-04-26T07:50:49.902583+0000","last_became_active":"2024-04-26T07:48:31.604886+0000","last_became_peered":"2024-04-26T07:48:31.604886+0000","last_unstale":"2024-04-26T07:51:39.386998+0000","last_undegraded":"2024-04-26T07:51:39.386998+0000","last_fullsized":"2024-04-26T07:51:39.386998+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375071+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:39.375071+0000","last_peered":"2024-04-26T07:51:39.375071+0000","last_clean":"2024-04-26T07:51:39.375071+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:39.375071+0000","last_undegraded":"2024-04-26T07:51:39.375071+0000","last_fullsized":"2024-04-26T07:51:39.375071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"89'14","reported_seq":147,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386364+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:39.386364+0000","last_peered":"2024-04-26T07:51:39.386364+0000","last_clean":"2024-04-26T07:51:39.386364+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:39.386364+0000","last_undegraded":"2024-04-26T07:51:39.386364+0000","last_fullsized":"2024-04-26T07:51:39.386364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:16.352834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":132,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.383133+0000","last_change":"2024-04-26T07:50:52.952271+0000","last_active":"2024-04-26T07:48:24.527456+0000","last_peered":"2024-04-26T07:48:24.527456+0000","last_clean":"2024-04-26T07:48:24.527456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.383133+0000","last_undegraded":"2024-04-26T07:51:39.383133+0000","last_fullsized":"2024-04-26T07:51:39.383133+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"90'23","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400652+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:51:39.400652+0000","last_peered":"2024-04-26T07:51:39.400652+0000","last_clean":"2024-04-26T07:51:39.400652+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:51:39.400652+0000","last_undegraded":"2024-04-26T07:51:39.400652+0000","last_fullsized":"2024-04-26T07:51:39.400652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.388932+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:51:39.388932+0000","last_peered":"2024-04-26T07:51:39.388932+0000","last_clean":"2024-04-26T07:51:39.388932+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:51:39.388932+0000","last_undegraded":"2024-04-26T07:51:39.388932+0000","last_fullsized":"2024-04-26T07:51:39.388932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":124,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.408976+0000","last_change":"2024-04-26T07:51:39.408976+0000","last_active":"2024-04-26T07:51:39.408976+0000","last_peered":"2024-04-26T07:50:49.905210+0000","last_clean":"2024-04-26T07:50:49.905210+0000","last_became_active":"2024-04-26T07:48:31.597882+0000","last_became_peered":"2024-04-26T07:48:31.597882+0000","last_unstale":"2024-04-26T07:51:39.408976+0000","last_undegraded":"2024-04-26T07:51:39.408976+0000","last_fullsized":"2024-04-26T07:51:39.408976+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376230+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:51:39.376230+0000","last_peered":"2024-04-26T07:51:39.376230+0000","last_clean":"2024-04-26T07:51:39.376230+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:51:39.376230+0000","last_undegraded":"2024-04-26T07:51:39.376230+0000","last_fullsized":"2024-04-26T07:51:39.376230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"90'28","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400325+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:51:39.400325+0000","last_peered":"2024-04-26T07:51:39.400325+0000","last_clean":"2024-04-26T07:51:39.400325+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:51:39.400325+0000","last_undegraded":"2024-04-26T07:51:39.400325+0000","last_fullsized":"2024-04-26T07:51:39.400325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397583+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:51:39.397583+0000","last_peered":"2024-04-26T07:51:39.397583+0000","last_clean":"2024-04-26T07:51:39.397583+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:51:39.397583+0000","last_undegraded":"2024-04-26T07:51:39.397583+0000","last_fullsized":"2024-04-26T07:51:39.397583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"90'18","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389206+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:39.389206+0000","last_peered":"2024-04-26T07:51:39.389206+0000","last_clean":"2024-04-26T07:51:39.389206+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:39.389206+0000","last_undegraded":"2024-04-26T07:51:39.389206+0000","last_fullsized":"2024-04-26T07:51:39.389206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406639+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:39.406639+0000","last_peered":"2024-04-26T07:51:39.406639+0000","last_clean":"2024-04-26T07:51:39.406639+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:39.406639+0000","last_undegraded":"2024-04-26T07:51:39.406639+0000","last_fullsized":"2024-04-26T07:51:39.406639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383761+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:39.383761+0000","last_peered":"2024-04-26T07:51:39.383761+0000","last_clean":"2024-04-26T07:51:39.383761+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:39.383761+0000","last_undegraded":"2024-04-26T07:51:39.383761+0000","last_fullsized":"2024-04-26T07:51:39.383761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379469+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:39.379469+0000","last_peered":"2024-04-26T07:51:39.379469+0000","last_clean":"2024-04-26T07:51:39.379469+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:39.379469+0000","last_undegraded":"2024-04-26T07:51:39.379469+0000","last_fullsized":"2024-04-26T07:51:39.379469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'27","reported_seq":161,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391787+0000","last_change":"2024-04-26T07:49:08.971107+0000","last_active":"2024-04-26T07:51:39.391787+0000","last_peered":"2024-04-26T07:51:39.391787+0000","last_clean":"2024-04-26T07:51:39.391787+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:51:39.391787+0000","last_undegraded":"2024-04-26T07:51:39.391787+0000","last_fullsized":"2024-04-26T07:51:39.391787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:06.980641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374176+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:39.374176+0000","last_peered":"2024-04-26T07:51:39.374176+0000","last_clean":"2024-04-26T07:51:39.374176+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:39.374176+0000","last_undegraded":"2024-04-26T07:51:39.374176+0000","last_fullsized":"2024-04-26T07:51:39.374176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"90'13","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381600+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:51:39.381600+0000","last_peered":"2024-04-26T07:51:39.381600+0000","last_clean":"2024-04-26T07:51:39.381600+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:51:39.381600+0000","last_undegraded":"2024-04-26T07:51:39.381600+0000","last_fullsized":"2024-04-26T07:51:39.381600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374528+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:39.374528+0000","last_peered":"2024-04-26T07:51:39.374528+0000","last_clean":"2024-04-26T07:51:39.374528+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:39.374528+0000","last_undegraded":"2024-04-26T07:51:39.374528+0000","last_fullsized":"2024-04-26T07:51:39.374528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":120,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.388033+0000","last_change":"2024-04-26T07:50:52.943695+0000","last_active":"2024-04-26T07:48:30.551424+0000","last_peered":"2024-04-26T07:48:30.551424+0000","last_clean":"2024-04-26T07:48:30.551424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.388033+0000","last_undegraded":"2024-04-26T07:51:39.388033+0000","last_fullsized":"2024-04-26T07:51:39.388033+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":252,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374974+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:39.374974+0000","last_peered":"2024-04-26T07:51:39.374974+0000","last_clean":"2024-04-26T07:51:39.374974+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:39.374974+0000","last_undegraded":"2024-04-26T07:51:39.374974+0000","last_fullsized":"2024-04-26T07:51:39.374974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'25","reported_seq":219,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393997+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:39.393997+0000","last_peered":"2024-04-26T07:51:39.393997+0000","last_clean":"2024-04-26T07:51:39.393997+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:39.393997+0000","last_undegraded":"2024-04-26T07:51:39.393997+0000","last_fullsized":"2024-04-26T07:51:39.393997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:34.437375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370649+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:51:39.370649+0000","last_peered":"2024-04-26T07:51:39.370649+0000","last_clean":"2024-04-26T07:51:39.370649+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:51:39.370649+0000","last_undegraded":"2024-04-26T07:51:39.370649+0000","last_fullsized":"2024-04-26T07:51:39.370649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"90'17","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375011+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:51:39.375011+0000","last_peered":"2024-04-26T07:51:39.375011+0000","last_clean":"2024-04-26T07:51:39.375011+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:51:39.375011+0000","last_undegraded":"2024-04-26T07:51:39.375011+0000","last_fullsized":"2024-04-26T07:51:39.375011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391487+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:51:39.391487+0000","last_peered":"2024-04-26T07:51:39.391487+0000","last_clean":"2024-04-26T07:51:39.391487+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:39.391487+0000","last_undegraded":"2024-04-26T07:51:39.391487+0000","last_fullsized":"2024-04-26T07:51:39.391487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378701+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:39.378701+0000","last_peered":"2024-04-26T07:51:39.378701+0000","last_clean":"2024-04-26T07:51:39.378701+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:39.378701+0000","last_undegraded":"2024-04-26T07:51:39.378701+0000","last_fullsized":"2024-04-26T07:51:39.378701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":227,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374241+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:51:39.374241+0000","last_peered":"2024-04-26T07:51:39.374241+0000","last_clean":"2024-04-26T07:51:39.374241+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:51:39.374241+0000","last_undegraded":"2024-04-26T07:51:39.374241+0000","last_fullsized":"2024-04-26T07:51:39.374241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406611+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:51:39.406611+0000","last_peered":"2024-04-26T07:51:39.406611+0000","last_clean":"2024-04-26T07:51:39.406611+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:51:39.406611+0000","last_undegraded":"2024-04-26T07:51:39.406611+0000","last_fullsized":"2024-04-26T07:51:39.406611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373707+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:51:39.373707+0000","last_peered":"2024-04-26T07:51:39.373707+0000","last_clean":"2024-04-26T07:51:39.373707+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:51:39.373707+0000","last_undegraded":"2024-04-26T07:51:39.373707+0000","last_fullsized":"2024-04-26T07:51:39.373707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'26","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385843+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:51:39.385843+0000","last_peered":"2024-04-26T07:51:39.385843+0000","last_clean":"2024-04-26T07:51:39.385843+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:51:39.385843+0000","last_undegraded":"2024-04-26T07:51:39.385843+0000","last_fullsized":"2024-04-26T07:51:39.385843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397011+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:51:39.397011+0000","last_peered":"2024-04-26T07:51:39.397011+0000","last_clean":"2024-04-26T07:51:39.397011+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:51:39.397011+0000","last_undegraded":"2024-04-26T07:51:39.397011+0000","last_fullsized":"2024-04-26T07:51:39.397011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"89'18","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401510+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:39.401510+0000","last_peered":"2024-04-26T07:51:39.401510+0000","last_clean":"2024-04-26T07:51:39.401510+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:39.401510+0000","last_undegraded":"2024-04-26T07:51:39.401510+0000","last_fullsized":"2024-04-26T07:51:39.401510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372213+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:51:39.372213+0000","last_peered":"2024-04-26T07:51:39.372213+0000","last_clean":"2024-04-26T07:51:39.372213+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:51:39.372213+0000","last_undegraded":"2024-04-26T07:51:39.372213+0000","last_fullsized":"2024-04-26T07:51:39.372213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'23","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392390+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:39.392390+0000","last_peered":"2024-04-26T07:51:39.392390+0000","last_clean":"2024-04-26T07:51:39.392390+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:39.392390+0000","last_undegraded":"2024-04-26T07:51:39.392390+0000","last_fullsized":"2024-04-26T07:51:39.392390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381281+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:51:39.381281+0000","last_peered":"2024-04-26T07:51:39.381281+0000","last_clean":"2024-04-26T07:51:39.381281+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:51:39.381281+0000","last_undegraded":"2024-04-26T07:51:39.381281+0000","last_fullsized":"2024-04-26T07:51:39.381281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'32","reported_seq":223,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383336+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:39.383336+0000","last_peered":"2024-04-26T07:51:39.383336+0000","last_clean":"2024-04-26T07:51:39.383336+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:39.383336+0000","last_undegraded":"2024-04-26T07:51:39.383336+0000","last_fullsized":"2024-04-26T07:51:39.383336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376481+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:51:39.376481+0000","last_peered":"2024-04-26T07:51:39.376481+0000","last_clean":"2024-04-26T07:51:39.376481+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:51:39.376481+0000","last_undegraded":"2024-04-26T07:51:39.376481+0000","last_fullsized":"2024-04-26T07:51:39.376481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"89'35","reported_seq":225,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375268+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:39.375268+0000","last_peered":"2024-04-26T07:51:39.375268+0000","last_clean":"2024-04-26T07:51:39.375268+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:39.375268+0000","last_undegraded":"2024-04-26T07:51:39.375268+0000","last_fullsized":"2024-04-26T07:51:39.375268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379302+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:51:39.379302+0000","last_peered":"2024-04-26T07:51:39.379302+0000","last_clean":"2024-04-26T07:51:39.379302+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:51:39.379302+0000","last_undegraded":"2024-04-26T07:51:39.379302+0000","last_fullsized":"2024-04-26T07:51:39.379302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"89'23","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.411733+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:51:39.411733+0000","last_peered":"2024-04-26T07:51:39.411733+0000","last_clean":"2024-04-26T07:51:39.411733+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:51:39.411733+0000","last_undegraded":"2024-04-26T07:51:39.411733+0000","last_fullsized":"2024-04-26T07:51:39.411733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396261+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:51:39.396261+0000","last_peered":"2024-04-26T07:51:39.396261+0000","last_clean":"2024-04-26T07:51:39.396261+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:51:39.396261+0000","last_undegraded":"2024-04-26T07:51:39.396261+0000","last_fullsized":"2024-04-26T07:51:39.396261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384030+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:39.384030+0000","last_peered":"2024-04-26T07:51:39.384030+0000","last_clean":"2024-04-26T07:51:39.384030+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:39.384030+0000","last_undegraded":"2024-04-26T07:51:39.384030+0000","last_fullsized":"2024-04-26T07:51:39.384030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393842+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:51:39.393842+0000","last_peered":"2024-04-26T07:51:39.393842+0000","last_clean":"2024-04-26T07:51:39.393842+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:51:39.393842+0000","last_undegraded":"2024-04-26T07:51:39.393842+0000","last_fullsized":"2024-04-26T07:51:39.393842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406065+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:39.406065+0000","last_peered":"2024-04-26T07:51:39.406065+0000","last_clean":"2024-04-26T07:51:39.406065+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:39.406065+0000","last_undegraded":"2024-04-26T07:51:39.406065+0000","last_fullsized":"2024-04-26T07:51:39.406065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379645+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:51:39.379645+0000","last_peered":"2024-04-26T07:51:39.379645+0000","last_clean":"2024-04-26T07:51:39.379645+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:51:39.379645+0000","last_undegraded":"2024-04-26T07:51:39.379645+0000","last_fullsized":"2024-04-26T07:51:39.379645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379508+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:39.379508+0000","last_peered":"2024-04-26T07:51:39.379508+0000","last_clean":"2024-04-26T07:51:39.379508+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:39.379508+0000","last_undegraded":"2024-04-26T07:51:39.379508+0000","last_fullsized":"2024-04-26T07:51:39.379508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389268+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:51:39.389268+0000","last_peered":"2024-04-26T07:51:39.389268+0000","last_clean":"2024-04-26T07:51:39.389268+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:51:39.389268+0000","last_undegraded":"2024-04-26T07:51:39.389268+0000","last_fullsized":"2024-04-26T07:51:39.389268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'14","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401211+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:51:39.401211+0000","last_peered":"2024-04-26T07:51:39.401211+0000","last_clean":"2024-04-26T07:51:39.401211+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:51:39.401211+0000","last_undegraded":"2024-04-26T07:51:39.401211+0000","last_fullsized":"2024-04-26T07:51:39.401211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378331+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:51:39.378331+0000","last_peered":"2024-04-26T07:51:39.378331+0000","last_clean":"2024-04-26T07:51:39.378331+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:51:39.378331+0000","last_undegraded":"2024-04-26T07:51:39.378331+0000","last_fullsized":"2024-04-26T07:51:39.378331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'27","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392576+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:39.392576+0000","last_peered":"2024-04-26T07:51:39.392576+0000","last_clean":"2024-04-26T07:51:39.392576+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:39.392576+0000","last_undegraded":"2024-04-26T07:51:39.392576+0000","last_fullsized":"2024-04-26T07:51:39.392576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":147,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.360637+0000","last_change":"2024-04-26T07:50:53.964033+0000","last_active":"2024-04-26T07:51:38.360637+0000","last_peered":"2024-04-26T07:51:38.360637+0000","last_clean":"2024-04-26T07:51:38.360637+0000","last_became_active":"2024-04-26T07:50:53.963208+0000","last_became_peered":"2024-04-26T07:50:53.963208+0000","last_unstale":"2024-04-26T07:51:38.360637+0000","last_undegraded":"2024-04-26T07:51:38.360637+0000","last_fullsized":"2024-04-26T07:51:38.360637+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:39.310959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408368+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:39.408368+0000","last_peered":"2024-04-26T07:51:39.408368+0000","last_clean":"2024-04-26T07:51:39.408368+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:39.408368+0000","last_undegraded":"2024-04-26T07:51:39.408368+0000","last_fullsized":"2024-04-26T07:51:39.408368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389677+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:51:39.389677+0000","last_peered":"2024-04-26T07:51:39.389677+0000","last_clean":"2024-04-26T07:51:39.389677+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:51:39.389677+0000","last_undegraded":"2024-04-26T07:51:39.389677+0000","last_fullsized":"2024-04-26T07:51:39.389677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'27","reported_seq":211,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.099005+0000","last_change":"2024-04-26T07:50:53.969078+0000","last_active":"2024-04-26T07:51:38.099005+0000","last_peered":"2024-04-26T07:51:38.099005+0000","last_clean":"2024-04-26T07:51:38.099005+0000","last_became_active":"2024-04-26T07:50:53.968768+0000","last_became_peered":"2024-04-26T07:50:53.968768+0000","last_unstale":"2024-04-26T07:51:38.099005+0000","last_undegraded":"2024-04-26T07:51:38.099005+0000","last_fullsized":"2024-04-26T07:51:38.099005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:53.217128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378100+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:51:39.378100+0000","last_peered":"2024-04-26T07:51:39.378100+0000","last_clean":"2024-04-26T07:51:39.378100+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:51:39.378100+0000","last_undegraded":"2024-04-26T07:51:39.378100+0000","last_fullsized":"2024-04-26T07:51:39.378100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"89'32","reported_seq":223,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392389+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:51:39.392389+0000","last_peered":"2024-04-26T07:51:39.392389+0000","last_clean":"2024-04-26T07:51:39.392389+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:51:39.392389+0000","last_undegraded":"2024-04-26T07:51:39.392389+0000","last_fullsized":"2024-04-26T07:51:39.392389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":164,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.359917+0000","last_change":"2024-04-26T07:50:53.947377+0000","last_active":"2024-04-26T07:51:38.359917+0000","last_peered":"2024-04-26T07:51:38.359917+0000","last_clean":"2024-04-26T07:51:38.359917+0000","last_became_active":"2024-04-26T07:50:53.946376+0000","last_became_peered":"2024-04-26T07:50:53.946376+0000","last_unstale":"2024-04-26T07:51:38.359917+0000","last_undegraded":"2024-04-26T07:51:38.359917+0000","last_fullsized":"2024-04-26T07:51:38.359917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:38.286898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.403358+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:39.403358+0000","last_peered":"2024-04-26T07:51:39.403358+0000","last_clean":"2024-04-26T07:51:39.403358+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:39.403358+0000","last_undegraded":"2024-04-26T07:51:39.403358+0000","last_fullsized":"2024-04-26T07:51:39.403358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"89'21","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405844+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:39.405844+0000","last_peered":"2024-04-26T07:51:39.405844+0000","last_clean":"2024-04-26T07:51:39.405844+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:39.405844+0000","last_undegraded":"2024-04-26T07:51:39.405844+0000","last_fullsized":"2024-04-26T07:51:39.405844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":185,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393607+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:51:39.393607+0000","last_peered":"2024-04-26T07:51:39.393607+0000","last_clean":"2024-04-26T07:51:39.393607+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:51:39.393607+0000","last_undegraded":"2024-04-26T07:51:39.393607+0000","last_fullsized":"2024-04-26T07:51:39.393607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'29","reported_seq":219,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373428+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:51:39.373428+0000","last_peered":"2024-04-26T07:51:39.373428+0000","last_clean":"2024-04-26T07:51:39.373428+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:51:39.373428+0000","last_undegraded":"2024-04-26T07:51:39.373428+0000","last_fullsized":"2024-04-26T07:51:39.373428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":198,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396985+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:51:39.396985+0000","last_peered":"2024-04-26T07:51:39.396985+0000","last_clean":"2024-04-26T07:51:39.396985+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:51:39.396985+0000","last_undegraded":"2024-04-26T07:51:39.396985+0000","last_fullsized":"2024-04-26T07:51:39.396985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1073,"ondisk_log_size":1073,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":850,"num_read_kb":615,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":1435,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716652,"kb_used_data":1685468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92655188,"statfs":{"total":96636764160,"available":94878912512,"internally_reserved":0,"allocated":1725919232,"data_stored":1725325760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203980,"kb_used_data":1172800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93167860,"statfs":{"total":96636764160,"available":95403888640,"internally_reserved":0,"allocated":1200947200,"data_stored":1200387469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1808360,"kb_used_data":1777180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92563480,"statfs":{"total":96636764160,"available":94785003520,"internally_reserved":0,"allocated":1819832320,"data_stored":1819224899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1935044,"kb_used_data":1903864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92436796,"statfs":{"total":96636764160,"available":94655279104,"internally_reserved":0,"allocated":1949556736,"data_stored":1949012579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1877928,"kb_used_data":1842588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92493912,"statfs":{"total":96636764160,"available":94713765888,"internally_reserved":0,"allocated":1886810112,"data_stored":1886217956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1122108,"kb_used_data":1086760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93249732,"statfs":{"total":96636764160,"available":95487725568,"internally_reserved":0,"allocated":1112842240,"data_stored":1112299854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185692,"kb_used_data":1150352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93186148,"statfs":{"total":96636764160,"available":95422615552,"internally_reserved":0,"allocated":1177960448,"data_stored":1177379431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1732968,"kb_used_data":1697624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92638872,"statfs":{"total":96636764160,"available":94862204928,"internally_reserved":0,"allocated":1738366976,"data_stored":1737792724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1736441856,"data_stored":1736441856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1176502272,"data_stored":1176502272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1885339648,"data_stored":1885339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1948254208,"data_stored":1948254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1199570944,"data_stored":1199570944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1723858944,"data_stored":1723858944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":118389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:51:44.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T07:51:44.845 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:44.845 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 4 pgs inactive, 4 pgs peering","count":8},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":222,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1714117693,"num_in_osds":8,"osd_in_since":1714117685,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":254},{"state_name":"peering","count":11}],"num_pgs":265,"num_pools":8,"num_objects":1702,"data_bytes":6300815940,"bytes_used":12884717568,"bytes_avail":760209395712,"bytes_total":773094113280,"inactive_pgs_ratio":0.041509434580802917,"read_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T07:49:15.798551+0000","services":{"rgw":{"daemons":{"summary":"","4458":{"start_epoch":2,"start_stamp":"2024-04-26T07:48:32.802337+0000","gid":4458,"addr":"172.21.15.53:0/909954941","metadata":{"arch":"x86_64","ceph_release":"squid","ceph_version":"ceph version 19.0.0-3092-g5bfac0af (5bfac0af933f1833ec096c3048e2c80e20507e52) squid (dev)","ceph_version_short":"19.0.0-3092-g5bfac0af","cpu":"Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz","distro":"ubuntu","distro_description":"Ubuntu 22.04.1 LTS","distro_version":"22.04","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"smithi053","id":"0","kernel_description":"#115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024","kernel_version":"5.15.0-105-generic","mem_swap_kb":"2097148","mem_total_kb":"32753048","num_handles":"1","os":"Linux","pid":"31245","realm_id":"","realm_name":"","zone_id":"350b6854-d1dd-4485-9f33-ad1fad5247c8","zone_name":"default","zonegroup_id":"c3255bc3-62e3-4875-bc4a-363ff4c652f2","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T07:51:44.864 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-26T07:51:44.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:51:45.187 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:51:45.206 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-04-26T07:51:43.849306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3272,"num_read_kb":2961,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3892,"ondisk_log_size":3892,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12582732,"kb_used_data":12316636,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":742391988,"statfs":{"total":773094113280,"available":760209395712,"internally_reserved":0,"allocated":12612235264,"data_stored":12607640672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001738"},"pg_stats":[{"pgid":"3.3f","version":"89'27","reported_seq":213,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.556686+0000","last_change":"2024-04-26T07:50:53.973250+0000","last_active":"2024-04-26T07:51:38.556686+0000","last_peered":"2024-04-26T07:51:38.556686+0000","last_clean":"2024-04-26T07:51:38.556686+0000","last_became_active":"2024-04-26T07:50:53.972389+0000","last_became_peered":"2024-04-26T07:50:53.972389+0000","last_unstale":"2024-04-26T07:51:38.556686+0000","last_undegraded":"2024-04-26T07:51:38.556686+0000","last_fullsized":"2024-04-26T07:51:38.556686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:52.226385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405394+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:51:39.405394+0000","last_peered":"2024-04-26T07:51:39.405394+0000","last_clean":"2024-04-26T07:51:39.405394+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:51:39.405394+0000","last_undegraded":"2024-04-26T07:51:39.405394+0000","last_fullsized":"2024-04-26T07:51:39.405394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'26","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373790+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:51:39.373790+0000","last_peered":"2024-04-26T07:51:39.373790+0000","last_clean":"2024-04-26T07:51:39.373790+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:51:39.373790+0000","last_undegraded":"2024-04-26T07:51:39.373790+0000","last_fullsized":"2024-04-26T07:51:39.373790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":136,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.387146+0000","last_change":"2024-04-26T07:50:52.943972+0000","last_active":"2024-04-26T07:48:22.491812+0000","last_peered":"2024-04-26T07:48:22.491812+0000","last_clean":"2024-04-26T07:48:22.491812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.387146+0000","last_undegraded":"2024-04-26T07:51:39.387146+0000","last_fullsized":"2024-04-26T07:51:39.387146+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'21","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389818+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:39.389818+0000","last_peered":"2024-04-26T07:51:39.389818+0000","last_clean":"2024-04-26T07:51:39.389818+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:39.389818+0000","last_undegraded":"2024-04-26T07:51:39.389818+0000","last_fullsized":"2024-04-26T07:51:39.389818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":224,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375710+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:51:39.375710+0000","last_peered":"2024-04-26T07:51:39.375710+0000","last_clean":"2024-04-26T07:51:39.375710+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:51:39.375710+0000","last_undegraded":"2024-04-26T07:51:39.375710+0000","last_fullsized":"2024-04-26T07:51:39.375710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'23","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400577+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:39.400577+0000","last_peered":"2024-04-26T07:51:39.400577+0000","last_clean":"2024-04-26T07:51:39.400577+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:39.400577+0000","last_undegraded":"2024-04-26T07:51:39.400577+0000","last_fullsized":"2024-04-26T07:51:39.400577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392215+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:39.392215+0000","last_peered":"2024-04-26T07:51:39.392215+0000","last_clean":"2024-04-26T07:51:39.392215+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:39.392215+0000","last_undegraded":"2024-04-26T07:51:39.392215+0000","last_fullsized":"2024-04-26T07:51:39.392215+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'23","reported_seq":171,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.387527+0000","last_change":"2024-04-26T07:51:39.387527+0000","last_active":"2024-04-26T07:51:39.387527+0000","last_peered":"2024-04-26T07:51:07.858168+0000","last_clean":"2024-04-26T07:51:07.858168+0000","last_became_active":"2024-04-26T07:50:53.969003+0000","last_became_peered":"2024-04-26T07:50:53.969003+0000","last_unstale":"2024-04-26T07:51:39.387527+0000","last_undegraded":"2024-04-26T07:51:39.387527+0000","last_fullsized":"2024-04-26T07:51:39.387527+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":208,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407983+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:51:39.407983+0000","last_peered":"2024-04-26T07:51:39.407983+0000","last_clean":"2024-04-26T07:51:39.407983+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:51:39.407983+0000","last_undegraded":"2024-04-26T07:51:39.407983+0000","last_fullsized":"2024-04-26T07:51:39.407983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'22","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400511+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:51:39.400511+0000","last_peered":"2024-04-26T07:51:39.400511+0000","last_clean":"2024-04-26T07:51:39.400511+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:51:39.400511+0000","last_undegraded":"2024-04-26T07:51:39.400511+0000","last_fullsized":"2024-04-26T07:51:39.400511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378607+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:51:39.378607+0000","last_peered":"2024-04-26T07:51:39.378607+0000","last_clean":"2024-04-26T07:51:39.378607+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:51:39.378607+0000","last_undegraded":"2024-04-26T07:51:39.378607+0000","last_fullsized":"2024-04-26T07:51:39.378607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'19","reported_seq":170,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.393997+0000","last_change":"2024-04-26T07:51:39.393997+0000","last_active":"2024-04-26T07:51:39.393997+0000","last_peered":"2024-04-26T07:51:05.051057+0000","last_clean":"2024-04-26T07:51:05.051057+0000","last_became_active":"2024-04-26T07:50:53.959397+0000","last_became_peered":"2024-04-26T07:50:53.959397+0000","last_unstale":"2024-04-26T07:51:39.393997+0000","last_undegraded":"2024-04-26T07:51:39.393997+0000","last_fullsized":"2024-04-26T07:51:39.393997+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396568+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:51:39.396568+0000","last_peered":"2024-04-26T07:51:39.396568+0000","last_clean":"2024-04-26T07:51:39.396568+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:51:39.396568+0000","last_undegraded":"2024-04-26T07:51:39.396568+0000","last_fullsized":"2024-04-26T07:51:39.396568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"89'23","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378269+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:39.378269+0000","last_peered":"2024-04-26T07:51:39.378269+0000","last_clean":"2024-04-26T07:51:39.378269+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:39.378269+0000","last_undegraded":"2024-04-26T07:51:39.378269+0000","last_fullsized":"2024-04-26T07:51:39.378269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392491+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:51:39.392491+0000","last_peered":"2024-04-26T07:51:39.392491+0000","last_clean":"2024-04-26T07:51:39.392491+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:51:39.392491+0000","last_undegraded":"2024-04-26T07:51:39.392491+0000","last_fullsized":"2024-04-26T07:51:39.392491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":229,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374683+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:51:39.374683+0000","last_peered":"2024-04-26T07:51:39.374683+0000","last_clean":"2024-04-26T07:51:39.374683+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:51:39.374683+0000","last_undegraded":"2024-04-26T07:51:39.374683+0000","last_fullsized":"2024-04-26T07:51:39.374683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'25","reported_seq":207,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.057005+0000","last_change":"2024-04-26T07:50:53.980391+0000","last_active":"2024-04-26T07:51:38.057005+0000","last_peered":"2024-04-26T07:51:38.057005+0000","last_clean":"2024-04-26T07:51:38.057005+0000","last_became_active":"2024-04-26T07:50:53.979506+0000","last_became_peered":"2024-04-26T07:50:53.979506+0000","last_unstale":"2024-04-26T07:51:38.057005+0000","last_undegraded":"2024-04-26T07:51:38.057005+0000","last_fullsized":"2024-04-26T07:51:38.057005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:35.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":207,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.358550+0000","last_change":"2024-04-26T07:50:53.969837+0000","last_active":"2024-04-26T07:51:38.358550+0000","last_peered":"2024-04-26T07:51:38.358550+0000","last_clean":"2024-04-26T07:51:38.358550+0000","last_became_active":"2024-04-26T07:50:53.968777+0000","last_became_peered":"2024-04-26T07:50:53.968777+0000","last_unstale":"2024-04-26T07:51:38.358550+0000","last_undegraded":"2024-04-26T07:51:38.358550+0000","last_fullsized":"2024-04-26T07:51:38.358550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:12.769798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"89'31","reported_seq":222,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408337+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:51:39.408337+0000","last_peered":"2024-04-26T07:51:39.408337+0000","last_clean":"2024-04-26T07:51:39.408337+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:51:39.408337+0000","last_undegraded":"2024-04-26T07:51:39.408337+0000","last_fullsized":"2024-04-26T07:51:39.408337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":41,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400939+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:51:39.400939+0000","last_peered":"2024-04-26T07:51:39.400939+0000","last_clean":"2024-04-26T07:51:39.400939+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:51:39.400939+0000","last_undegraded":"2024-04-26T07:51:39.400939+0000","last_fullsized":"2024-04-26T07:51:39.400939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412523+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:51:39.412523+0000","last_peered":"2024-04-26T07:51:39.412523+0000","last_clean":"2024-04-26T07:51:39.412523+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:51:39.412523+0000","last_undegraded":"2024-04-26T07:51:39.412523+0000","last_fullsized":"2024-04-26T07:51:39.412523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":226,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386774+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:51:39.386774+0000","last_peered":"2024-04-26T07:51:39.386774+0000","last_clean":"2024-04-26T07:51:39.386774+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:51:39.386774+0000","last_undegraded":"2024-04-26T07:51:39.386774+0000","last_fullsized":"2024-04-26T07:51:39.386774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'24","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377431+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:39.377431+0000","last_peered":"2024-04-26T07:51:39.377431+0000","last_clean":"2024-04-26T07:51:39.377431+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:39.377431+0000","last_undegraded":"2024-04-26T07:51:39.377431+0000","last_fullsized":"2024-04-26T07:51:39.377431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387284+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:51:39.387284+0000","last_peered":"2024-04-26T07:51:39.387284+0000","last_clean":"2024-04-26T07:51:39.387284+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:51:39.387284+0000","last_undegraded":"2024-04-26T07:51:39.387284+0000","last_fullsized":"2024-04-26T07:51:39.387284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380785+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:39.380785+0000","last_peered":"2024-04-26T07:51:39.380785+0000","last_clean":"2024-04-26T07:51:39.380785+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:39.380785+0000","last_undegraded":"2024-04-26T07:51:39.380785+0000","last_fullsized":"2024-04-26T07:51:39.380785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378704+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:51:39.378704+0000","last_peered":"2024-04-26T07:51:39.378704+0000","last_clean":"2024-04-26T07:51:39.378704+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:51:39.378704+0000","last_undegraded":"2024-04-26T07:51:39.378704+0000","last_fullsized":"2024-04-26T07:51:39.378704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"90'24","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390410+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:39.390410+0000","last_peered":"2024-04-26T07:51:39.390410+0000","last_clean":"2024-04-26T07:51:39.390410+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:39.390410+0000","last_undegraded":"2024-04-26T07:51:39.390410+0000","last_fullsized":"2024-04-26T07:51:39.390410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374135+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:39.374135+0000","last_peered":"2024-04-26T07:51:39.374135+0000","last_clean":"2024-04-26T07:51:39.374135+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:39.374135+0000","last_undegraded":"2024-04-26T07:51:39.374135+0000","last_fullsized":"2024-04-26T07:51:39.374135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383068+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:39.383068+0000","last_peered":"2024-04-26T07:51:39.383068+0000","last_clean":"2024-04-26T07:51:39.383068+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:39.383068+0000","last_undegraded":"2024-04-26T07:51:39.383068+0000","last_fullsized":"2024-04-26T07:51:39.383068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'19","reported_seq":152,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386665+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:39.386665+0000","last_peered":"2024-04-26T07:51:39.386665+0000","last_clean":"2024-04-26T07:51:39.386665+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:39.386665+0000","last_undegraded":"2024-04-26T07:51:39.386665+0000","last_fullsized":"2024-04-26T07:51:39.386665+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:08.704021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396771+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:39.396771+0000","last_peered":"2024-04-26T07:51:39.396771+0000","last_clean":"2024-04-26T07:51:39.396771+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:39.396771+0000","last_undegraded":"2024-04-26T07:51:39.396771+0000","last_fullsized":"2024-04-26T07:51:39.396771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"90'17","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392064+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:39.392064+0000","last_peered":"2024-04-26T07:51:39.392064+0000","last_clean":"2024-04-26T07:51:39.392064+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:39.392064+0000","last_undegraded":"2024-04-26T07:51:39.392064+0000","last_fullsized":"2024-04-26T07:51:39.392064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":124,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.403124+0000","last_change":"2024-04-26T07:50:52.956904+0000","last_active":"2024-04-26T07:48:28.544638+0000","last_peered":"2024-04-26T07:48:28.544638+0000","last_clean":"2024-04-26T07:48:28.544638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.403124+0000","last_undegraded":"2024-04-26T07:51:39.403124+0000","last_fullsized":"2024-04-26T07:51:39.403124+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":240,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401254+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:39.401254+0000","last_peered":"2024-04-26T07:51:39.401254+0000","last_clean":"2024-04-26T07:51:39.401254+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:39.401254+0000","last_undegraded":"2024-04-26T07:51:39.401254+0000","last_fullsized":"2024-04-26T07:51:39.401254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.399848+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:51:39.399848+0000","last_peered":"2024-04-26T07:51:39.399848+0000","last_clean":"2024-04-26T07:51:39.399848+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:51:39.399848+0000","last_undegraded":"2024-04-26T07:51:39.399848+0000","last_fullsized":"2024-04-26T07:51:39.399848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'20","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390597+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:39.390597+0000","last_peered":"2024-04-26T07:51:39.390597+0000","last_clean":"2024-04-26T07:51:39.390597+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:39.390597+0000","last_undegraded":"2024-04-26T07:51:39.390597+0000","last_fullsized":"2024-04-26T07:51:39.390597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382864+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:39.382864+0000","last_peered":"2024-04-26T07:51:39.382864+0000","last_clean":"2024-04-26T07:51:39.382864+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:39.382864+0000","last_undegraded":"2024-04-26T07:51:39.382864+0000","last_fullsized":"2024-04-26T07:51:39.382864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"53'7","reported_seq":188,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381805+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:51:39.381805+0000","last_peered":"2024-04-26T07:51:39.381805+0000","last_clean":"2024-04-26T07:51:39.381805+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:51:39.381805+0000","last_undegraded":"2024-04-26T07:51:39.381805+0000","last_fullsized":"2024-04-26T07:51:39.381805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378856+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:39.378856+0000","last_peered":"2024-04-26T07:51:39.378856+0000","last_clean":"2024-04-26T07:51:39.378856+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:39.378856+0000","last_undegraded":"2024-04-26T07:51:39.378856+0000","last_fullsized":"2024-04-26T07:51:39.378856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389866+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:51:39.389866+0000","last_peered":"2024-04-26T07:51:39.389866+0000","last_clean":"2024-04-26T07:51:39.389866+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:51:39.389866+0000","last_undegraded":"2024-04-26T07:51:39.389866+0000","last_fullsized":"2024-04-26T07:51:39.389866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394120+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:51:39.394120+0000","last_peered":"2024-04-26T07:51:39.394120+0000","last_clean":"2024-04-26T07:51:39.394120+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:51:39.394120+0000","last_undegraded":"2024-04-26T07:51:39.394120+0000","last_fullsized":"2024-04-26T07:51:39.394120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'22","reported_seq":207,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.362701+0000","last_change":"2024-04-26T07:50:53.967597+0000","last_active":"2024-04-26T07:51:38.362701+0000","last_peered":"2024-04-26T07:51:38.362701+0000","last_clean":"2024-04-26T07:51:38.362701+0000","last_became_active":"2024-04-26T07:50:53.966791+0000","last_became_peered":"2024-04-26T07:50:53.966791+0000","last_unstale":"2024-04-26T07:51:38.362701+0000","last_undegraded":"2024-04-26T07:51:38.362701+0000","last_fullsized":"2024-04-26T07:51:38.362701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:26.519461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384379+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:39.384379+0000","last_peered":"2024-04-26T07:51:39.384379+0000","last_clean":"2024-04-26T07:51:39.384379+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:39.384379+0000","last_undegraded":"2024-04-26T07:51:39.384379+0000","last_fullsized":"2024-04-26T07:51:39.384379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386471+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:51:39.386471+0000","last_peered":"2024-04-26T07:51:39.386471+0000","last_clean":"2024-04-26T07:51:39.386471+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:51:39.386471+0000","last_undegraded":"2024-04-26T07:51:39.386471+0000","last_fullsized":"2024-04-26T07:51:39.386471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'135","reported_seq":300,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.391475+0000","last_change":"2024-04-26T07:51:39.391475+0000","last_active":"2024-04-26T07:51:39.391475+0000","last_peered":"2024-04-26T07:51:08.340110+0000","last_clean":"2024-04-26T07:51:08.340110+0000","last_became_active":"2024-04-26T07:50:53.968380+0000","last_became_peered":"2024-04-26T07:50:53.968380+0000","last_unstale":"2024-04-26T07:51:39.391475+0000","last_undegraded":"2024-04-26T07:51:39.391475+0000","last_fullsized":"2024-04-26T07:51:39.391475+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374803+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:39.374803+0000","last_peered":"2024-04-26T07:51:39.374803+0000","last_clean":"2024-04-26T07:51:39.374803+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:39.374803+0000","last_undegraded":"2024-04-26T07:51:39.374803+0000","last_fullsized":"2024-04-26T07:51:39.374803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384036+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:51:39.384036+0000","last_peered":"2024-04-26T07:51:39.384036+0000","last_clean":"2024-04-26T07:51:39.384036+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:51:39.384036+0000","last_undegraded":"2024-04-26T07:51:39.384036+0000","last_fullsized":"2024-04-26T07:51:39.384036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'17","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406890+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:51:39.406890+0000","last_peered":"2024-04-26T07:51:39.406890+0000","last_clean":"2024-04-26T07:51:39.406890+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:51:39.406890+0000","last_undegraded":"2024-04-26T07:51:39.406890+0000","last_fullsized":"2024-04-26T07:51:39.406890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396314+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:39.396314+0000","last_peered":"2024-04-26T07:51:39.396314+0000","last_clean":"2024-04-26T07:51:39.396314+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:39.396314+0000","last_undegraded":"2024-04-26T07:51:39.396314+0000","last_fullsized":"2024-04-26T07:51:39.396314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"90'17","reported_seq":151,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.401950+0000","last_change":"2024-04-26T07:51:39.401950+0000","last_active":"2024-04-26T07:51:39.401950+0000","last_peered":"2024-04-26T07:50:49.905105+0000","last_clean":"2024-04-26T07:50:49.905105+0000","last_became_active":"2024-04-26T07:48:27.655900+0000","last_became_peered":"2024-04-26T07:48:27.655900+0000","last_unstale":"2024-04-26T07:51:39.401950+0000","last_undegraded":"2024-04-26T07:51:39.401950+0000","last_fullsized":"2024-04-26T07:51:39.401950+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'134","reported_seq":347,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382488+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:51:39.382488+0000","last_peered":"2024-04-26T07:51:39.382488+0000","last_clean":"2024-04-26T07:51:39.382488+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:51:39.382488+0000","last_undegraded":"2024-04-26T07:51:39.382488+0000","last_fullsized":"2024-04-26T07:51:39.382488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":185,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405821+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:51:39.405821+0000","last_peered":"2024-04-26T07:51:39.405821+0000","last_clean":"2024-04-26T07:51:39.405821+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:51:39.405821+0000","last_undegraded":"2024-04-26T07:51:39.405821+0000","last_fullsized":"2024-04-26T07:51:39.405821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'27","reported_seq":213,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.362818+0000","last_change":"2024-04-26T07:50:53.967800+0000","last_active":"2024-04-26T07:51:38.362818+0000","last_peered":"2024-04-26T07:51:38.362818+0000","last_clean":"2024-04-26T07:51:38.362818+0000","last_became_active":"2024-04-26T07:50:53.966844+0000","last_became_peered":"2024-04-26T07:50:53.966844+0000","last_unstale":"2024-04-26T07:51:38.362818+0000","last_undegraded":"2024-04-26T07:51:38.362818+0000","last_fullsized":"2024-04-26T07:51:38.362818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:35.672021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.555154+0000","last_change":"2024-04-26T07:50:53.972931+0000","last_active":"2024-04-26T07:51:38.555154+0000","last_peered":"2024-04-26T07:51:38.555154+0000","last_clean":"2024-04-26T07:51:38.555154+0000","last_became_active":"2024-04-26T07:50:53.972133+0000","last_became_peered":"2024-04-26T07:50:53.972133+0000","last_unstale":"2024-04-26T07:51:38.555154+0000","last_undegraded":"2024-04-26T07:51:38.555154+0000","last_fullsized":"2024-04-26T07:51:38.555154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:14.805996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"90'27","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397583+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:51:39.397583+0000","last_peered":"2024-04-26T07:51:39.397583+0000","last_clean":"2024-04-26T07:51:39.397583+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:51:39.397583+0000","last_undegraded":"2024-04-26T07:51:39.397583+0000","last_fullsized":"2024-04-26T07:51:39.397583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372502+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:39.372502+0000","last_peered":"2024-04-26T07:51:39.372502+0000","last_clean":"2024-04-26T07:51:39.372502+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:39.372502+0000","last_undegraded":"2024-04-26T07:51:39.372502+0000","last_fullsized":"2024-04-26T07:51:39.372502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":179,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400253+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:39.400253+0000","last_peered":"2024-04-26T07:51:39.400253+0000","last_clean":"2024-04-26T07:51:39.400253+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:39.400253+0000","last_undegraded":"2024-04-26T07:51:39.400253+0000","last_fullsized":"2024-04-26T07:51:39.400253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374859+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:51:39.374859+0000","last_peered":"2024-04-26T07:51:39.374859+0000","last_clean":"2024-04-26T07:51:39.374859+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:51:39.374859+0000","last_undegraded":"2024-04-26T07:51:39.374859+0000","last_fullsized":"2024-04-26T07:51:39.374859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'24","reported_seq":210,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.363319+0000","last_change":"2024-04-26T07:50:53.953128+0000","last_active":"2024-04-26T07:51:38.363319+0000","last_peered":"2024-04-26T07:51:38.363319+0000","last_clean":"2024-04-26T07:51:38.363319+0000","last_became_active":"2024-04-26T07:50:53.952170+0000","last_became_peered":"2024-04-26T07:50:53.952170+0000","last_unstale":"2024-04-26T07:51:38.363319+0000","last_undegraded":"2024-04-26T07:51:38.363319+0000","last_fullsized":"2024-04-26T07:51:38.363319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:06.181214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385816+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:51:39.385816+0000","last_peered":"2024-04-26T07:51:39.385816+0000","last_clean":"2024-04-26T07:51:39.385816+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:51:39.385816+0000","last_undegraded":"2024-04-26T07:51:39.385816+0000","last_fullsized":"2024-04-26T07:51:39.385816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"90'17","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381410+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:51:39.381410+0000","last_peered":"2024-04-26T07:51:39.381410+0000","last_clean":"2024-04-26T07:51:39.381410+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:51:39.381410+0000","last_undegraded":"2024-04-26T07:51:39.381410+0000","last_fullsized":"2024-04-26T07:51:39.381410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379438+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:51:39.379438+0000","last_peered":"2024-04-26T07:51:39.379438+0000","last_clean":"2024-04-26T07:51:39.379438+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:51:39.379438+0000","last_undegraded":"2024-04-26T07:51:39.379438+0000","last_fullsized":"2024-04-26T07:51:39.379438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412119+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:39.412119+0000","last_peered":"2024-04-26T07:51:39.412119+0000","last_clean":"2024-04-26T07:51:39.412119+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:39.412119+0000","last_undegraded":"2024-04-26T07:51:39.412119+0000","last_fullsized":"2024-04-26T07:51:39.412119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407707+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:51:39.407707+0000","last_peered":"2024-04-26T07:51:39.407707+0000","last_clean":"2024-04-26T07:51:39.407707+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:51:39.407707+0000","last_undegraded":"2024-04-26T07:51:39.407707+0000","last_fullsized":"2024-04-26T07:51:39.407707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"89'25","reported_seq":208,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.056706+0000","last_change":"2024-04-26T07:50:53.981815+0000","last_active":"2024-04-26T07:51:38.056706+0000","last_peered":"2024-04-26T07:51:38.056706+0000","last_clean":"2024-04-26T07:51:38.056706+0000","last_became_active":"2024-04-26T07:50:53.981054+0000","last_became_peered":"2024-04-26T07:50:53.981054+0000","last_unstale":"2024-04-26T07:51:38.056706+0000","last_undegraded":"2024-04-26T07:51:38.056706+0000","last_fullsized":"2024-04-26T07:51:38.056706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:50.801176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.388088+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:51:39.388088+0000","last_peered":"2024-04-26T07:51:39.388088+0000","last_clean":"2024-04-26T07:51:39.388088+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:51:39.388088+0000","last_undegraded":"2024-04-26T07:51:39.388088+0000","last_fullsized":"2024-04-26T07:51:39.388088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"90'25","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.096867+0000","last_change":"2024-04-26T07:50:53.960437+0000","last_active":"2024-04-26T07:51:38.096867+0000","last_peered":"2024-04-26T07:51:38.096867+0000","last_clean":"2024-04-26T07:51:38.096867+0000","last_became_active":"2024-04-26T07:50:53.960163+0000","last_became_peered":"2024-04-26T07:50:53.960163+0000","last_unstale":"2024-04-26T07:51:38.096867+0000","last_undegraded":"2024-04-26T07:51:38.096867+0000","last_fullsized":"2024-04-26T07:51:38.096867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:09.908067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62803,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"90'134","reported_seq":345,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390378+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:51:39.390378+0000","last_peered":"2024-04-26T07:51:39.390378+0000","last_clean":"2024-04-26T07:51:39.390378+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:51:39.390378+0000","last_undegraded":"2024-04-26T07:51:39.390378+0000","last_fullsized":"2024-04-26T07:51:39.390378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392267+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:39.392267+0000","last_peered":"2024-04-26T07:51:39.392267+0000","last_clean":"2024-04-26T07:51:39.392267+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:39.392267+0000","last_undegraded":"2024-04-26T07:51:39.392267+0000","last_fullsized":"2024-04-26T07:51:39.392267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393052+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:39.393052+0000","last_peered":"2024-04-26T07:51:39.393052+0000","last_clean":"2024-04-26T07:51:39.393052+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:39.393052+0000","last_undegraded":"2024-04-26T07:51:39.393052+0000","last_fullsized":"2024-04-26T07:51:39.393052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401067+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:39.401067+0000","last_peered":"2024-04-26T07:51:39.401067+0000","last_clean":"2024-04-26T07:51:39.401067+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:39.401067+0000","last_undegraded":"2024-04-26T07:51:39.401067+0000","last_fullsized":"2024-04-26T07:51:39.401067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386484+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:51:39.386484+0000","last_peered":"2024-04-26T07:51:39.386484+0000","last_clean":"2024-04-26T07:51:39.386484+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:51:39.386484+0000","last_undegraded":"2024-04-26T07:51:39.386484+0000","last_fullsized":"2024-04-26T07:51:39.386484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'29","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391232+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:39.391232+0000","last_peered":"2024-04-26T07:51:39.391232+0000","last_clean":"2024-04-26T07:51:39.391232+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:39.391232+0000","last_undegraded":"2024-04-26T07:51:39.391232+0000","last_fullsized":"2024-04-26T07:51:39.391232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385638+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:51:39.385638+0000","last_peered":"2024-04-26T07:51:39.385638+0000","last_clean":"2024-04-26T07:51:39.385638+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:51:39.385638+0000","last_undegraded":"2024-04-26T07:51:39.385638+0000","last_fullsized":"2024-04-26T07:51:39.385638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":198,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373961+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:39.373961+0000","last_peered":"2024-04-26T07:51:39.373961+0000","last_clean":"2024-04-26T07:51:39.373961+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:39.373961+0000","last_undegraded":"2024-04-26T07:51:39.373961+0000","last_fullsized":"2024-04-26T07:51:39.373961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":240,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377873+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:39.377873+0000","last_peered":"2024-04-26T07:51:39.377873+0000","last_clean":"2024-04-26T07:51:39.377873+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:39.377873+0000","last_undegraded":"2024-04-26T07:51:39.377873+0000","last_fullsized":"2024-04-26T07:51:39.377873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380416+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:39.380416+0000","last_peered":"2024-04-26T07:51:39.380416+0000","last_clean":"2024-04-26T07:51:39.380416+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:39.380416+0000","last_undegraded":"2024-04-26T07:51:39.380416+0000","last_fullsized":"2024-04-26T07:51:39.380416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387388+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:51:39.387388+0000","last_peered":"2024-04-26T07:51:39.387388+0000","last_clean":"2024-04-26T07:51:39.387388+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:51:39.387388+0000","last_undegraded":"2024-04-26T07:51:39.387388+0000","last_fullsized":"2024-04-26T07:51:39.387388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"90'20","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379225+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:51:39.379225+0000","last_peered":"2024-04-26T07:51:39.379225+0000","last_clean":"2024-04-26T07:51:39.379225+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:51:39.379225+0000","last_undegraded":"2024-04-26T07:51:39.379225+0000","last_fullsized":"2024-04-26T07:51:39.379225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393340+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:51:39.393340+0000","last_peered":"2024-04-26T07:51:39.393340+0000","last_clean":"2024-04-26T07:51:39.393340+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:51:39.393340+0000","last_undegraded":"2024-04-26T07:51:39.393340+0000","last_fullsized":"2024-04-26T07:51:39.393340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377539+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:39.377539+0000","last_peered":"2024-04-26T07:51:39.377539+0000","last_clean":"2024-04-26T07:51:39.377539+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:39.377539+0000","last_undegraded":"2024-04-26T07:51:39.377539+0000","last_fullsized":"2024-04-26T07:51:39.377539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379014+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:39.379014+0000","last_peered":"2024-04-26T07:51:39.379014+0000","last_clean":"2024-04-26T07:51:39.379014+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:39.379014+0000","last_undegraded":"2024-04-26T07:51:39.379014+0000","last_fullsized":"2024-04-26T07:51:39.379014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'25","reported_seq":215,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407929+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:51:39.407929+0000","last_peered":"2024-04-26T07:51:39.407929+0000","last_clean":"2024-04-26T07:51:39.407929+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:51:39.407929+0000","last_undegraded":"2024-04-26T07:51:39.407929+0000","last_fullsized":"2024-04-26T07:51:39.407929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371914+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:51:39.371914+0000","last_peered":"2024-04-26T07:51:39.371914+0000","last_clean":"2024-04-26T07:51:39.371914+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:51:39.371914+0000","last_undegraded":"2024-04-26T07:51:39.371914+0000","last_fullsized":"2024-04-26T07:51:39.371914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"90'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392335+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:51:39.392335+0000","last_peered":"2024-04-26T07:51:39.392335+0000","last_clean":"2024-04-26T07:51:39.392335+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:51:39.392335+0000","last_undegraded":"2024-04-26T07:51:39.392335+0000","last_fullsized":"2024-04-26T07:51:39.392335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'134","reported_seq":362,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391679+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:51:39.391679+0000","last_peered":"2024-04-26T07:51:39.391679+0000","last_clean":"2024-04-26T07:51:39.391679+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:51:39.391679+0000","last_undegraded":"2024-04-26T07:51:39.391679+0000","last_fullsized":"2024-04-26T07:51:39.391679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371623+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:39.371623+0000","last_peered":"2024-04-26T07:51:39.371623+0000","last_clean":"2024-04-26T07:51:39.371623+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:39.371623+0000","last_undegraded":"2024-04-26T07:51:39.371623+0000","last_fullsized":"2024-04-26T07:51:39.371623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379771+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:51:39.379771+0000","last_peered":"2024-04-26T07:51:39.379771+0000","last_clean":"2024-04-26T07:51:39.379771+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:51:39.379771+0000","last_undegraded":"2024-04-26T07:51:39.379771+0000","last_fullsized":"2024-04-26T07:51:39.379771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"89'30","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377863+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:39.377863+0000","last_peered":"2024-04-26T07:51:39.377863+0000","last_clean":"2024-04-26T07:51:39.377863+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:39.377863+0000","last_undegraded":"2024-04-26T07:51:39.377863+0000","last_fullsized":"2024-04-26T07:51:39.377863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":361,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401426+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:51:39.401426+0000","last_peered":"2024-04-26T07:51:39.401426+0000","last_clean":"2024-04-26T07:51:39.401426+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:51:39.401426+0000","last_undegraded":"2024-04-26T07:51:39.401426+0000","last_fullsized":"2024-04-26T07:51:39.401426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.382757+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:51:39.382757+0000","last_peered":"2024-04-26T07:51:39.382757+0000","last_clean":"2024-04-26T07:51:39.382757+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:51:39.382757+0000","last_undegraded":"2024-04-26T07:51:39.382757+0000","last_fullsized":"2024-04-26T07:51:39.382757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'134","reported_seq":397,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412379+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:39.412379+0000","last_peered":"2024-04-26T07:51:39.412379+0000","last_clean":"2024-04-26T07:51:39.412379+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:39.412379+0000","last_undegraded":"2024-04-26T07:51:39.412379+0000","last_fullsized":"2024-04-26T07:51:39.412379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":176,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375424+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:39.375424+0000","last_peered":"2024-04-26T07:51:39.375424+0000","last_clean":"2024-04-26T07:51:39.375424+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:39.375424+0000","last_undegraded":"2024-04-26T07:51:39.375424+0000","last_fullsized":"2024-04-26T07:51:39.375424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":163,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384155+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:39.384155+0000","last_peered":"2024-04-26T07:51:39.384155+0000","last_clean":"2024-04-26T07:51:39.384155+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:39.384155+0000","last_undegraded":"2024-04-26T07:51:39.384155+0000","last_fullsized":"2024-04-26T07:51:39.384155+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378411+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:39.378411+0000","last_peered":"2024-04-26T07:51:39.378411+0000","last_clean":"2024-04-26T07:51:39.378411+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:39.378411+0000","last_undegraded":"2024-04-26T07:51:39.378411+0000","last_fullsized":"2024-04-26T07:51:39.378411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379506+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:51:39.379506+0000","last_peered":"2024-04-26T07:51:39.379506+0000","last_clean":"2024-04-26T07:51:39.379506+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:51:39.379506+0000","last_undegraded":"2024-04-26T07:51:39.379506+0000","last_fullsized":"2024-04-26T07:51:39.379506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"90'26","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396517+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:51:39.396517+0000","last_peered":"2024-04-26T07:51:39.396517+0000","last_clean":"2024-04-26T07:51:39.396517+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:51:39.396517+0000","last_undegraded":"2024-04-26T07:51:39.396517+0000","last_fullsized":"2024-04-26T07:51:39.396517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407447+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:39.407447+0000","last_peered":"2024-04-26T07:51:39.407447+0000","last_clean":"2024-04-26T07:51:39.407447+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:39.407447+0000","last_undegraded":"2024-04-26T07:51:39.407447+0000","last_fullsized":"2024-04-26T07:51:39.407447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372350+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:39.372350+0000","last_peered":"2024-04-26T07:51:39.372350+0000","last_clean":"2024-04-26T07:51:39.372350+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:39.372350+0000","last_undegraded":"2024-04-26T07:51:39.372350+0000","last_fullsized":"2024-04-26T07:51:39.372350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412425+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:51:39.412425+0000","last_peered":"2024-04-26T07:51:39.412425+0000","last_clean":"2024-04-26T07:51:39.412425+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:51:39.412425+0000","last_undegraded":"2024-04-26T07:51:39.412425+0000","last_fullsized":"2024-04-26T07:51:39.412425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.185797+0000","last_change":"2024-04-26T07:50:53.965294+0000","last_active":"2024-04-26T07:51:38.185797+0000","last_peered":"2024-04-26T07:51:38.185797+0000","last_clean":"2024-04-26T07:51:38.185797+0000","last_became_active":"2024-04-26T07:50:53.964427+0000","last_became_peered":"2024-04-26T07:50:53.964427+0000","last_unstale":"2024-04-26T07:51:38.185797+0000","last_undegraded":"2024-04-26T07:51:38.185797+0000","last_fullsized":"2024-04-26T07:51:38.185797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:24.027532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397877+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:39.397877+0000","last_peered":"2024-04-26T07:51:39.397877+0000","last_clean":"2024-04-26T07:51:39.397877+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:39.397877+0000","last_undegraded":"2024-04-26T07:51:39.397877+0000","last_fullsized":"2024-04-26T07:51:39.397877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380033+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:39.380033+0000","last_peered":"2024-04-26T07:51:39.380033+0000","last_clean":"2024-04-26T07:51:39.380033+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:39.380033+0000","last_undegraded":"2024-04-26T07:51:39.380033+0000","last_fullsized":"2024-04-26T07:51:39.380033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":53,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.098260+0000","last_change":"2024-04-26T07:50:53.963193+0000","last_active":"2024-04-26T07:51:38.098260+0000","last_peered":"2024-04-26T07:51:38.098260+0000","last_clean":"2024-04-26T07:51:38.098260+0000","last_became_active":"2024-04-26T07:50:53.962624+0000","last_became_peered":"2024-04-26T07:50:53.962624+0000","last_unstale":"2024-04-26T07:51:38.098260+0000","last_undegraded":"2024-04-26T07:51:38.098260+0000","last_fullsized":"2024-04-26T07:51:38.098260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:34.031661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"90'39","reported_seq":230,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401761+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:51:39.401761+0000","last_peered":"2024-04-26T07:51:39.401761+0000","last_clean":"2024-04-26T07:51:39.401761+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:51:39.401761+0000","last_undegraded":"2024-04-26T07:51:39.401761+0000","last_fullsized":"2024-04-26T07:51:39.401761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392535+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:51:39.392535+0000","last_peered":"2024-04-26T07:51:39.392535+0000","last_clean":"2024-04-26T07:51:39.392535+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:51:39.392535+0000","last_undegraded":"2024-04-26T07:51:39.392535+0000","last_fullsized":"2024-04-26T07:51:39.392535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406290+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:39.406290+0000","last_peered":"2024-04-26T07:51:39.406290+0000","last_clean":"2024-04-26T07:51:39.406290+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:39.406290+0000","last_undegraded":"2024-04-26T07:51:39.406290+0000","last_fullsized":"2024-04-26T07:51:39.406290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":229,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393641+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:51:39.393641+0000","last_peered":"2024-04-26T07:51:39.393641+0000","last_clean":"2024-04-26T07:51:39.393641+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:51:39.393641+0000","last_undegraded":"2024-04-26T07:51:39.393641+0000","last_fullsized":"2024-04-26T07:51:39.393641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.357609+0000","last_change":"2024-04-26T07:50:53.968724+0000","last_active":"2024-04-26T07:51:38.357609+0000","last_peered":"2024-04-26T07:51:38.357609+0000","last_clean":"2024-04-26T07:51:38.357609+0000","last_became_active":"2024-04-26T07:50:53.968282+0000","last_became_peered":"2024-04-26T07:50:53.968282+0000","last_unstale":"2024-04-26T07:51:38.357609+0000","last_undegraded":"2024-04-26T07:51:38.357609+0000","last_fullsized":"2024-04-26T07:51:38.357609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:32.175509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"89'20","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391341+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:39.391341+0000","last_peered":"2024-04-26T07:51:39.391341+0000","last_clean":"2024-04-26T07:51:39.391341+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:39.391341+0000","last_undegraded":"2024-04-26T07:51:39.391341+0000","last_fullsized":"2024-04-26T07:51:39.391341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.402965+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:39.402965+0000","last_peered":"2024-04-26T07:51:39.402965+0000","last_clean":"2024-04-26T07:51:39.402965+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:39.402965+0000","last_undegraded":"2024-04-26T07:51:39.402965+0000","last_fullsized":"2024-04-26T07:51:39.402965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'137","reported_seq":415,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371759+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:51:39.371759+0000","last_peered":"2024-04-26T07:51:39.371759+0000","last_clean":"2024-04-26T07:51:39.371759+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:51:39.371759+0000","last_undegraded":"2024-04-26T07:51:39.371759+0000","last_fullsized":"2024-04-26T07:51:39.371759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":54,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.098156+0000","last_change":"2024-04-26T07:50:53.962915+0000","last_active":"2024-04-26T07:51:38.098156+0000","last_peered":"2024-04-26T07:51:38.098156+0000","last_clean":"2024-04-26T07:51:38.098156+0000","last_became_active":"2024-04-26T07:50:53.962553+0000","last_became_peered":"2024-04-26T07:50:53.962553+0000","last_unstale":"2024-04-26T07:51:38.098156+0000","last_undegraded":"2024-04-26T07:51:38.098156+0000","last_fullsized":"2024-04-26T07:51:38.098156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:24.357622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370516+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:39.370516+0000","last_peered":"2024-04-26T07:51:39.370516+0000","last_clean":"2024-04-26T07:51:39.370516+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:39.370516+0000","last_undegraded":"2024-04-26T07:51:39.370516+0000","last_fullsized":"2024-04-26T07:51:39.370516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374300+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:51:39.374300+0000","last_peered":"2024-04-26T07:51:39.374300+0000","last_clean":"2024-04-26T07:51:39.374300+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:51:39.374300+0000","last_undegraded":"2024-04-26T07:51:39.374300+0000","last_fullsized":"2024-04-26T07:51:39.374300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385985+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:51:39.385985+0000","last_peered":"2024-04-26T07:51:39.385985+0000","last_clean":"2024-04-26T07:51:39.385985+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:51:39.385985+0000","last_undegraded":"2024-04-26T07:51:39.385985+0000","last_fullsized":"2024-04-26T07:51:39.385985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'26","reported_seq":216,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370330+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:39.370330+0000","last_peered":"2024-04-26T07:51:39.370330+0000","last_clean":"2024-04-26T07:51:39.370330+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:39.370330+0000","last_undegraded":"2024-04-26T07:51:39.370330+0000","last_fullsized":"2024-04-26T07:51:39.370330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":184,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391902+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:51:39.391902+0000","last_peered":"2024-04-26T07:51:39.391902+0000","last_clean":"2024-04-26T07:51:39.391902+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:51:39.391902+0000","last_undegraded":"2024-04-26T07:51:39.391902+0000","last_fullsized":"2024-04-26T07:51:39.391902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"85'16","reported_seq":104,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.556506+0000","last_change":"2024-04-26T07:50:53.973436+0000","last_active":"2024-04-26T07:51:38.556506+0000","last_peered":"2024-04-26T07:51:38.556506+0000","last_clean":"2024-04-26T07:51:38.556506+0000","last_became_active":"2024-04-26T07:50:53.972444+0000","last_became_peered":"2024-04-26T07:50:53.972444+0000","last_unstale":"2024-04-26T07:51:38.556506+0000","last_undegraded":"2024-04-26T07:51:38.556506+0000","last_fullsized":"2024-04-26T07:51:38.556506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:34.553163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.390613+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:51:39.390613+0000","last_peered":"2024-04-26T07:51:39.390613+0000","last_clean":"2024-04-26T07:51:39.390613+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:51:39.390613+0000","last_undegraded":"2024-04-26T07:51:39.390613+0000","last_fullsized":"2024-04-26T07:51:39.390613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381057+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:39.381057+0000","last_peered":"2024-04-26T07:51:39.381057+0000","last_clean":"2024-04-26T07:51:39.381057+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:39.381057+0000","last_undegraded":"2024-04-26T07:51:39.381057+0000","last_fullsized":"2024-04-26T07:51:39.381057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372050+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:51:39.372050+0000","last_peered":"2024-04-26T07:51:39.372050+0000","last_clean":"2024-04-26T07:51:39.372050+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:51:39.372050+0000","last_undegraded":"2024-04-26T07:51:39.372050+0000","last_fullsized":"2024-04-26T07:51:39.372050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401773+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:39.401773+0000","last_peered":"2024-04-26T07:51:39.401773+0000","last_clean":"2024-04-26T07:51:39.401773+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:39.401773+0000","last_undegraded":"2024-04-26T07:51:39.401773+0000","last_fullsized":"2024-04-26T07:51:39.401773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'20","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377573+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:39.377573+0000","last_peered":"2024-04-26T07:51:39.377573+0000","last_clean":"2024-04-26T07:51:39.377573+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:39.377573+0000","last_undegraded":"2024-04-26T07:51:39.377573+0000","last_fullsized":"2024-04-26T07:51:39.377573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389554+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:51:39.389554+0000","last_peered":"2024-04-26T07:51:39.389554+0000","last_clean":"2024-04-26T07:51:39.389554+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:51:39.389554+0000","last_undegraded":"2024-04-26T07:51:39.389554+0000","last_fullsized":"2024-04-26T07:51:39.389554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384109+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:39.384109+0000","last_peered":"2024-04-26T07:51:39.384109+0000","last_clean":"2024-04-26T07:51:39.384109+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:39.384109+0000","last_undegraded":"2024-04-26T07:51:39.384109+0000","last_fullsized":"2024-04-26T07:51:39.384109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412874+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:39.412874+0000","last_peered":"2024-04-26T07:51:39.412874+0000","last_clean":"2024-04-26T07:51:39.412874+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:39.412874+0000","last_undegraded":"2024-04-26T07:51:39.412874+0000","last_fullsized":"2024-04-26T07:51:39.412874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405058+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:39.405058+0000","last_peered":"2024-04-26T07:51:39.405058+0000","last_clean":"2024-04-26T07:51:39.405058+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:39.405058+0000","last_undegraded":"2024-04-26T07:51:39.405058+0000","last_fullsized":"2024-04-26T07:51:39.405058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371172+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:51:39.371172+0000","last_peered":"2024-04-26T07:51:39.371172+0000","last_clean":"2024-04-26T07:51:39.371172+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:51:39.371172+0000","last_undegraded":"2024-04-26T07:51:39.371172+0000","last_fullsized":"2024-04-26T07:51:39.371172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"88'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400610+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:39.400610+0000","last_peered":"2024-04-26T07:51:39.400610+0000","last_clean":"2024-04-26T07:51:39.400610+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:39.400610+0000","last_undegraded":"2024-04-26T07:51:39.400610+0000","last_fullsized":"2024-04-26T07:51:39.400610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372282+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:51:39.372282+0000","last_peered":"2024-04-26T07:51:39.372282+0000","last_clean":"2024-04-26T07:51:39.372282+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:51:39.372282+0000","last_undegraded":"2024-04-26T07:51:39.372282+0000","last_fullsized":"2024-04-26T07:51:39.372282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392473+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:51:39.392473+0000","last_peered":"2024-04-26T07:51:39.392473+0000","last_clean":"2024-04-26T07:51:39.392473+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:51:39.392473+0000","last_undegraded":"2024-04-26T07:51:39.392473+0000","last_fullsized":"2024-04-26T07:51:39.392473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"90'35","reported_seq":226,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389945+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:51:39.389945+0000","last_peered":"2024-04-26T07:51:39.389945+0000","last_clean":"2024-04-26T07:51:39.389945+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:51:39.389945+0000","last_undegraded":"2024-04-26T07:51:39.389945+0000","last_fullsized":"2024-04-26T07:51:39.389945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374284+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:39.374284+0000","last_peered":"2024-04-26T07:51:39.374284+0000","last_clean":"2024-04-26T07:51:39.374284+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:39.374284+0000","last_undegraded":"2024-04-26T07:51:39.374284+0000","last_fullsized":"2024-04-26T07:51:39.374284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389492+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:39.389492+0000","last_peered":"2024-04-26T07:51:39.389492+0000","last_clean":"2024-04-26T07:51:39.389492+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:39.389492+0000","last_undegraded":"2024-04-26T07:51:39.389492+0000","last_fullsized":"2024-04-26T07:51:39.389492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393090+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:51:39.393090+0000","last_peered":"2024-04-26T07:51:39.393090+0000","last_clean":"2024-04-26T07:51:39.393090+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:51:39.393090+0000","last_undegraded":"2024-04-26T07:51:39.393090+0000","last_fullsized":"2024-04-26T07:51:39.393090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372167+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:51:39.372167+0000","last_peered":"2024-04-26T07:51:39.372167+0000","last_clean":"2024-04-26T07:51:39.372167+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:51:39.372167+0000","last_undegraded":"2024-04-26T07:51:39.372167+0000","last_fullsized":"2024-04-26T07:51:39.372167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.186748+0000","last_change":"2024-04-26T07:50:53.967883+0000","last_active":"2024-04-26T07:51:38.186748+0000","last_peered":"2024-04-26T07:51:38.186748+0000","last_clean":"2024-04-26T07:51:38.186748+0000","last_became_active":"2024-04-26T07:50:53.967473+0000","last_became_peered":"2024-04-26T07:50:53.967473+0000","last_unstale":"2024-04-26T07:51:38.186748+0000","last_undegraded":"2024-04-26T07:51:38.186748+0000","last_fullsized":"2024-04-26T07:51:38.186748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:20.524401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407217+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:51:39.407217+0000","last_peered":"2024-04-26T07:51:39.407217+0000","last_clean":"2024-04-26T07:51:39.407217+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:51:39.407217+0000","last_undegraded":"2024-04-26T07:51:39.407217+0000","last_fullsized":"2024-04-26T07:51:39.407217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":200,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370492+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:39.370492+0000","last_peered":"2024-04-26T07:51:39.370492+0000","last_clean":"2024-04-26T07:51:39.370492+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:39.370492+0000","last_undegraded":"2024-04-26T07:51:39.370492+0000","last_fullsized":"2024-04-26T07:51:39.370492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'134","reported_seq":375,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405553+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:51:39.405553+0000","last_peered":"2024-04-26T07:51:39.405553+0000","last_clean":"2024-04-26T07:51:39.405553+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:51:39.405553+0000","last_undegraded":"2024-04-26T07:51:39.405553+0000","last_fullsized":"2024-04-26T07:51:39.405553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384142+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:39.384142+0000","last_peered":"2024-04-26T07:51:39.384142+0000","last_clean":"2024-04-26T07:51:39.384142+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:39.384142+0000","last_undegraded":"2024-04-26T07:51:39.384142+0000","last_fullsized":"2024-04-26T07:51:39.384142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377875+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:51:39.377875+0000","last_peered":"2024-04-26T07:51:39.377875+0000","last_clean":"2024-04-26T07:51:39.377875+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:51:39.377875+0000","last_undegraded":"2024-04-26T07:51:39.377875+0000","last_fullsized":"2024-04-26T07:51:39.377875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'19","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383860+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:39.383860+0000","last_peered":"2024-04-26T07:51:39.383860+0000","last_clean":"2024-04-26T07:51:39.383860+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:39.383860+0000","last_undegraded":"2024-04-26T07:51:39.383860+0000","last_fullsized":"2024-04-26T07:51:39.383860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373893+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:51:39.373893+0000","last_peered":"2024-04-26T07:51:39.373893+0000","last_clean":"2024-04-26T07:51:39.373893+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:51:39.373893+0000","last_undegraded":"2024-04-26T07:51:39.373893+0000","last_fullsized":"2024-04-26T07:51:39.373893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375376+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:39.375376+0000","last_peered":"2024-04-26T07:51:39.375376+0000","last_clean":"2024-04-26T07:51:39.375376+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:39.375376+0000","last_undegraded":"2024-04-26T07:51:39.375376+0000","last_fullsized":"2024-04-26T07:51:39.375376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375966+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:51:39.375966+0000","last_peered":"2024-04-26T07:51:39.375966+0000","last_clean":"2024-04-26T07:51:39.375966+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:51:39.375966+0000","last_undegraded":"2024-04-26T07:51:39.375966+0000","last_fullsized":"2024-04-26T07:51:39.375966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'134","reported_seq":347,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381796+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:51:39.381796+0000","last_peered":"2024-04-26T07:51:39.381796+0000","last_clean":"2024-04-26T07:51:39.381796+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:51:39.381796+0000","last_undegraded":"2024-04-26T07:51:39.381796+0000","last_fullsized":"2024-04-26T07:51:39.381796+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391088+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:39.391088+0000","last_peered":"2024-04-26T07:51:39.391088+0000","last_clean":"2024-04-26T07:51:39.391088+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:39.391088+0000","last_undegraded":"2024-04-26T07:51:39.391088+0000","last_fullsized":"2024-04-26T07:51:39.391088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":234,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375190+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:39.375190+0000","last_peered":"2024-04-26T07:51:39.375190+0000","last_clean":"2024-04-26T07:51:39.375190+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:39.375190+0000","last_undegraded":"2024-04-26T07:51:39.375190+0000","last_fullsized":"2024-04-26T07:51:39.375190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394463+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:39.394463+0000","last_peered":"2024-04-26T07:51:39.394463+0000","last_clean":"2024-04-26T07:51:39.394463+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:39.394463+0000","last_undegraded":"2024-04-26T07:51:39.394463+0000","last_fullsized":"2024-04-26T07:51:39.394463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.413288+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:51:39.413288+0000","last_peered":"2024-04-26T07:51:39.413288+0000","last_clean":"2024-04-26T07:51:39.413288+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:51:39.413288+0000","last_undegraded":"2024-04-26T07:51:39.413288+0000","last_fullsized":"2024-04-26T07:51:39.413288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377673+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:39.377673+0000","last_peered":"2024-04-26T07:51:39.377673+0000","last_clean":"2024-04-26T07:51:39.377673+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:39.377673+0000","last_undegraded":"2024-04-26T07:51:39.377673+0000","last_fullsized":"2024-04-26T07:51:39.377673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"90'44","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.555117+0000","last_change":"2024-04-26T07:50:53.973637+0000","last_active":"2024-04-26T07:51:38.555117+0000","last_peered":"2024-04-26T07:51:38.555117+0000","last_clean":"2024-04-26T07:51:38.555117+0000","last_became_active":"2024-04-26T07:50:53.972585+0000","last_became_peered":"2024-04-26T07:50:53.972585+0000","last_unstale":"2024-04-26T07:51:38.555117+0000","last_undegraded":"2024-04-26T07:51:38.555117+0000","last_fullsized":"2024-04-26T07:51:38.555117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:54.979556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379607+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:51:39.379607+0000","last_peered":"2024-04-26T07:51:39.379607+0000","last_clean":"2024-04-26T07:51:39.379607+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:51:39.379607+0000","last_undegraded":"2024-04-26T07:51:39.379607+0000","last_fullsized":"2024-04-26T07:51:39.379607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":177,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397667+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:39.397667+0000","last_peered":"2024-04-26T07:51:39.397667+0000","last_clean":"2024-04-26T07:51:39.397667+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:39.397667+0000","last_undegraded":"2024-04-26T07:51:39.397667+0000","last_fullsized":"2024-04-26T07:51:39.397667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392928+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:39.392928+0000","last_peered":"2024-04-26T07:51:39.392928+0000","last_clean":"2024-04-26T07:51:39.392928+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:39.392928+0000","last_undegraded":"2024-04-26T07:51:39.392928+0000","last_fullsized":"2024-04-26T07:51:39.392928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375375+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:51:39.375375+0000","last_peered":"2024-04-26T07:51:39.375375+0000","last_clean":"2024-04-26T07:51:39.375375+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:51:39.375375+0000","last_undegraded":"2024-04-26T07:51:39.375375+0000","last_fullsized":"2024-04-26T07:51:39.375375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"89'31","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377267+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:39.377267+0000","last_peered":"2024-04-26T07:51:39.377267+0000","last_clean":"2024-04-26T07:51:39.377267+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:39.377267+0000","last_undegraded":"2024-04-26T07:51:39.377267+0000","last_fullsized":"2024-04-26T07:51:39.377267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.371320+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:51:39.371320+0000","last_peered":"2024-04-26T07:51:39.371320+0000","last_clean":"2024-04-26T07:51:39.371320+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:51:39.371320+0000","last_undegraded":"2024-04-26T07:51:39.371320+0000","last_fullsized":"2024-04-26T07:51:39.371320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"90'19","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377783+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:51:39.377783+0000","last_peered":"2024-04-26T07:51:39.377783+0000","last_clean":"2024-04-26T07:51:39.377783+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:51:39.377783+0000","last_undegraded":"2024-04-26T07:51:39.377783+0000","last_fullsized":"2024-04-26T07:51:39.377783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.377604+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:51:39.377604+0000","last_peered":"2024-04-26T07:51:39.377604+0000","last_clean":"2024-04-26T07:51:39.377604+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:51:39.377604+0000","last_undegraded":"2024-04-26T07:51:39.377604+0000","last_fullsized":"2024-04-26T07:51:39.377604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":177,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380056+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:39.380056+0000","last_peered":"2024-04-26T07:51:39.380056+0000","last_clean":"2024-04-26T07:51:39.380056+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:39.380056+0000","last_undegraded":"2024-04-26T07:51:39.380056+0000","last_fullsized":"2024-04-26T07:51:39.380056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":186,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370943+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:51:39.370943+0000","last_peered":"2024-04-26T07:51:39.370943+0000","last_clean":"2024-04-26T07:51:39.370943+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:51:39.370943+0000","last_undegraded":"2024-04-26T07:51:39.370943+0000","last_fullsized":"2024-04-26T07:51:39.370943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'18","reported_seq":203,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.361166+0000","last_change":"2024-04-26T07:50:53.963894+0000","last_active":"2024-04-26T07:51:38.361166+0000","last_peered":"2024-04-26T07:51:38.361166+0000","last_clean":"2024-04-26T07:51:38.361166+0000","last_became_active":"2024-04-26T07:50:53.963007+0000","last_became_peered":"2024-04-26T07:50:53.963007+0000","last_unstale":"2024-04-26T07:51:38.361166+0000","last_undegraded":"2024-04-26T07:51:38.361166+0000","last_fullsized":"2024-04-26T07:51:38.361166+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:26.560585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":273,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380927+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:39.380927+0000","last_peered":"2024-04-26T07:51:39.380927+0000","last_clean":"2024-04-26T07:51:39.380927+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:39.380927+0000","last_undegraded":"2024-04-26T07:51:39.380927+0000","last_fullsized":"2024-04-26T07:51:39.380927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"101'10","reported_seq":189,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389777+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:51:39.389777+0000","last_peered":"2024-04-26T07:51:39.389777+0000","last_clean":"2024-04-26T07:51:39.389777+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:51:39.389777+0000","last_undegraded":"2024-04-26T07:51:39.389777+0000","last_fullsized":"2024-04-26T07:51:39.389777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":56,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.554776+0000","last_change":"2024-04-26T07:50:53.973397+0000","last_active":"2024-04-26T07:51:38.554776+0000","last_peered":"2024-04-26T07:51:38.554776+0000","last_clean":"2024-04-26T07:51:38.554776+0000","last_became_active":"2024-04-26T07:50:53.972614+0000","last_became_peered":"2024-04-26T07:50:53.972614+0000","last_unstale":"2024-04-26T07:51:38.554776+0000","last_undegraded":"2024-04-26T07:51:38.554776+0000","last_fullsized":"2024-04-26T07:51:38.554776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:21.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389427+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:39.389427+0000","last_peered":"2024-04-26T07:51:39.389427+0000","last_clean":"2024-04-26T07:51:39.389427+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:39.389427+0000","last_undegraded":"2024-04-26T07:51:39.389427+0000","last_fullsized":"2024-04-26T07:51:39.389427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379349+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:51:39.379349+0000","last_peered":"2024-04-26T07:51:39.379349+0000","last_clean":"2024-04-26T07:51:39.379349+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:51:39.379349+0000","last_undegraded":"2024-04-26T07:51:39.379349+0000","last_fullsized":"2024-04-26T07:51:39.379349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408423+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:39.408423+0000","last_peered":"2024-04-26T07:51:39.408423+0000","last_clean":"2024-04-26T07:51:39.408423+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:39.408423+0000","last_undegraded":"2024-04-26T07:51:39.408423+0000","last_fullsized":"2024-04-26T07:51:39.408423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":55,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.360898+0000","last_change":"2024-04-26T07:50:53.967849+0000","last_active":"2024-04-26T07:51:38.360898+0000","last_peered":"2024-04-26T07:51:38.360898+0000","last_clean":"2024-04-26T07:51:38.360898+0000","last_became_active":"2024-04-26T07:50:53.966926+0000","last_became_peered":"2024-04-26T07:50:53.966926+0000","last_unstale":"2024-04-26T07:51:38.360898+0000","last_undegraded":"2024-04-26T07:51:38.360898+0000","last_fullsized":"2024-04-26T07:51:38.360898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:54.861809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"90'20","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380656+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:51:39.380656+0000","last_peered":"2024-04-26T07:51:39.380656+0000","last_clean":"2024-04-26T07:51:39.380656+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:51:39.380656+0000","last_undegraded":"2024-04-26T07:51:39.380656+0000","last_fullsized":"2024-04-26T07:51:39.380656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407151+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:39.407151+0000","last_peered":"2024-04-26T07:51:39.407151+0000","last_clean":"2024-04-26T07:51:39.407151+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:39.407151+0000","last_undegraded":"2024-04-26T07:51:39.407151+0000","last_fullsized":"2024-04-26T07:51:39.407151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397451+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:39.397451+0000","last_peered":"2024-04-26T07:51:39.397451+0000","last_clean":"2024-04-26T07:51:39.397451+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:39.397451+0000","last_undegraded":"2024-04-26T07:51:39.397451+0000","last_fullsized":"2024-04-26T07:51:39.397451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378122+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:51:39.378122+0000","last_peered":"2024-04-26T07:51:39.378122+0000","last_clean":"2024-04-26T07:51:39.378122+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:51:39.378122+0000","last_undegraded":"2024-04-26T07:51:39.378122+0000","last_fullsized":"2024-04-26T07:51:39.378122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'25","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394144+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:39.394144+0000","last_peered":"2024-04-26T07:51:39.394144+0000","last_clean":"2024-04-26T07:51:39.394144+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:39.394144+0000","last_undegraded":"2024-04-26T07:51:39.394144+0000","last_fullsized":"2024-04-26T07:51:39.394144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.407013+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:51:39.407013+0000","last_peered":"2024-04-26T07:51:39.407013+0000","last_clean":"2024-04-26T07:51:39.407013+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:51:39.407013+0000","last_undegraded":"2024-04-26T07:51:39.407013+0000","last_fullsized":"2024-04-26T07:51:39.407013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"90'18","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.097250+0000","last_change":"2024-04-26T07:50:53.965258+0000","last_active":"2024-04-26T07:51:38.097250+0000","last_peered":"2024-04-26T07:51:38.097250+0000","last_clean":"2024-04-26T07:51:38.097250+0000","last_became_active":"2024-04-26T07:50:53.964570+0000","last_became_peered":"2024-04-26T07:50:53.964570+0000","last_unstale":"2024-04-26T07:51:38.097250+0000","last_undegraded":"2024-04-26T07:51:38.097250+0000","last_fullsized":"2024-04-26T07:51:38.097250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:00.227690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391695+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:51:39.391695+0000","last_peered":"2024-04-26T07:51:39.391695+0000","last_clean":"2024-04-26T07:51:39.391695+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:51:39.391695+0000","last_undegraded":"2024-04-26T07:51:39.391695+0000","last_fullsized":"2024-04-26T07:51:39.391695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.413295+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:51:39.413295+0000","last_peered":"2024-04-26T07:51:39.413295+0000","last_clean":"2024-04-26T07:51:39.413295+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:51:39.413295+0000","last_undegraded":"2024-04-26T07:51:39.413295+0000","last_fullsized":"2024-04-26T07:51:39.413295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'23","reported_seq":214,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378325+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:39.378325+0000","last_peered":"2024-04-26T07:51:39.378325+0000","last_clean":"2024-04-26T07:51:39.378325+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:39.378325+0000","last_undegraded":"2024-04-26T07:51:39.378325+0000","last_fullsized":"2024-04-26T07:51:39.378325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.394247+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:51:39.394247+0000","last_peered":"2024-04-26T07:51:39.394247+0000","last_clean":"2024-04-26T07:51:39.394247+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:51:39.394247+0000","last_undegraded":"2024-04-26T07:51:39.394247+0000","last_fullsized":"2024-04-26T07:51:39.394247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"90'29","reported_seq":218,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373437+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:51:39.373437+0000","last_peered":"2024-04-26T07:51:39.373437+0000","last_clean":"2024-04-26T07:51:39.373437+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:51:39.373437+0000","last_undegraded":"2024-04-26T07:51:39.373437+0000","last_fullsized":"2024-04-26T07:51:39.373437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397735+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:39.397735+0000","last_peered":"2024-04-26T07:51:39.397735+0000","last_clean":"2024-04-26T07:51:39.397735+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:39.397735+0000","last_undegraded":"2024-04-26T07:51:39.397735+0000","last_fullsized":"2024-04-26T07:51:39.397735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":175,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380112+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:39.380112+0000","last_peered":"2024-04-26T07:51:39.380112+0000","last_clean":"2024-04-26T07:51:39.380112+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:39.380112+0000","last_undegraded":"2024-04-26T07:51:39.380112+0000","last_fullsized":"2024-04-26T07:51:39.380112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":201,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393319+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:51:39.393319+0000","last_peered":"2024-04-26T07:51:39.393319+0000","last_clean":"2024-04-26T07:51:39.393319+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:51:39.393319+0000","last_undegraded":"2024-04-26T07:51:39.393319+0000","last_fullsized":"2024-04-26T07:51:39.393319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'16","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373938+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:51:39.373938+0000","last_peered":"2024-04-26T07:51:39.373938+0000","last_clean":"2024-04-26T07:51:39.373938+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:51:39.373938+0000","last_undegraded":"2024-04-26T07:51:39.373938+0000","last_fullsized":"2024-04-26T07:51:39.373938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412868+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:51:39.412868+0000","last_peered":"2024-04-26T07:51:39.412868+0000","last_clean":"2024-04-26T07:51:39.412868+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:51:39.412868+0000","last_undegraded":"2024-04-26T07:51:39.412868+0000","last_fullsized":"2024-04-26T07:51:39.412868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"90'25","reported_seq":162,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.401018+0000","last_change":"2024-04-26T07:51:39.401018+0000","last_active":"2024-04-26T07:51:39.401018+0000","last_peered":"2024-04-26T07:50:49.904013+0000","last_clean":"2024-04-26T07:50:49.904013+0000","last_became_active":"2024-04-26T07:48:27.577870+0000","last_became_peered":"2024-04-26T07:48:27.577870+0000","last_unstale":"2024-04-26T07:51:39.401018+0000","last_undegraded":"2024-04-26T07:51:39.401018+0000","last_fullsized":"2024-04-26T07:51:39.401018+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373623+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:39.373623+0000","last_peered":"2024-04-26T07:51:39.373623+0000","last_clean":"2024-04-26T07:51:39.373623+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:39.373623+0000","last_undegraded":"2024-04-26T07:51:39.373623+0000","last_fullsized":"2024-04-26T07:51:39.373623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":170,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406561+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:39.406561+0000","last_peered":"2024-04-26T07:51:39.406561+0000","last_clean":"2024-04-26T07:51:39.406561+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:39.406561+0000","last_undegraded":"2024-04-26T07:51:39.406561+0000","last_fullsized":"2024-04-26T07:51:39.406561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.380723+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:51:39.380723+0000","last_peered":"2024-04-26T07:51:39.380723+0000","last_clean":"2024-04-26T07:51:39.380723+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:51:39.380723+0000","last_undegraded":"2024-04-26T07:51:39.380723+0000","last_fullsized":"2024-04-26T07:51:39.380723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'31","reported_seq":221,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376544+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:39.376544+0000","last_peered":"2024-04-26T07:51:39.376544+0000","last_clean":"2024-04-26T07:51:39.376544+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:39.376544+0000","last_undegraded":"2024-04-26T07:51:39.376544+0000","last_fullsized":"2024-04-26T07:51:39.376544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378631+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:51:39.378631+0000","last_peered":"2024-04-26T07:51:39.378631+0000","last_clean":"2024-04-26T07:51:39.378631+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:51:39.378631+0000","last_undegraded":"2024-04-26T07:51:39.378631+0000","last_fullsized":"2024-04-26T07:51:39.378631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"90'19","reported_seq":206,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384277+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:51:39.384277+0000","last_peered":"2024-04-26T07:51:39.384277+0000","last_clean":"2024-04-26T07:51:39.384277+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:51:39.384277+0000","last_undegraded":"2024-04-26T07:51:39.384277+0000","last_fullsized":"2024-04-26T07:51:39.384277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373433+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:39.373433+0000","last_peered":"2024-04-26T07:51:39.373433+0000","last_clean":"2024-04-26T07:51:39.373433+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:39.373433+0000","last_undegraded":"2024-04-26T07:51:39.373433+0000","last_fullsized":"2024-04-26T07:51:39.373433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":169,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.399982+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:39.399982+0000","last_peered":"2024-04-26T07:51:39.399982+0000","last_clean":"2024-04-26T07:51:39.399982+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:39.399982+0000","last_undegraded":"2024-04-26T07:51:39.399982+0000","last_fullsized":"2024-04-26T07:51:39.399982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.387435+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:51:39.387435+0000","last_peered":"2024-04-26T07:51:39.387435+0000","last_clean":"2024-04-26T07:51:39.387435+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:51:39.387435+0000","last_undegraded":"2024-04-26T07:51:39.387435+0000","last_fullsized":"2024-04-26T07:51:39.387435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"88'18","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392037+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:39.392037+0000","last_peered":"2024-04-26T07:51:39.392037+0000","last_clean":"2024-04-26T07:51:39.392037+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:39.392037+0000","last_undegraded":"2024-04-26T07:51:39.392037+0000","last_fullsized":"2024-04-26T07:51:39.392037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374068+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:51:39.374068+0000","last_peered":"2024-04-26T07:51:39.374068+0000","last_clean":"2024-04-26T07:51:39.374068+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:51:39.374068+0000","last_undegraded":"2024-04-26T07:51:39.374068+0000","last_fullsized":"2024-04-26T07:51:39.374068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379379+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:51:39.379379+0000","last_peered":"2024-04-26T07:51:39.379379+0000","last_clean":"2024-04-26T07:51:39.379379+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:51:39.379379+0000","last_undegraded":"2024-04-26T07:51:39.379379+0000","last_fullsized":"2024-04-26T07:51:39.379379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'134","reported_seq":424,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.412386+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:51:39.412386+0000","last_peered":"2024-04-26T07:51:39.412386+0000","last_clean":"2024-04-26T07:51:39.412386+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:51:39.412386+0000","last_undegraded":"2024-04-26T07:51:39.412386+0000","last_fullsized":"2024-04-26T07:51:39.412386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":128,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.386998+0000","last_change":"2024-04-26T07:51:39.386998+0000","last_active":"2024-04-26T07:51:39.386998+0000","last_peered":"2024-04-26T07:50:49.902583+0000","last_clean":"2024-04-26T07:50:49.902583+0000","last_became_active":"2024-04-26T07:48:31.604886+0000","last_became_peered":"2024-04-26T07:48:31.604886+0000","last_unstale":"2024-04-26T07:51:39.386998+0000","last_undegraded":"2024-04-26T07:51:39.386998+0000","last_fullsized":"2024-04-26T07:51:39.386998+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375071+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:39.375071+0000","last_peered":"2024-04-26T07:51:39.375071+0000","last_clean":"2024-04-26T07:51:39.375071+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:39.375071+0000","last_undegraded":"2024-04-26T07:51:39.375071+0000","last_fullsized":"2024-04-26T07:51:39.375071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"89'14","reported_seq":147,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.386364+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:39.386364+0000","last_peered":"2024-04-26T07:51:39.386364+0000","last_clean":"2024-04-26T07:51:39.386364+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:39.386364+0000","last_undegraded":"2024-04-26T07:51:39.386364+0000","last_fullsized":"2024-04-26T07:51:39.386364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:16.352834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":132,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.383133+0000","last_change":"2024-04-26T07:50:52.952271+0000","last_active":"2024-04-26T07:48:24.527456+0000","last_peered":"2024-04-26T07:48:24.527456+0000","last_clean":"2024-04-26T07:48:24.527456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.383133+0000","last_undegraded":"2024-04-26T07:51:39.383133+0000","last_fullsized":"2024-04-26T07:51:39.383133+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"90'23","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400652+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:51:39.400652+0000","last_peered":"2024-04-26T07:51:39.400652+0000","last_clean":"2024-04-26T07:51:39.400652+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:51:39.400652+0000","last_undegraded":"2024-04-26T07:51:39.400652+0000","last_fullsized":"2024-04-26T07:51:39.400652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.388932+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:51:39.388932+0000","last_peered":"2024-04-26T07:51:39.388932+0000","last_clean":"2024-04-26T07:51:39.388932+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:51:39.388932+0000","last_undegraded":"2024-04-26T07:51:39.388932+0000","last_fullsized":"2024-04-26T07:51:39.388932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":124,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.408976+0000","last_change":"2024-04-26T07:51:39.408976+0000","last_active":"2024-04-26T07:51:39.408976+0000","last_peered":"2024-04-26T07:50:49.905210+0000","last_clean":"2024-04-26T07:50:49.905210+0000","last_became_active":"2024-04-26T07:48:31.597882+0000","last_became_peered":"2024-04-26T07:48:31.597882+0000","last_unstale":"2024-04-26T07:51:39.408976+0000","last_undegraded":"2024-04-26T07:51:39.408976+0000","last_fullsized":"2024-04-26T07:51:39.408976+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376230+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:51:39.376230+0000","last_peered":"2024-04-26T07:51:39.376230+0000","last_clean":"2024-04-26T07:51:39.376230+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:51:39.376230+0000","last_undegraded":"2024-04-26T07:51:39.376230+0000","last_fullsized":"2024-04-26T07:51:39.376230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"90'28","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.400325+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:51:39.400325+0000","last_peered":"2024-04-26T07:51:39.400325+0000","last_clean":"2024-04-26T07:51:39.400325+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:51:39.400325+0000","last_undegraded":"2024-04-26T07:51:39.400325+0000","last_fullsized":"2024-04-26T07:51:39.400325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":181,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397583+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:51:39.397583+0000","last_peered":"2024-04-26T07:51:39.397583+0000","last_clean":"2024-04-26T07:51:39.397583+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:51:39.397583+0000","last_undegraded":"2024-04-26T07:51:39.397583+0000","last_fullsized":"2024-04-26T07:51:39.397583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"90'18","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389206+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:39.389206+0000","last_peered":"2024-04-26T07:51:39.389206+0000","last_clean":"2024-04-26T07:51:39.389206+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:39.389206+0000","last_undegraded":"2024-04-26T07:51:39.389206+0000","last_fullsized":"2024-04-26T07:51:39.389206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406639+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:39.406639+0000","last_peered":"2024-04-26T07:51:39.406639+0000","last_clean":"2024-04-26T07:51:39.406639+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:39.406639+0000","last_undegraded":"2024-04-26T07:51:39.406639+0000","last_fullsized":"2024-04-26T07:51:39.406639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":171,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383761+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:39.383761+0000","last_peered":"2024-04-26T07:51:39.383761+0000","last_clean":"2024-04-26T07:51:39.383761+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:39.383761+0000","last_undegraded":"2024-04-26T07:51:39.383761+0000","last_fullsized":"2024-04-26T07:51:39.383761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379469+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:39.379469+0000","last_peered":"2024-04-26T07:51:39.379469+0000","last_clean":"2024-04-26T07:51:39.379469+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:39.379469+0000","last_undegraded":"2024-04-26T07:51:39.379469+0000","last_fullsized":"2024-04-26T07:51:39.379469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'27","reported_seq":161,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391787+0000","last_change":"2024-04-26T07:49:08.971107+0000","last_active":"2024-04-26T07:51:39.391787+0000","last_peered":"2024-04-26T07:51:39.391787+0000","last_clean":"2024-04-26T07:51:39.391787+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:51:39.391787+0000","last_undegraded":"2024-04-26T07:51:39.391787+0000","last_fullsized":"2024-04-26T07:51:39.391787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:06.980641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":182,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374176+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:39.374176+0000","last_peered":"2024-04-26T07:51:39.374176+0000","last_clean":"2024-04-26T07:51:39.374176+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:39.374176+0000","last_undegraded":"2024-04-26T07:51:39.374176+0000","last_fullsized":"2024-04-26T07:51:39.374176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"90'13","reported_seq":197,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381600+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:51:39.381600+0000","last_peered":"2024-04-26T07:51:39.381600+0000","last_clean":"2024-04-26T07:51:39.381600+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:51:39.381600+0000","last_undegraded":"2024-04-26T07:51:39.381600+0000","last_fullsized":"2024-04-26T07:51:39.381600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":174,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374528+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:39.374528+0000","last_peered":"2024-04-26T07:51:39.374528+0000","last_clean":"2024-04-26T07:51:39.374528+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:39.374528+0000","last_undegraded":"2024-04-26T07:51:39.374528+0000","last_fullsized":"2024-04-26T07:51:39.374528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":120,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-26T07:51:39.388033+0000","last_change":"2024-04-26T07:50:52.943695+0000","last_active":"2024-04-26T07:48:30.551424+0000","last_peered":"2024-04-26T07:48:30.551424+0000","last_clean":"2024-04-26T07:48:30.551424+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T07:51:39.388033+0000","last_undegraded":"2024-04-26T07:51:39.388033+0000","last_fullsized":"2024-04-26T07:51:39.388033+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":252,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374974+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:39.374974+0000","last_peered":"2024-04-26T07:51:39.374974+0000","last_clean":"2024-04-26T07:51:39.374974+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:39.374974+0000","last_undegraded":"2024-04-26T07:51:39.374974+0000","last_fullsized":"2024-04-26T07:51:39.374974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'25","reported_seq":219,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393997+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:39.393997+0000","last_peered":"2024-04-26T07:51:39.393997+0000","last_clean":"2024-04-26T07:51:39.393997+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:39.393997+0000","last_undegraded":"2024-04-26T07:51:39.393997+0000","last_fullsized":"2024-04-26T07:51:39.393997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:34.437375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":183,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.370649+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:51:39.370649+0000","last_peered":"2024-04-26T07:51:39.370649+0000","last_clean":"2024-04-26T07:51:39.370649+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:51:39.370649+0000","last_undegraded":"2024-04-26T07:51:39.370649+0000","last_fullsized":"2024-04-26T07:51:39.370649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"90'17","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375011+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:51:39.375011+0000","last_peered":"2024-04-26T07:51:39.375011+0000","last_clean":"2024-04-26T07:51:39.375011+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:51:39.375011+0000","last_undegraded":"2024-04-26T07:51:39.375011+0000","last_fullsized":"2024-04-26T07:51:39.375011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.391487+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:51:39.391487+0000","last_peered":"2024-04-26T07:51:39.391487+0000","last_clean":"2024-04-26T07:51:39.391487+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:39.391487+0000","last_undegraded":"2024-04-26T07:51:39.391487+0000","last_fullsized":"2024-04-26T07:51:39.391487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":173,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378701+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:39.378701+0000","last_peered":"2024-04-26T07:51:39.378701+0000","last_clean":"2024-04-26T07:51:39.378701+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:39.378701+0000","last_undegraded":"2024-04-26T07:51:39.378701+0000","last_fullsized":"2024-04-26T07:51:39.378701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":227,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.374241+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:51:39.374241+0000","last_peered":"2024-04-26T07:51:39.374241+0000","last_clean":"2024-04-26T07:51:39.374241+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:51:39.374241+0000","last_undegraded":"2024-04-26T07:51:39.374241+0000","last_fullsized":"2024-04-26T07:51:39.374241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406611+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:51:39.406611+0000","last_peered":"2024-04-26T07:51:39.406611+0000","last_clean":"2024-04-26T07:51:39.406611+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:51:39.406611+0000","last_undegraded":"2024-04-26T07:51:39.406611+0000","last_fullsized":"2024-04-26T07:51:39.406611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373707+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:51:39.373707+0000","last_peered":"2024-04-26T07:51:39.373707+0000","last_clean":"2024-04-26T07:51:39.373707+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:51:39.373707+0000","last_undegraded":"2024-04-26T07:51:39.373707+0000","last_fullsized":"2024-04-26T07:51:39.373707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'26","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.385843+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:51:39.385843+0000","last_peered":"2024-04-26T07:51:39.385843+0000","last_clean":"2024-04-26T07:51:39.385843+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:51:39.385843+0000","last_undegraded":"2024-04-26T07:51:39.385843+0000","last_fullsized":"2024-04-26T07:51:39.385843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.397011+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:51:39.397011+0000","last_peered":"2024-04-26T07:51:39.397011+0000","last_clean":"2024-04-26T07:51:39.397011+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:51:39.397011+0000","last_undegraded":"2024-04-26T07:51:39.397011+0000","last_fullsized":"2024-04-26T07:51:39.397011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"89'18","reported_seq":207,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401510+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:39.401510+0000","last_peered":"2024-04-26T07:51:39.401510+0000","last_clean":"2024-04-26T07:51:39.401510+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:39.401510+0000","last_undegraded":"2024-04-26T07:51:39.401510+0000","last_fullsized":"2024-04-26T07:51:39.401510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.372213+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:51:39.372213+0000","last_peered":"2024-04-26T07:51:39.372213+0000","last_clean":"2024-04-26T07:51:39.372213+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:51:39.372213+0000","last_undegraded":"2024-04-26T07:51:39.372213+0000","last_fullsized":"2024-04-26T07:51:39.372213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'23","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392390+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:39.392390+0000","last_peered":"2024-04-26T07:51:39.392390+0000","last_clean":"2024-04-26T07:51:39.392390+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:39.392390+0000","last_undegraded":"2024-04-26T07:51:39.392390+0000","last_fullsized":"2024-04-26T07:51:39.392390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":187,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.381281+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:51:39.381281+0000","last_peered":"2024-04-26T07:51:39.381281+0000","last_clean":"2024-04-26T07:51:39.381281+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:51:39.381281+0000","last_undegraded":"2024-04-26T07:51:39.381281+0000","last_fullsized":"2024-04-26T07:51:39.381281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'32","reported_seq":223,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.383336+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:39.383336+0000","last_peered":"2024-04-26T07:51:39.383336+0000","last_clean":"2024-04-26T07:51:39.383336+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:39.383336+0000","last_undegraded":"2024-04-26T07:51:39.383336+0000","last_fullsized":"2024-04-26T07:51:39.383336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.376481+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:51:39.376481+0000","last_peered":"2024-04-26T07:51:39.376481+0000","last_clean":"2024-04-26T07:51:39.376481+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:51:39.376481+0000","last_undegraded":"2024-04-26T07:51:39.376481+0000","last_fullsized":"2024-04-26T07:51:39.376481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"89'35","reported_seq":225,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.375268+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:39.375268+0000","last_peered":"2024-04-26T07:51:39.375268+0000","last_clean":"2024-04-26T07:51:39.375268+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:39.375268+0000","last_undegraded":"2024-04-26T07:51:39.375268+0000","last_fullsized":"2024-04-26T07:51:39.375268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":204,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379302+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:51:39.379302+0000","last_peered":"2024-04-26T07:51:39.379302+0000","last_clean":"2024-04-26T07:51:39.379302+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:51:39.379302+0000","last_undegraded":"2024-04-26T07:51:39.379302+0000","last_fullsized":"2024-04-26T07:51:39.379302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"89'23","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.411733+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:51:39.411733+0000","last_peered":"2024-04-26T07:51:39.411733+0000","last_clean":"2024-04-26T07:51:39.411733+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:51:39.411733+0000","last_undegraded":"2024-04-26T07:51:39.411733+0000","last_fullsized":"2024-04-26T07:51:39.411733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396261+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:51:39.396261+0000","last_peered":"2024-04-26T07:51:39.396261+0000","last_clean":"2024-04-26T07:51:39.396261+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:51:39.396261+0000","last_undegraded":"2024-04-26T07:51:39.396261+0000","last_fullsized":"2024-04-26T07:51:39.396261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'29","reported_seq":220,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.384030+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:39.384030+0000","last_peered":"2024-04-26T07:51:39.384030+0000","last_clean":"2024-04-26T07:51:39.384030+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:39.384030+0000","last_undegraded":"2024-04-26T07:51:39.384030+0000","last_fullsized":"2024-04-26T07:51:39.384030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":193,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393842+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:51:39.393842+0000","last_peered":"2024-04-26T07:51:39.393842+0000","last_clean":"2024-04-26T07:51:39.393842+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:51:39.393842+0000","last_undegraded":"2024-04-26T07:51:39.393842+0000","last_fullsized":"2024-04-26T07:51:39.393842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'24","reported_seq":213,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.406065+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:39.406065+0000","last_peered":"2024-04-26T07:51:39.406065+0000","last_clean":"2024-04-26T07:51:39.406065+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:39.406065+0000","last_undegraded":"2024-04-26T07:51:39.406065+0000","last_fullsized":"2024-04-26T07:51:39.406065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379645+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:51:39.379645+0000","last_peered":"2024-04-26T07:51:39.379645+0000","last_clean":"2024-04-26T07:51:39.379645+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:51:39.379645+0000","last_undegraded":"2024-04-26T07:51:39.379645+0000","last_fullsized":"2024-04-26T07:51:39.379645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'21","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.379508+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:39.379508+0000","last_peered":"2024-04-26T07:51:39.379508+0000","last_clean":"2024-04-26T07:51:39.379508+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:39.379508+0000","last_undegraded":"2024-04-26T07:51:39.379508+0000","last_fullsized":"2024-04-26T07:51:39.379508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":209,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389268+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:51:39.389268+0000","last_peered":"2024-04-26T07:51:39.389268+0000","last_clean":"2024-04-26T07:51:39.389268+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:51:39.389268+0000","last_undegraded":"2024-04-26T07:51:39.389268+0000","last_fullsized":"2024-04-26T07:51:39.389268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'14","reported_seq":203,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.401211+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:51:39.401211+0000","last_peered":"2024-04-26T07:51:39.401211+0000","last_clean":"2024-04-26T07:51:39.401211+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:51:39.401211+0000","last_undegraded":"2024-04-26T07:51:39.401211+0000","last_fullsized":"2024-04-26T07:51:39.401211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":194,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378331+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:51:39.378331+0000","last_peered":"2024-04-26T07:51:39.378331+0000","last_clean":"2024-04-26T07:51:39.378331+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:51:39.378331+0000","last_undegraded":"2024-04-26T07:51:39.378331+0000","last_fullsized":"2024-04-26T07:51:39.378331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'27","reported_seq":217,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392576+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:39.392576+0000","last_peered":"2024-04-26T07:51:39.392576+0000","last_clean":"2024-04-26T07:51:39.392576+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:39.392576+0000","last_undegraded":"2024-04-26T07:51:39.392576+0000","last_fullsized":"2024-04-26T07:51:39.392576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":147,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.360637+0000","last_change":"2024-04-26T07:50:53.964033+0000","last_active":"2024-04-26T07:51:38.360637+0000","last_peered":"2024-04-26T07:51:38.360637+0000","last_clean":"2024-04-26T07:51:38.360637+0000","last_became_active":"2024-04-26T07:50:53.963208+0000","last_became_peered":"2024-04-26T07:50:53.963208+0000","last_unstale":"2024-04-26T07:51:38.360637+0000","last_undegraded":"2024-04-26T07:51:38.360637+0000","last_fullsized":"2024-04-26T07:51:38.360637+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:39.310959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"89'21","reported_seq":211,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.408368+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:39.408368+0000","last_peered":"2024-04-26T07:51:39.408368+0000","last_clean":"2024-04-26T07:51:39.408368+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:39.408368+0000","last_undegraded":"2024-04-26T07:51:39.408368+0000","last_fullsized":"2024-04-26T07:51:39.408368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":202,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.389677+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:51:39.389677+0000","last_peered":"2024-04-26T07:51:39.389677+0000","last_clean":"2024-04-26T07:51:39.389677+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:51:39.389677+0000","last_undegraded":"2024-04-26T07:51:39.389677+0000","last_fullsized":"2024-04-26T07:51:39.389677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'27","reported_seq":211,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.099005+0000","last_change":"2024-04-26T07:50:53.969078+0000","last_active":"2024-04-26T07:51:38.099005+0000","last_peered":"2024-04-26T07:51:38.099005+0000","last_clean":"2024-04-26T07:51:38.099005+0000","last_became_active":"2024-04-26T07:50:53.968768+0000","last_became_peered":"2024-04-26T07:50:53.968768+0000","last_unstale":"2024-04-26T07:51:38.099005+0000","last_undegraded":"2024-04-26T07:51:38.099005+0000","last_fullsized":"2024-04-26T07:51:38.099005+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:53.217128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":195,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.378100+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:51:39.378100+0000","last_peered":"2024-04-26T07:51:39.378100+0000","last_clean":"2024-04-26T07:51:39.378100+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:51:39.378100+0000","last_undegraded":"2024-04-26T07:51:39.378100+0000","last_fullsized":"2024-04-26T07:51:39.378100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"89'32","reported_seq":223,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.392389+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:51:39.392389+0000","last_peered":"2024-04-26T07:51:39.392389+0000","last_clean":"2024-04-26T07:51:39.392389+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:51:39.392389+0000","last_undegraded":"2024-04-26T07:51:39.392389+0000","last_fullsized":"2024-04-26T07:51:39.392389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":164,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-26T07:51:38.359917+0000","last_change":"2024-04-26T07:50:53.947377+0000","last_active":"2024-04-26T07:51:38.359917+0000","last_peered":"2024-04-26T07:51:38.359917+0000","last_clean":"2024-04-26T07:51:38.359917+0000","last_became_active":"2024-04-26T07:50:53.946376+0000","last_became_peered":"2024-04-26T07:50:53.946376+0000","last_unstale":"2024-04-26T07:51:38.359917+0000","last_undegraded":"2024-04-26T07:51:38.359917+0000","last_fullsized":"2024-04-26T07:51:38.359917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:38.286898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"89'22","reported_seq":212,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.403358+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:39.403358+0000","last_peered":"2024-04-26T07:51:39.403358+0000","last_clean":"2024-04-26T07:51:39.403358+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:39.403358+0000","last_undegraded":"2024-04-26T07:51:39.403358+0000","last_fullsized":"2024-04-26T07:51:39.403358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"89'21","reported_seq":210,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.405844+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:39.405844+0000","last_peered":"2024-04-26T07:51:39.405844+0000","last_clean":"2024-04-26T07:51:39.405844+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:39.405844+0000","last_undegraded":"2024-04-26T07:51:39.405844+0000","last_fullsized":"2024-04-26T07:51:39.405844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":185,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.393607+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:51:39.393607+0000","last_peered":"2024-04-26T07:51:39.393607+0000","last_clean":"2024-04-26T07:51:39.393607+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:51:39.393607+0000","last_undegraded":"2024-04-26T07:51:39.393607+0000","last_fullsized":"2024-04-26T07:51:39.393607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'29","reported_seq":219,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.373428+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:51:39.373428+0000","last_peered":"2024-04-26T07:51:39.373428+0000","last_clean":"2024-04-26T07:51:39.373428+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:51:39.373428+0000","last_undegraded":"2024-04-26T07:51:39.373428+0000","last_fullsized":"2024-04-26T07:51:39.373428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":198,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T07:51:39.396985+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:51:39.396985+0000","last_peered":"2024-04-26T07:51:39.396985+0000","last_clean":"2024-04-26T07:51:39.396985+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:51:39.396985+0000","last_undegraded":"2024-04-26T07:51:39.396985+0000","last_fullsized":"2024-04-26T07:51:39.396985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1073,"ondisk_log_size":1073,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":850,"num_read_kb":615,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1467,"num_read_kb":1435,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716652,"kb_used_data":1685468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92655188,"statfs":{"total":96636764160,"available":94878912512,"internally_reserved":0,"allocated":1725919232,"data_stored":1725325760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203980,"kb_used_data":1172800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93167860,"statfs":{"total":96636764160,"available":95403888640,"internally_reserved":0,"allocated":1200947200,"data_stored":1200387469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1808360,"kb_used_data":1777180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92563480,"statfs":{"total":96636764160,"available":94785003520,"internally_reserved":0,"allocated":1819832320,"data_stored":1819224899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1935044,"kb_used_data":1903864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92436796,"statfs":{"total":96636764160,"available":94655279104,"internally_reserved":0,"allocated":1949556736,"data_stored":1949012579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1877928,"kb_used_data":1842588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92493912,"statfs":{"total":96636764160,"available":94713765888,"internally_reserved":0,"allocated":1886810112,"data_stored":1886217956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1122108,"kb_used_data":1086760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93249732,"statfs":{"total":96636764160,"available":95487725568,"internally_reserved":0,"allocated":1112842240,"data_stored":1112299854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185692,"kb_used_data":1150352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93186148,"statfs":{"total":96636764160,"available":95422615552,"internally_reserved":0,"allocated":1177960448,"data_stored":1177379431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1732968,"kb_used_data":1697624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92638872,"statfs":{"total":96636764160,"available":94862204928,"internally_reserved":0,"allocated":1738366976,"data_stored":1737792724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1736441856,"data_stored":1736441856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1176502272,"data_stored":1176502272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1885339648,"data_stored":1885339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1948254208,"data_stored":1948254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1199570944,"data_stored":1199570944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1723858944,"data_stored":1723858944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":118389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:51:48.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:51:48.556 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:48.563 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:51:48.573 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2024-04-26T07:51:47.851525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3285,"num_read_kb":2974,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12587024,"kb_used_data":12316744,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":742387696,"statfs":{"total":773094113280,"available":760205000704,"internally_reserved":0,"allocated":12612345856,"data_stored":12607711304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.482744"},"pg_stats":[{"pgid":"3.3f","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.419563+0000","last_change":"2024-04-26T07:51:40.419563+0000","last_active":"2024-04-26T07:51:40.419563+0000","last_peered":"2024-04-26T07:51:40.419563+0000","last_clean":"2024-04-26T07:51:40.419563+0000","last_became_active":"2024-04-26T07:51:40.418691+0000","last_became_peered":"2024-04-26T07:51:40.418691+0000","last_unstale":"2024-04-26T07:51:40.419563+0000","last_undegraded":"2024-04-26T07:51:40.419563+0000","last_fullsized":"2024-04-26T07:51:40.419563+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:26.560585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410032+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:51:40.410032+0000","last_peered":"2024-04-26T07:51:40.410032+0000","last_clean":"2024-04-26T07:51:40.410032+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:51:40.410032+0000","last_undegraded":"2024-04-26T07:51:40.410032+0000","last_fullsized":"2024-04-26T07:51:40.410032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'26","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410817+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:51:40.410817+0000","last_peered":"2024-04-26T07:51:40.410817+0000","last_clean":"2024-04-26T07:51:40.410817+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:51:40.410817+0000","last_undegraded":"2024-04-26T07:51:40.410817+0000","last_fullsized":"2024-04-26T07:51:40.410817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":144,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.439485+0000","last_change":"2024-04-26T07:51:40.439485+0000","last_active":"2024-04-26T07:51:40.439485+0000","last_peered":"2024-04-26T07:51:40.439485+0000","last_clean":"2024-04-26T07:51:40.439485+0000","last_became_active":"2024-04-26T07:51:40.437448+0000","last_became_peered":"2024-04-26T07:51:40.437448+0000","last_unstale":"2024-04-26T07:51:40.439485+0000","last_undegraded":"2024-04-26T07:51:40.439485+0000","last_fullsized":"2024-04-26T07:51:40.439485+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:31.108593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387511+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:40.387511+0000","last_peered":"2024-04-26T07:51:40.387511+0000","last_clean":"2024-04-26T07:51:40.387511+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:40.387511+0000","last_undegraded":"2024-04-26T07:51:40.387511+0000","last_fullsized":"2024-04-26T07:51:40.387511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":226,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400767+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:51:40.400767+0000","last_peered":"2024-04-26T07:51:40.400767+0000","last_clean":"2024-04-26T07:51:40.400767+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:51:40.400767+0000","last_undegraded":"2024-04-26T07:51:40.400767+0000","last_fullsized":"2024-04-26T07:51:40.400767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414495+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:40.414495+0000","last_peered":"2024-04-26T07:51:40.414495+0000","last_clean":"2024-04-26T07:51:40.414495+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:40.414495+0000","last_undegraded":"2024-04-26T07:51:40.414495+0000","last_fullsized":"2024-04-26T07:51:40.414495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387443+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:40.387443+0000","last_peered":"2024-04-26T07:51:40.387443+0000","last_clean":"2024-04-26T07:51:40.387443+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:40.387443+0000","last_undegraded":"2024-04-26T07:51:40.387443+0000","last_fullsized":"2024-04-26T07:51:40.387443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'23","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435742+0000","last_change":"2024-04-26T07:51:40.435742+0000","last_active":"2024-04-26T07:51:40.435742+0000","last_peered":"2024-04-26T07:51:40.435742+0000","last_clean":"2024-04-26T07:51:40.435742+0000","last_became_active":"2024-04-26T07:51:40.433215+0000","last_became_peered":"2024-04-26T07:51:40.433215+0000","last_unstale":"2024-04-26T07:51:40.435742+0000","last_undegraded":"2024-04-26T07:51:40.435742+0000","last_fullsized":"2024-04-26T07:51:40.435742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:42.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411494+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:51:40.411494+0000","last_peered":"2024-04-26T07:51:40.411494+0000","last_clean":"2024-04-26T07:51:40.411494+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:51:40.411494+0000","last_undegraded":"2024-04-26T07:51:40.411494+0000","last_fullsized":"2024-04-26T07:51:40.411494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'22","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413726+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:51:40.413726+0000","last_peered":"2024-04-26T07:51:40.413726+0000","last_clean":"2024-04-26T07:51:40.413726+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:51:40.413726+0000","last_undegraded":"2024-04-26T07:51:40.413726+0000","last_fullsized":"2024-04-26T07:51:40.413726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396370+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:51:40.396370+0000","last_peered":"2024-04-26T07:51:40.396370+0000","last_clean":"2024-04-26T07:51:40.396370+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:51:40.396370+0000","last_undegraded":"2024-04-26T07:51:40.396370+0000","last_fullsized":"2024-04-26T07:51:40.396370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'19","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429122+0000","last_change":"2024-04-26T07:51:40.429122+0000","last_active":"2024-04-26T07:51:40.429122+0000","last_peered":"2024-04-26T07:51:40.429122+0000","last_clean":"2024-04-26T07:51:40.429122+0000","last_became_active":"2024-04-26T07:51:40.428267+0000","last_became_peered":"2024-04-26T07:51:40.428267+0000","last_unstale":"2024-04-26T07:51:40.429122+0000","last_undegraded":"2024-04-26T07:51:40.429122+0000","last_fullsized":"2024-04-26T07:51:40.429122+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.892584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414674+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:51:40.414674+0000","last_peered":"2024-04-26T07:51:40.414674+0000","last_clean":"2024-04-26T07:51:40.414674+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:51:40.414674+0000","last_undegraded":"2024-04-26T07:51:40.414674+0000","last_fullsized":"2024-04-26T07:51:40.414674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"89'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390795+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:40.390795+0000","last_peered":"2024-04-26T07:51:40.390795+0000","last_clean":"2024-04-26T07:51:40.390795+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:40.390795+0000","last_undegraded":"2024-04-26T07:51:40.390795+0000","last_fullsized":"2024-04-26T07:51:40.390795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399387+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:51:40.399387+0000","last_peered":"2024-04-26T07:51:40.399387+0000","last_clean":"2024-04-26T07:51:40.399387+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:51:40.399387+0000","last_undegraded":"2024-04-26T07:51:40.399387+0000","last_fullsized":"2024-04-26T07:51:40.399387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395530+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:51:40.395530+0000","last_peered":"2024-04-26T07:51:40.395530+0000","last_clean":"2024-04-26T07:51:40.395530+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:51:40.395530+0000","last_undegraded":"2024-04-26T07:51:40.395530+0000","last_fullsized":"2024-04-26T07:51:40.395530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'25","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429380+0000","last_change":"2024-04-26T07:51:40.429380+0000","last_active":"2024-04-26T07:51:40.429380+0000","last_peered":"2024-04-26T07:51:40.429380+0000","last_clean":"2024-04-26T07:51:40.429380+0000","last_became_active":"2024-04-26T07:51:40.428461+0000","last_became_peered":"2024-04-26T07:51:40.428461+0000","last_unstale":"2024-04-26T07:51:40.429380+0000","last_undegraded":"2024-04-26T07:51:40.429380+0000","last_fullsized":"2024-04-26T07:51:40.429380+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.386208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437638+0000","last_change":"2024-04-26T07:51:40.437638+0000","last_active":"2024-04-26T07:51:40.437638+0000","last_peered":"2024-04-26T07:51:40.437638+0000","last_clean":"2024-04-26T07:51:40.437638+0000","last_became_active":"2024-04-26T07:51:40.435585+0000","last_became_peered":"2024-04-26T07:51:40.435585+0000","last_unstale":"2024-04-26T07:51:40.437638+0000","last_undegraded":"2024-04-26T07:51:40.437638+0000","last_fullsized":"2024-04-26T07:51:40.437638+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:03.283810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'31","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412304+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:51:40.412304+0000","last_peered":"2024-04-26T07:51:40.412304+0000","last_clean":"2024-04-26T07:51:40.412304+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:51:40.412304+0000","last_undegraded":"2024-04-26T07:51:40.412304+0000","last_fullsized":"2024-04-26T07:51:40.412304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":41,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413895+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:51:40.413895+0000","last_peered":"2024-04-26T07:51:40.413895+0000","last_clean":"2024-04-26T07:51:40.413895+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:51:40.413895+0000","last_undegraded":"2024-04-26T07:51:40.413895+0000","last_fullsized":"2024-04-26T07:51:40.413895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412401+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:51:40.412401+0000","last_peered":"2024-04-26T07:51:40.412401+0000","last_clean":"2024-04-26T07:51:40.412401+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:51:40.412401+0000","last_undegraded":"2024-04-26T07:51:40.412401+0000","last_fullsized":"2024-04-26T07:51:40.412401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401519+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:51:40.401519+0000","last_peered":"2024-04-26T07:51:40.401519+0000","last_clean":"2024-04-26T07:51:40.401519+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:51:40.401519+0000","last_undegraded":"2024-04-26T07:51:40.401519+0000","last_fullsized":"2024-04-26T07:51:40.401519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'24","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397971+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:40.397971+0000","last_peered":"2024-04-26T07:51:40.397971+0000","last_clean":"2024-04-26T07:51:40.397971+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:40.397971+0000","last_undegraded":"2024-04-26T07:51:40.397971+0000","last_fullsized":"2024-04-26T07:51:40.397971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399756+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:51:40.399756+0000","last_peered":"2024-04-26T07:51:40.399756+0000","last_clean":"2024-04-26T07:51:40.399756+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:51:40.399756+0000","last_undegraded":"2024-04-26T07:51:40.399756+0000","last_fullsized":"2024-04-26T07:51:40.399756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392181+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:40.392181+0000","last_peered":"2024-04-26T07:51:40.392181+0000","last_clean":"2024-04-26T07:51:40.392181+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:40.392181+0000","last_undegraded":"2024-04-26T07:51:40.392181+0000","last_fullsized":"2024-04-26T07:51:40.392181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396627+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:51:40.396627+0000","last_peered":"2024-04-26T07:51:40.396627+0000","last_clean":"2024-04-26T07:51:40.396627+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:51:40.396627+0000","last_undegraded":"2024-04-26T07:51:40.396627+0000","last_fullsized":"2024-04-26T07:51:40.396627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"90'24","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386874+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:40.386874+0000","last_peered":"2024-04-26T07:51:40.386874+0000","last_clean":"2024-04-26T07:51:40.386874+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:40.386874+0000","last_undegraded":"2024-04-26T07:51:40.386874+0000","last_fullsized":"2024-04-26T07:51:40.386874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394620+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:40.394620+0000","last_peered":"2024-04-26T07:51:40.394620+0000","last_clean":"2024-04-26T07:51:40.394620+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:40.394620+0000","last_undegraded":"2024-04-26T07:51:40.394620+0000","last_fullsized":"2024-04-26T07:51:40.394620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393414+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:40.393414+0000","last_peered":"2024-04-26T07:51:40.393414+0000","last_clean":"2024-04-26T07:51:40.393414+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:40.393414+0000","last_undegraded":"2024-04-26T07:51:40.393414+0000","last_fullsized":"2024-04-26T07:51:40.393414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'19","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401423+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:40.401423+0000","last_peered":"2024-04-26T07:51:40.401423+0000","last_clean":"2024-04-26T07:51:40.401423+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:40.401423+0000","last_undegraded":"2024-04-26T07:51:40.401423+0000","last_fullsized":"2024-04-26T07:51:40.401423+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:08.704021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414398+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:40.414398+0000","last_peered":"2024-04-26T07:51:40.414398+0000","last_clean":"2024-04-26T07:51:40.414398+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:40.414398+0000","last_undegraded":"2024-04-26T07:51:40.414398+0000","last_fullsized":"2024-04-26T07:51:40.414398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"90'17","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387664+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:40.387664+0000","last_peered":"2024-04-26T07:51:40.387664+0000","last_clean":"2024-04-26T07:51:40.387664+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:40.387664+0000","last_undegraded":"2024-04-26T07:51:40.387664+0000","last_fullsized":"2024-04-26T07:51:40.387664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427384+0000","last_change":"2024-04-26T07:51:40.427384+0000","last_active":"2024-04-26T07:51:40.427384+0000","last_peered":"2024-04-26T07:51:40.427384+0000","last_clean":"2024-04-26T07:51:40.427384+0000","last_became_active":"2024-04-26T07:51:40.424563+0000","last_became_peered":"2024-04-26T07:51:40.424563+0000","last_unstale":"2024-04-26T07:51:40.427384+0000","last_undegraded":"2024-04-26T07:51:40.427384+0000","last_fullsized":"2024-04-26T07:51:40.427384+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:45.363785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409995+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:40.409995+0000","last_peered":"2024-04-26T07:51:40.409995+0000","last_clean":"2024-04-26T07:51:40.409995+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:40.409995+0000","last_undegraded":"2024-04-26T07:51:40.409995+0000","last_fullsized":"2024-04-26T07:51:40.409995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415011+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:51:40.415011+0000","last_peered":"2024-04-26T07:51:40.415011+0000","last_clean":"2024-04-26T07:51:40.415011+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:51:40.415011+0000","last_undegraded":"2024-04-26T07:51:40.415011+0000","last_fullsized":"2024-04-26T07:51:40.415011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386993+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:40.386993+0000","last_peered":"2024-04-26T07:51:40.386993+0000","last_clean":"2024-04-26T07:51:40.386993+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:40.386993+0000","last_undegraded":"2024-04-26T07:51:40.386993+0000","last_fullsized":"2024-04-26T07:51:40.386993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393282+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:40.393282+0000","last_peered":"2024-04-26T07:51:40.393282+0000","last_clean":"2024-04-26T07:51:40.393282+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:40.393282+0000","last_undegraded":"2024-04-26T07:51:40.393282+0000","last_fullsized":"2024-04-26T07:51:40.393282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"53'7","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397138+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:51:40.397138+0000","last_peered":"2024-04-26T07:51:40.397138+0000","last_clean":"2024-04-26T07:51:40.397138+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:51:40.397138+0000","last_undegraded":"2024-04-26T07:51:40.397138+0000","last_fullsized":"2024-04-26T07:51:40.397138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396318+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:40.396318+0000","last_peered":"2024-04-26T07:51:40.396318+0000","last_clean":"2024-04-26T07:51:40.396318+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:40.396318+0000","last_undegraded":"2024-04-26T07:51:40.396318+0000","last_fullsized":"2024-04-26T07:51:40.396318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386651+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:51:40.386651+0000","last_peered":"2024-04-26T07:51:40.386651+0000","last_clean":"2024-04-26T07:51:40.386651+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:51:40.386651+0000","last_undegraded":"2024-04-26T07:51:40.386651+0000","last_fullsized":"2024-04-26T07:51:40.386651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388934+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:51:40.388934+0000","last_peered":"2024-04-26T07:51:40.388934+0000","last_clean":"2024-04-26T07:51:40.388934+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:51:40.388934+0000","last_undegraded":"2024-04-26T07:51:40.388934+0000","last_fullsized":"2024-04-26T07:51:40.388934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'22","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441938+0000","last_change":"2024-04-26T07:51:40.441938+0000","last_active":"2024-04-26T07:51:40.441938+0000","last_peered":"2024-04-26T07:51:40.441938+0000","last_clean":"2024-04-26T07:51:40.441938+0000","last_became_active":"2024-04-26T07:51:40.440255+0000","last_became_peered":"2024-04-26T07:51:40.440255+0000","last_unstale":"2024-04-26T07:51:40.441938+0000","last_undegraded":"2024-04-26T07:51:40.441938+0000","last_fullsized":"2024-04-26T07:51:40.441938+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:49.106793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394846+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:40.394846+0000","last_peered":"2024-04-26T07:51:40.394846+0000","last_clean":"2024-04-26T07:51:40.394846+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:40.394846+0000","last_undegraded":"2024-04-26T07:51:40.394846+0000","last_fullsized":"2024-04-26T07:51:40.394846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399562+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:51:40.399562+0000","last_peered":"2024-04-26T07:51:40.399562+0000","last_clean":"2024-04-26T07:51:40.399562+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:51:40.399562+0000","last_undegraded":"2024-04-26T07:51:40.399562+0000","last_fullsized":"2024-04-26T07:51:40.399562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"109'136","reported_seq":309,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.448594+0000","last_change":"2024-04-26T07:51:40.446383+0000","last_active":"2024-04-26T07:51:40.448594+0000","last_peered":"2024-04-26T07:51:40.448594+0000","last_clean":"2024-04-26T07:51:40.448594+0000","last_became_active":"2024-04-26T07:51:40.439601+0000","last_became_peered":"2024-04-26T07:51:40.439601+0000","last_unstale":"2024-04-26T07:51:40.448594+0000","last_undegraded":"2024-04-26T07:51:40.448594+0000","last_fullsized":"2024-04-26T07:51:40.448594+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:32.966811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395932+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:40.395932+0000","last_peered":"2024-04-26T07:51:40.395932+0000","last_clean":"2024-04-26T07:51:40.395932+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:40.395932+0000","last_undegraded":"2024-04-26T07:51:40.395932+0000","last_fullsized":"2024-04-26T07:51:40.395932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394102+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:51:40.394102+0000","last_peered":"2024-04-26T07:51:40.394102+0000","last_clean":"2024-04-26T07:51:40.394102+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:51:40.394102+0000","last_undegraded":"2024-04-26T07:51:40.394102+0000","last_fullsized":"2024-04-26T07:51:40.394102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'17","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408341+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:51:40.408341+0000","last_peered":"2024-04-26T07:51:40.408341+0000","last_clean":"2024-04-26T07:51:40.408341+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:51:40.408341+0000","last_undegraded":"2024-04-26T07:51:40.408341+0000","last_fullsized":"2024-04-26T07:51:40.408341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414412+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:40.414412+0000","last_peered":"2024-04-26T07:51:40.414412+0000","last_clean":"2024-04-26T07:51:40.414412+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:40.414412+0000","last_undegraded":"2024-04-26T07:51:40.414412+0000","last_fullsized":"2024-04-26T07:51:40.414412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"90'17","reported_seq":159,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.447428+0000","last_change":"2024-04-26T07:51:40.447428+0000","last_active":"2024-04-26T07:51:40.447428+0000","last_peered":"2024-04-26T07:51:40.447428+0000","last_clean":"2024-04-26T07:51:40.447428+0000","last_became_active":"2024-04-26T07:51:40.441381+0000","last_became_peered":"2024-04-26T07:51:40.441381+0000","last_unstale":"2024-04-26T07:51:40.447428+0000","last_undegraded":"2024-04-26T07:51:40.447428+0000","last_fullsized":"2024-04-26T07:51:40.447428+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:19.309516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'134","reported_seq":350,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391398+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:51:40.391398+0000","last_peered":"2024-04-26T07:51:40.391398+0000","last_clean":"2024-04-26T07:51:40.391398+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:51:40.391398+0000","last_undegraded":"2024-04-26T07:51:40.391398+0000","last_fullsized":"2024-04-26T07:51:40.391398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410355+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:51:40.410355+0000","last_peered":"2024-04-26T07:51:40.410355+0000","last_clean":"2024-04-26T07:51:40.410355+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:51:40.410355+0000","last_undegraded":"2024-04-26T07:51:40.410355+0000","last_fullsized":"2024-04-26T07:51:40.410355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433314+0000","last_change":"2024-04-26T07:51:40.433314+0000","last_active":"2024-04-26T07:51:40.433314+0000","last_peered":"2024-04-26T07:51:40.433314+0000","last_clean":"2024-04-26T07:51:40.433314+0000","last_became_active":"2024-04-26T07:51:40.432352+0000","last_became_peered":"2024-04-26T07:51:40.432352+0000","last_unstale":"2024-04-26T07:51:40.433314+0000","last_undegraded":"2024-04-26T07:51:40.433314+0000","last_fullsized":"2024-04-26T07:51:40.433314+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:27.681250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436814+0000","last_change":"2024-04-26T07:51:40.436814+0000","last_active":"2024-04-26T07:51:40.436814+0000","last_peered":"2024-04-26T07:51:40.436814+0000","last_clean":"2024-04-26T07:51:40.436814+0000","last_became_active":"2024-04-26T07:51:40.432366+0000","last_became_peered":"2024-04-26T07:51:40.432366+0000","last_unstale":"2024-04-26T07:51:40.436814+0000","last_undegraded":"2024-04-26T07:51:40.436814+0000","last_fullsized":"2024-04-26T07:51:40.436814+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.091620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"90'27","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412936+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:51:40.412936+0000","last_peered":"2024-04-26T07:51:40.412936+0000","last_clean":"2024-04-26T07:51:40.412936+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:51:40.412936+0000","last_undegraded":"2024-04-26T07:51:40.412936+0000","last_fullsized":"2024-04-26T07:51:40.412936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409381+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:40.409381+0000","last_peered":"2024-04-26T07:51:40.409381+0000","last_clean":"2024-04-26T07:51:40.409381+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:40.409381+0000","last_undegraded":"2024-04-26T07:51:40.409381+0000","last_fullsized":"2024-04-26T07:51:40.409381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413984+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:40.413984+0000","last_peered":"2024-04-26T07:51:40.413984+0000","last_clean":"2024-04-26T07:51:40.413984+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:40.413984+0000","last_undegraded":"2024-04-26T07:51:40.413984+0000","last_fullsized":"2024-04-26T07:51:40.413984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395453+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:51:40.395453+0000","last_peered":"2024-04-26T07:51:40.395453+0000","last_clean":"2024-04-26T07:51:40.395453+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:51:40.395453+0000","last_undegraded":"2024-04-26T07:51:40.395453+0000","last_fullsized":"2024-04-26T07:51:40.395453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'24","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432790+0000","last_change":"2024-04-26T07:51:40.432790+0000","last_active":"2024-04-26T07:51:40.432790+0000","last_peered":"2024-04-26T07:51:40.432790+0000","last_clean":"2024-04-26T07:51:40.432790+0000","last_became_active":"2024-04-26T07:51:40.431661+0000","last_became_peered":"2024-04-26T07:51:40.431661+0000","last_unstale":"2024-04-26T07:51:40.432790+0000","last_undegraded":"2024-04-26T07:51:40.432790+0000","last_fullsized":"2024-04-26T07:51:40.432790+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:44.955807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399129+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:51:40.399129+0000","last_peered":"2024-04-26T07:51:40.399129+0000","last_clean":"2024-04-26T07:51:40.399129+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:51:40.399129+0000","last_undegraded":"2024-04-26T07:51:40.399129+0000","last_fullsized":"2024-04-26T07:51:40.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"90'17","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392602+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:51:40.392602+0000","last_peered":"2024-04-26T07:51:40.392602+0000","last_clean":"2024-04-26T07:51:40.392602+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:51:40.392602+0000","last_undegraded":"2024-04-26T07:51:40.392602+0000","last_fullsized":"2024-04-26T07:51:40.392602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391295+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:51:40.391295+0000","last_peered":"2024-04-26T07:51:40.391295+0000","last_clean":"2024-04-26T07:51:40.391295+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:51:40.391295+0000","last_undegraded":"2024-04-26T07:51:40.391295+0000","last_fullsized":"2024-04-26T07:51:40.391295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411466+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:40.411466+0000","last_peered":"2024-04-26T07:51:40.411466+0000","last_clean":"2024-04-26T07:51:40.411466+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:40.411466+0000","last_undegraded":"2024-04-26T07:51:40.411466+0000","last_fullsized":"2024-04-26T07:51:40.411466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409163+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:51:40.409163+0000","last_peered":"2024-04-26T07:51:40.409163+0000","last_clean":"2024-04-26T07:51:40.409163+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:51:40.409163+0000","last_undegraded":"2024-04-26T07:51:40.409163+0000","last_fullsized":"2024-04-26T07:51:40.409163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"89'25","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.448016+0000","last_change":"2024-04-26T07:51:40.448016+0000","last_active":"2024-04-26T07:51:40.448016+0000","last_peered":"2024-04-26T07:51:40.448016+0000","last_clean":"2024-04-26T07:51:40.448016+0000","last_became_active":"2024-04-26T07:51:40.444713+0000","last_became_peered":"2024-04-26T07:51:40.444713+0000","last_unstale":"2024-04-26T07:51:40.448016+0000","last_undegraded":"2024-04-26T07:51:40.448016+0000","last_fullsized":"2024-04-26T07:51:40.448016+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:01.400431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401762+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:51:40.401762+0000","last_peered":"2024-04-26T07:51:40.401762+0000","last_clean":"2024-04-26T07:51:40.401762+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:51:40.401762+0000","last_undegraded":"2024-04-26T07:51:40.401762+0000","last_fullsized":"2024-04-26T07:51:40.401762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"90'25","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444435+0000","last_change":"2024-04-26T07:51:40.444435+0000","last_active":"2024-04-26T07:51:40.444435+0000","last_peered":"2024-04-26T07:51:40.444435+0000","last_clean":"2024-04-26T07:51:40.444435+0000","last_became_active":"2024-04-26T07:51:40.438940+0000","last_became_peered":"2024-04-26T07:51:40.438940+0000","last_unstale":"2024-04-26T07:51:40.444435+0000","last_undegraded":"2024-04-26T07:51:40.444435+0000","last_fullsized":"2024-04-26T07:51:40.444435+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:00.682036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62803,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"90'134","reported_seq":348,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386908+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:51:40.386908+0000","last_peered":"2024-04-26T07:51:40.386908+0000","last_clean":"2024-04-26T07:51:40.386908+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:51:40.386908+0000","last_undegraded":"2024-04-26T07:51:40.386908+0000","last_fullsized":"2024-04-26T07:51:40.386908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387775+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:40.387775+0000","last_peered":"2024-04-26T07:51:40.387775+0000","last_clean":"2024-04-26T07:51:40.387775+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:40.387775+0000","last_undegraded":"2024-04-26T07:51:40.387775+0000","last_fullsized":"2024-04-26T07:51:40.387775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388194+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:40.388194+0000","last_peered":"2024-04-26T07:51:40.388194+0000","last_clean":"2024-04-26T07:51:40.388194+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:40.388194+0000","last_undegraded":"2024-04-26T07:51:40.388194+0000","last_fullsized":"2024-04-26T07:51:40.388194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414745+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:40.414745+0000","last_peered":"2024-04-26T07:51:40.414745+0000","last_clean":"2024-04-26T07:51:40.414745+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:40.414745+0000","last_undegraded":"2024-04-26T07:51:40.414745+0000","last_fullsized":"2024-04-26T07:51:40.414745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400425+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:51:40.400425+0000","last_peered":"2024-04-26T07:51:40.400425+0000","last_clean":"2024-04-26T07:51:40.400425+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:51:40.400425+0000","last_undegraded":"2024-04-26T07:51:40.400425+0000","last_fullsized":"2024-04-26T07:51:40.400425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'29","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387270+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:40.387270+0000","last_peered":"2024-04-26T07:51:40.387270+0000","last_clean":"2024-04-26T07:51:40.387270+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:40.387270+0000","last_undegraded":"2024-04-26T07:51:40.387270+0000","last_fullsized":"2024-04-26T07:51:40.387270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398515+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:51:40.398515+0000","last_peered":"2024-04-26T07:51:40.398515+0000","last_clean":"2024-04-26T07:51:40.398515+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:51:40.398515+0000","last_undegraded":"2024-04-26T07:51:40.398515+0000","last_fullsized":"2024-04-26T07:51:40.398515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410194+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:40.410194+0000","last_peered":"2024-04-26T07:51:40.410194+0000","last_clean":"2024-04-26T07:51:40.410194+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:40.410194+0000","last_undegraded":"2024-04-26T07:51:40.410194+0000","last_fullsized":"2024-04-26T07:51:40.410194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398461+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:40.398461+0000","last_peered":"2024-04-26T07:51:40.398461+0000","last_clean":"2024-04-26T07:51:40.398461+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:40.398461+0000","last_undegraded":"2024-04-26T07:51:40.398461+0000","last_fullsized":"2024-04-26T07:51:40.398461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391868+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:40.391868+0000","last_peered":"2024-04-26T07:51:40.391868+0000","last_clean":"2024-04-26T07:51:40.391868+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:40.391868+0000","last_undegraded":"2024-04-26T07:51:40.391868+0000","last_fullsized":"2024-04-26T07:51:40.391868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398811+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:51:40.398811+0000","last_peered":"2024-04-26T07:51:40.398811+0000","last_clean":"2024-04-26T07:51:40.398811+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:51:40.398811+0000","last_undegraded":"2024-04-26T07:51:40.398811+0000","last_fullsized":"2024-04-26T07:51:40.398811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"90'20","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396590+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:51:40.396590+0000","last_peered":"2024-04-26T07:51:40.396590+0000","last_clean":"2024-04-26T07:51:40.396590+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:51:40.396590+0000","last_undegraded":"2024-04-26T07:51:40.396590+0000","last_fullsized":"2024-04-26T07:51:40.396590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388406+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:51:40.388406+0000","last_peered":"2024-04-26T07:51:40.388406+0000","last_clean":"2024-04-26T07:51:40.388406+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:51:40.388406+0000","last_undegraded":"2024-04-26T07:51:40.388406+0000","last_fullsized":"2024-04-26T07:51:40.388406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390097+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:40.390097+0000","last_peered":"2024-04-26T07:51:40.390097+0000","last_clean":"2024-04-26T07:51:40.390097+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:40.390097+0000","last_undegraded":"2024-04-26T07:51:40.390097+0000","last_fullsized":"2024-04-26T07:51:40.390097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396856+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:40.396856+0000","last_peered":"2024-04-26T07:51:40.396856+0000","last_clean":"2024-04-26T07:51:40.396856+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:40.396856+0000","last_undegraded":"2024-04-26T07:51:40.396856+0000","last_fullsized":"2024-04-26T07:51:40.396856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'25","reported_seq":217,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409628+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:51:40.409628+0000","last_peered":"2024-04-26T07:51:40.409628+0000","last_clean":"2024-04-26T07:51:40.409628+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:51:40.409628+0000","last_undegraded":"2024-04-26T07:51:40.409628+0000","last_fullsized":"2024-04-26T07:51:40.409628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409449+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:51:40.409449+0000","last_peered":"2024-04-26T07:51:40.409449+0000","last_clean":"2024-04-26T07:51:40.409449+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:51:40.409449+0000","last_undegraded":"2024-04-26T07:51:40.409449+0000","last_fullsized":"2024-04-26T07:51:40.409449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"90'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399211+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:51:40.399211+0000","last_peered":"2024-04-26T07:51:40.399211+0000","last_clean":"2024-04-26T07:51:40.399211+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:51:40.399211+0000","last_undegraded":"2024-04-26T07:51:40.399211+0000","last_fullsized":"2024-04-26T07:51:40.399211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'134","reported_seq":365,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399225+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:51:40.399225+0000","last_peered":"2024-04-26T07:51:40.399225+0000","last_clean":"2024-04-26T07:51:40.399225+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:51:40.399225+0000","last_undegraded":"2024-04-26T07:51:40.399225+0000","last_fullsized":"2024-04-26T07:51:40.399225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409050+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:40.409050+0000","last_peered":"2024-04-26T07:51:40.409050+0000","last_clean":"2024-04-26T07:51:40.409050+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:40.409050+0000","last_undegraded":"2024-04-26T07:51:40.409050+0000","last_fullsized":"2024-04-26T07:51:40.409050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398129+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:51:40.398129+0000","last_peered":"2024-04-26T07:51:40.398129+0000","last_clean":"2024-04-26T07:51:40.398129+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:51:40.398129+0000","last_undegraded":"2024-04-26T07:51:40.398129+0000","last_fullsized":"2024-04-26T07:51:40.398129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"89'30","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396862+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:40.396862+0000","last_peered":"2024-04-26T07:51:40.396862+0000","last_clean":"2024-04-26T07:51:40.396862+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:40.396862+0000","last_undegraded":"2024-04-26T07:51:40.396862+0000","last_fullsized":"2024-04-26T07:51:40.396862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":363,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416681+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:51:40.416681+0000","last_peered":"2024-04-26T07:51:40.416681+0000","last_clean":"2024-04-26T07:51:40.416681+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:51:40.416681+0000","last_undegraded":"2024-04-26T07:51:40.416681+0000","last_fullsized":"2024-04-26T07:51:40.416681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393097+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:51:40.393097+0000","last_peered":"2024-04-26T07:51:40.393097+0000","last_clean":"2024-04-26T07:51:40.393097+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:51:40.393097+0000","last_undegraded":"2024-04-26T07:51:40.393097+0000","last_fullsized":"2024-04-26T07:51:40.393097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"90'134","reported_seq":400,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411763+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:40.411763+0000","last_peered":"2024-04-26T07:51:40.411763+0000","last_clean":"2024-04-26T07:51:40.411763+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:40.411763+0000","last_undegraded":"2024-04-26T07:51:40.411763+0000","last_fullsized":"2024-04-26T07:51:40.411763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400533+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:40.400533+0000","last_peered":"2024-04-26T07:51:40.400533+0000","last_clean":"2024-04-26T07:51:40.400533+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:40.400533+0000","last_undegraded":"2024-04-26T07:51:40.400533+0000","last_fullsized":"2024-04-26T07:51:40.400533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":165,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394484+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:40.394484+0000","last_peered":"2024-04-26T07:51:40.394484+0000","last_clean":"2024-04-26T07:51:40.394484+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:40.394484+0000","last_undegraded":"2024-04-26T07:51:40.394484+0000","last_fullsized":"2024-04-26T07:51:40.394484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390895+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:40.390895+0000","last_peered":"2024-04-26T07:51:40.390895+0000","last_clean":"2024-04-26T07:51:40.390895+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:40.390895+0000","last_undegraded":"2024-04-26T07:51:40.390895+0000","last_fullsized":"2024-04-26T07:51:40.390895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397629+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:51:40.397629+0000","last_peered":"2024-04-26T07:51:40.397629+0000","last_clean":"2024-04-26T07:51:40.397629+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:51:40.397629+0000","last_undegraded":"2024-04-26T07:51:40.397629+0000","last_fullsized":"2024-04-26T07:51:40.397629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"90'26","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414130+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:51:40.414130+0000","last_peered":"2024-04-26T07:51:40.414130+0000","last_clean":"2024-04-26T07:51:40.414130+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:51:40.414130+0000","last_undegraded":"2024-04-26T07:51:40.414130+0000","last_fullsized":"2024-04-26T07:51:40.414130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409728+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:40.409728+0000","last_peered":"2024-04-26T07:51:40.409728+0000","last_clean":"2024-04-26T07:51:40.409728+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:40.409728+0000","last_undegraded":"2024-04-26T07:51:40.409728+0000","last_fullsized":"2024-04-26T07:51:40.409728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409337+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:40.409337+0000","last_peered":"2024-04-26T07:51:40.409337+0000","last_clean":"2024-04-26T07:51:40.409337+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:40.409337+0000","last_undegraded":"2024-04-26T07:51:40.409337+0000","last_fullsized":"2024-04-26T07:51:40.409337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412130+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:51:40.412130+0000","last_peered":"2024-04-26T07:51:40.412130+0000","last_clean":"2024-04-26T07:51:40.412130+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:51:40.412130+0000","last_undegraded":"2024-04-26T07:51:40.412130+0000","last_fullsized":"2024-04-26T07:51:40.412130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435552+0000","last_change":"2024-04-26T07:51:40.435552+0000","last_active":"2024-04-26T07:51:40.435552+0000","last_peered":"2024-04-26T07:51:40.435552+0000","last_clean":"2024-04-26T07:51:40.435552+0000","last_became_active":"2024-04-26T07:51:40.429475+0000","last_became_peered":"2024-04-26T07:51:40.429475+0000","last_unstale":"2024-04-26T07:51:40.435552+0000","last_undegraded":"2024-04-26T07:51:40.435552+0000","last_fullsized":"2024-04-26T07:51:40.435552+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:19.379343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414577+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:40.414577+0000","last_peered":"2024-04-26T07:51:40.414577+0000","last_clean":"2024-04-26T07:51:40.414577+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:40.414577+0000","last_undegraded":"2024-04-26T07:51:40.414577+0000","last_fullsized":"2024-04-26T07:51:40.414577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391655+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:40.391655+0000","last_peered":"2024-04-26T07:51:40.391655+0000","last_clean":"2024-04-26T07:51:40.391655+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:40.391655+0000","last_undegraded":"2024-04-26T07:51:40.391655+0000","last_fullsized":"2024-04-26T07:51:40.391655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429427+0000","last_change":"2024-04-26T07:51:40.429427+0000","last_active":"2024-04-26T07:51:40.429427+0000","last_peered":"2024-04-26T07:51:40.429427+0000","last_clean":"2024-04-26T07:51:40.429427+0000","last_became_active":"2024-04-26T07:51:40.428641+0000","last_became_peered":"2024-04-26T07:51:40.428641+0000","last_unstale":"2024-04-26T07:51:40.429427+0000","last_undegraded":"2024-04-26T07:51:40.429427+0000","last_fullsized":"2024-04-26T07:51:40.429427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:31.406741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"90'39","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416828+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:51:40.416828+0000","last_peered":"2024-04-26T07:51:40.416828+0000","last_clean":"2024-04-26T07:51:40.416828+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:51:40.416828+0000","last_undegraded":"2024-04-26T07:51:40.416828+0000","last_fullsized":"2024-04-26T07:51:40.416828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388551+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:51:40.388551+0000","last_peered":"2024-04-26T07:51:40.388551+0000","last_clean":"2024-04-26T07:51:40.388551+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:51:40.388551+0000","last_undegraded":"2024-04-26T07:51:40.388551+0000","last_fullsized":"2024-04-26T07:51:40.388551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407507+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:40.407507+0000","last_peered":"2024-04-26T07:51:40.407507+0000","last_clean":"2024-04-26T07:51:40.407507+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:40.407507+0000","last_undegraded":"2024-04-26T07:51:40.407507+0000","last_fullsized":"2024-04-26T07:51:40.407507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388819+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:51:40.388819+0000","last_peered":"2024-04-26T07:51:40.388819+0000","last_clean":"2024-04-26T07:51:40.388819+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:51:40.388819+0000","last_undegraded":"2024-04-26T07:51:40.388819+0000","last_fullsized":"2024-04-26T07:51:40.388819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.440837+0000","last_change":"2024-04-26T07:51:40.440837+0000","last_active":"2024-04-26T07:51:40.440837+0000","last_peered":"2024-04-26T07:51:40.440837+0000","last_clean":"2024-04-26T07:51:40.440837+0000","last_became_active":"2024-04-26T07:51:40.437582+0000","last_became_peered":"2024-04-26T07:51:40.437582+0000","last_unstale":"2024-04-26T07:51:40.440837+0000","last_undegraded":"2024-04-26T07:51:40.440837+0000","last_fullsized":"2024-04-26T07:51:40.440837+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.908604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"89'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387392+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:40.387392+0000","last_peered":"2024-04-26T07:51:40.387392+0000","last_clean":"2024-04-26T07:51:40.387392+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:40.387392+0000","last_undegraded":"2024-04-26T07:51:40.387392+0000","last_fullsized":"2024-04-26T07:51:40.387392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417014+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:40.417014+0000","last_peered":"2024-04-26T07:51:40.417014+0000","last_clean":"2024-04-26T07:51:40.417014+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:40.417014+0000","last_undegraded":"2024-04-26T07:51:40.417014+0000","last_fullsized":"2024-04-26T07:51:40.417014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'137","reported_seq":418,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409395+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:51:40.409395+0000","last_peered":"2024-04-26T07:51:40.409395+0000","last_clean":"2024-04-26T07:51:40.409395+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:51:40.409395+0000","last_undegraded":"2024-04-26T07:51:40.409395+0000","last_fullsized":"2024-04-26T07:51:40.409395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444144+0000","last_change":"2024-04-26T07:51:40.444144+0000","last_active":"2024-04-26T07:51:40.444144+0000","last_peered":"2024-04-26T07:51:40.444144+0000","last_clean":"2024-04-26T07:51:40.444144+0000","last_became_active":"2024-04-26T07:51:40.439356+0000","last_became_peered":"2024-04-26T07:51:40.439356+0000","last_unstale":"2024-04-26T07:51:40.444144+0000","last_undegraded":"2024-04-26T07:51:40.444144+0000","last_fullsized":"2024-04-26T07:51:40.444144+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:37.987341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408252+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:40.408252+0000","last_peered":"2024-04-26T07:51:40.408252+0000","last_clean":"2024-04-26T07:51:40.408252+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:40.408252+0000","last_undegraded":"2024-04-26T07:51:40.408252+0000","last_fullsized":"2024-04-26T07:51:40.408252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410446+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:51:40.410446+0000","last_peered":"2024-04-26T07:51:40.410446+0000","last_clean":"2024-04-26T07:51:40.410446+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:51:40.410446+0000","last_undegraded":"2024-04-26T07:51:40.410446+0000","last_fullsized":"2024-04-26T07:51:40.410446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399025+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:51:40.399025+0000","last_peered":"2024-04-26T07:51:40.399025+0000","last_clean":"2024-04-26T07:51:40.399025+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:51:40.399025+0000","last_undegraded":"2024-04-26T07:51:40.399025+0000","last_fullsized":"2024-04-26T07:51:40.399025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'26","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408371+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:40.408371+0000","last_peered":"2024-04-26T07:51:40.408371+0000","last_clean":"2024-04-26T07:51:40.408371+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:40.408371+0000","last_undegraded":"2024-04-26T07:51:40.408371+0000","last_fullsized":"2024-04-26T07:51:40.408371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399455+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:51:40.399455+0000","last_peered":"2024-04-26T07:51:40.399455+0000","last_clean":"2024-04-26T07:51:40.399455+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:51:40.399455+0000","last_undegraded":"2024-04-26T07:51:40.399455+0000","last_fullsized":"2024-04-26T07:51:40.399455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"109'17","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.450263+0000","last_change":"2024-04-26T07:51:40.448691+0000","last_active":"2024-04-26T07:51:40.450263+0000","last_peered":"2024-04-26T07:51:40.450263+0000","last_clean":"2024-04-26T07:51:40.450263+0000","last_became_active":"2024-04-26T07:51:40.445444+0000","last_became_peered":"2024-04-26T07:51:40.445444+0000","last_unstale":"2024-04-26T07:51:40.450263+0000","last_undegraded":"2024-04-26T07:51:40.450263+0000","last_fullsized":"2024-04-26T07:51:40.450263+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:23.750359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387011+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:51:40.387011+0000","last_peered":"2024-04-26T07:51:40.387011+0000","last_clean":"2024-04-26T07:51:40.387011+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:51:40.387011+0000","last_undegraded":"2024-04-26T07:51:40.387011+0000","last_fullsized":"2024-04-26T07:51:40.387011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392361+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:40.392361+0000","last_peered":"2024-04-26T07:51:40.392361+0000","last_clean":"2024-04-26T07:51:40.392361+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:40.392361+0000","last_undegraded":"2024-04-26T07:51:40.392361+0000","last_fullsized":"2024-04-26T07:51:40.392361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409549+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:51:40.409549+0000","last_peered":"2024-04-26T07:51:40.409549+0000","last_clean":"2024-04-26T07:51:40.409549+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:51:40.409549+0000","last_undegraded":"2024-04-26T07:51:40.409549+0000","last_fullsized":"2024-04-26T07:51:40.409549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414326+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:40.414326+0000","last_peered":"2024-04-26T07:51:40.414326+0000","last_clean":"2024-04-26T07:51:40.414326+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:40.414326+0000","last_undegraded":"2024-04-26T07:51:40.414326+0000","last_fullsized":"2024-04-26T07:51:40.414326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'20","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397271+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:40.397271+0000","last_peered":"2024-04-26T07:51:40.397271+0000","last_clean":"2024-04-26T07:51:40.397271+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:40.397271+0000","last_undegraded":"2024-04-26T07:51:40.397271+0000","last_fullsized":"2024-04-26T07:51:40.397271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387118+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:51:40.387118+0000","last_peered":"2024-04-26T07:51:40.387118+0000","last_clean":"2024-04-26T07:51:40.387118+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:51:40.387118+0000","last_undegraded":"2024-04-26T07:51:40.387118+0000","last_fullsized":"2024-04-26T07:51:40.387118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393907+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:40.393907+0000","last_peered":"2024-04-26T07:51:40.393907+0000","last_clean":"2024-04-26T07:51:40.393907+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:40.393907+0000","last_undegraded":"2024-04-26T07:51:40.393907+0000","last_fullsized":"2024-04-26T07:51:40.393907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412184+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:40.412184+0000","last_peered":"2024-04-26T07:51:40.412184+0000","last_clean":"2024-04-26T07:51:40.412184+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:40.412184+0000","last_undegraded":"2024-04-26T07:51:40.412184+0000","last_fullsized":"2024-04-26T07:51:40.412184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409446+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:40.409446+0000","last_peered":"2024-04-26T07:51:40.409446+0000","last_clean":"2024-04-26T07:51:40.409446+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:40.409446+0000","last_undegraded":"2024-04-26T07:51:40.409446+0000","last_fullsized":"2024-04-26T07:51:40.409446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408654+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:51:40.408654+0000","last_peered":"2024-04-26T07:51:40.408654+0000","last_clean":"2024-04-26T07:51:40.408654+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:51:40.408654+0000","last_undegraded":"2024-04-26T07:51:40.408654+0000","last_fullsized":"2024-04-26T07:51:40.408654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"88'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415304+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:40.415304+0000","last_peered":"2024-04-26T07:51:40.415304+0000","last_clean":"2024-04-26T07:51:40.415304+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:40.415304+0000","last_undegraded":"2024-04-26T07:51:40.415304+0000","last_fullsized":"2024-04-26T07:51:40.415304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409916+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:51:40.409916+0000","last_peered":"2024-04-26T07:51:40.409916+0000","last_clean":"2024-04-26T07:51:40.409916+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:51:40.409916+0000","last_undegraded":"2024-04-26T07:51:40.409916+0000","last_fullsized":"2024-04-26T07:51:40.409916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387667+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:51:40.387667+0000","last_peered":"2024-04-26T07:51:40.387667+0000","last_clean":"2024-04-26T07:51:40.387667+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:51:40.387667+0000","last_undegraded":"2024-04-26T07:51:40.387667+0000","last_fullsized":"2024-04-26T07:51:40.387667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"90'35","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386306+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:51:40.386306+0000","last_peered":"2024-04-26T07:51:40.386306+0000","last_clean":"2024-04-26T07:51:40.386306+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:51:40.386306+0000","last_undegraded":"2024-04-26T07:51:40.386306+0000","last_fullsized":"2024-04-26T07:51:40.386306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394908+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:40.394908+0000","last_peered":"2024-04-26T07:51:40.394908+0000","last_clean":"2024-04-26T07:51:40.394908+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:40.394908+0000","last_undegraded":"2024-04-26T07:51:40.394908+0000","last_fullsized":"2024-04-26T07:51:40.394908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387516+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:40.387516+0000","last_peered":"2024-04-26T07:51:40.387516+0000","last_clean":"2024-04-26T07:51:40.387516+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:40.387516+0000","last_undegraded":"2024-04-26T07:51:40.387516+0000","last_fullsized":"2024-04-26T07:51:40.387516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388105+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:51:40.388105+0000","last_peered":"2024-04-26T07:51:40.388105+0000","last_clean":"2024-04-26T07:51:40.388105+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:51:40.388105+0000","last_undegraded":"2024-04-26T07:51:40.388105+0000","last_fullsized":"2024-04-26T07:51:40.388105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409722+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:51:40.409722+0000","last_peered":"2024-04-26T07:51:40.409722+0000","last_clean":"2024-04-26T07:51:40.409722+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:51:40.409722+0000","last_undegraded":"2024-04-26T07:51:40.409722+0000","last_fullsized":"2024-04-26T07:51:40.409722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441852+0000","last_change":"2024-04-26T07:51:40.441852+0000","last_active":"2024-04-26T07:51:40.441852+0000","last_peered":"2024-04-26T07:51:40.441852+0000","last_clean":"2024-04-26T07:51:40.441852+0000","last_became_active":"2024-04-26T07:51:40.433293+0000","last_became_peered":"2024-04-26T07:51:40.433293+0000","last_unstale":"2024-04-26T07:51:40.441852+0000","last_undegraded":"2024-04-26T07:51:40.441852+0000","last_fullsized":"2024-04-26T07:51:40.441852+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:25.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408513+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:51:40.408513+0000","last_peered":"2024-04-26T07:51:40.408513+0000","last_clean":"2024-04-26T07:51:40.408513+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:51:40.408513+0000","last_undegraded":"2024-04-26T07:51:40.408513+0000","last_fullsized":"2024-04-26T07:51:40.408513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408684+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:40.408684+0000","last_peered":"2024-04-26T07:51:40.408684+0000","last_clean":"2024-04-26T07:51:40.408684+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:40.408684+0000","last_undegraded":"2024-04-26T07:51:40.408684+0000","last_fullsized":"2024-04-26T07:51:40.408684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'134","reported_seq":378,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410176+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:51:40.410176+0000","last_peered":"2024-04-26T07:51:40.410176+0000","last_clean":"2024-04-26T07:51:40.410176+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:51:40.410176+0000","last_undegraded":"2024-04-26T07:51:40.410176+0000","last_fullsized":"2024-04-26T07:51:40.410176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394363+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:40.394363+0000","last_peered":"2024-04-26T07:51:40.394363+0000","last_clean":"2024-04-26T07:51:40.394363+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:40.394363+0000","last_undegraded":"2024-04-26T07:51:40.394363+0000","last_fullsized":"2024-04-26T07:51:40.394363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390662+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:51:40.390662+0000","last_peered":"2024-04-26T07:51:40.390662+0000","last_clean":"2024-04-26T07:51:40.390662+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:51:40.390662+0000","last_undegraded":"2024-04-26T07:51:40.390662+0000","last_fullsized":"2024-04-26T07:51:40.390662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'19","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393883+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:40.393883+0000","last_peered":"2024-04-26T07:51:40.393883+0000","last_clean":"2024-04-26T07:51:40.393883+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:40.393883+0000","last_undegraded":"2024-04-26T07:51:40.393883+0000","last_fullsized":"2024-04-26T07:51:40.393883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410909+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:51:40.410909+0000","last_peered":"2024-04-26T07:51:40.410909+0000","last_clean":"2024-04-26T07:51:40.410909+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:51:40.410909+0000","last_undegraded":"2024-04-26T07:51:40.410909+0000","last_fullsized":"2024-04-26T07:51:40.410909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395337+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:40.395337+0000","last_peered":"2024-04-26T07:51:40.395337+0000","last_clean":"2024-04-26T07:51:40.395337+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:40.395337+0000","last_undegraded":"2024-04-26T07:51:40.395337+0000","last_fullsized":"2024-04-26T07:51:40.395337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400935+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:51:40.400935+0000","last_peered":"2024-04-26T07:51:40.400935+0000","last_clean":"2024-04-26T07:51:40.400935+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:51:40.400935+0000","last_undegraded":"2024-04-26T07:51:40.400935+0000","last_fullsized":"2024-04-26T07:51:40.400935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'134","reported_seq":350,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392962+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:51:40.392962+0000","last_peered":"2024-04-26T07:51:40.392962+0000","last_clean":"2024-04-26T07:51:40.392962+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:51:40.392962+0000","last_undegraded":"2024-04-26T07:51:40.392962+0000","last_fullsized":"2024-04-26T07:51:40.392962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387074+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:40.387074+0000","last_peered":"2024-04-26T07:51:40.387074+0000","last_clean":"2024-04-26T07:51:40.387074+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:40.387074+0000","last_undegraded":"2024-04-26T07:51:40.387074+0000","last_fullsized":"2024-04-26T07:51:40.387074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395762+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:40.395762+0000","last_peered":"2024-04-26T07:51:40.395762+0000","last_clean":"2024-04-26T07:51:40.395762+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:40.395762+0000","last_undegraded":"2024-04-26T07:51:40.395762+0000","last_fullsized":"2024-04-26T07:51:40.395762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.389005+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:40.389005+0000","last_peered":"2024-04-26T07:51:40.389005+0000","last_clean":"2024-04-26T07:51:40.389005+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:40.389005+0000","last_undegraded":"2024-04-26T07:51:40.389005+0000","last_fullsized":"2024-04-26T07:51:40.389005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412692+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:51:40.412692+0000","last_peered":"2024-04-26T07:51:40.412692+0000","last_clean":"2024-04-26T07:51:40.412692+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:51:40.412692+0000","last_undegraded":"2024-04-26T07:51:40.412692+0000","last_fullsized":"2024-04-26T07:51:40.412692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":275,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390337+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:40.390337+0000","last_peered":"2024-04-26T07:51:40.390337+0000","last_clean":"2024-04-26T07:51:40.390337+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:40.390337+0000","last_undegraded":"2024-04-26T07:51:40.390337+0000","last_fullsized":"2024-04-26T07:51:40.390337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"90'44","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.419562+0000","last_change":"2024-04-26T07:51:40.419562+0000","last_active":"2024-04-26T07:51:40.419562+0000","last_peered":"2024-04-26T07:51:40.419562+0000","last_clean":"2024-04-26T07:51:40.419562+0000","last_became_active":"2024-04-26T07:51:40.418680+0000","last_became_peered":"2024-04-26T07:51:40.418680+0000","last_unstale":"2024-04-26T07:51:40.419562+0000","last_undegraded":"2024-04-26T07:51:40.419562+0000","last_fullsized":"2024-04-26T07:51:40.419562+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:42.333538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391389+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:51:40.391389+0000","last_peered":"2024-04-26T07:51:40.391389+0000","last_clean":"2024-04-26T07:51:40.391389+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:51:40.391389+0000","last_undegraded":"2024-04-26T07:51:40.391389+0000","last_fullsized":"2024-04-26T07:51:40.391389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413846+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:40.413846+0000","last_peered":"2024-04-26T07:51:40.413846+0000","last_clean":"2024-04-26T07:51:40.413846+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:40.413846+0000","last_undegraded":"2024-04-26T07:51:40.413846+0000","last_fullsized":"2024-04-26T07:51:40.413846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387849+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:40.387849+0000","last_peered":"2024-04-26T07:51:40.387849+0000","last_clean":"2024-04-26T07:51:40.387849+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:40.387849+0000","last_undegraded":"2024-04-26T07:51:40.387849+0000","last_fullsized":"2024-04-26T07:51:40.387849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396489+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:51:40.396489+0000","last_peered":"2024-04-26T07:51:40.396489+0000","last_clean":"2024-04-26T07:51:40.396489+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:51:40.396489+0000","last_undegraded":"2024-04-26T07:51:40.396489+0000","last_fullsized":"2024-04-26T07:51:40.396489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"89'31","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397695+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:40.397695+0000","last_peered":"2024-04-26T07:51:40.397695+0000","last_clean":"2024-04-26T07:51:40.397695+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:40.397695+0000","last_undegraded":"2024-04-26T07:51:40.397695+0000","last_fullsized":"2024-04-26T07:51:40.397695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408744+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:51:40.408744+0000","last_peered":"2024-04-26T07:51:40.408744+0000","last_clean":"2024-04-26T07:51:40.408744+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:51:40.408744+0000","last_undegraded":"2024-04-26T07:51:40.408744+0000","last_fullsized":"2024-04-26T07:51:40.408744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"90'19","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.389984+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:51:40.389984+0000","last_peered":"2024-04-26T07:51:40.389984+0000","last_clean":"2024-04-26T07:51:40.389984+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:51:40.389984+0000","last_undegraded":"2024-04-26T07:51:40.389984+0000","last_fullsized":"2024-04-26T07:51:40.389984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390188+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:51:40.390188+0000","last_peered":"2024-04-26T07:51:40.390188+0000","last_clean":"2024-04-26T07:51:40.390188+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:51:40.390188+0000","last_undegraded":"2024-04-26T07:51:40.390188+0000","last_fullsized":"2024-04-26T07:51:40.390188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393594+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:40.393594+0000","last_peered":"2024-04-26T07:51:40.393594+0000","last_clean":"2024-04-26T07:51:40.393594+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:40.393594+0000","last_undegraded":"2024-04-26T07:51:40.393594+0000","last_fullsized":"2024-04-26T07:51:40.393594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408560+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:51:40.408560+0000","last_peered":"2024-04-26T07:51:40.408560+0000","last_clean":"2024-04-26T07:51:40.408560+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:51:40.408560+0000","last_undegraded":"2024-04-26T07:51:40.408560+0000","last_fullsized":"2024-04-26T07:51:40.408560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'18","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.447435+0000","last_change":"2024-04-26T07:51:40.447435+0000","last_active":"2024-04-26T07:51:40.447435+0000","last_peered":"2024-04-26T07:51:40.447435+0000","last_clean":"2024-04-26T07:51:40.447435+0000","last_became_active":"2024-04-26T07:51:40.444446+0000","last_became_peered":"2024-04-26T07:51:40.444446+0000","last_unstale":"2024-04-26T07:51:40.447435+0000","last_undegraded":"2024-04-26T07:51:40.447435+0000","last_fullsized":"2024-04-26T07:51:40.447435+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:01.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":275,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392275+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:40.392275+0000","last_peered":"2024-04-26T07:51:40.392275+0000","last_clean":"2024-04-26T07:51:40.392275+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:40.392275+0000","last_undegraded":"2024-04-26T07:51:40.392275+0000","last_fullsized":"2024-04-26T07:51:40.392275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"101'10","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386065+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:51:40.386065+0000","last_peered":"2024-04-26T07:51:40.386065+0000","last_clean":"2024-04-26T07:51:40.386065+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:51:40.386065+0000","last_undegraded":"2024-04-26T07:51:40.386065+0000","last_fullsized":"2024-04-26T07:51:40.386065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432738+0000","last_change":"2024-04-26T07:51:40.432738+0000","last_active":"2024-04-26T07:51:40.432738+0000","last_peered":"2024-04-26T07:51:40.432738+0000","last_clean":"2024-04-26T07:51:40.432738+0000","last_became_active":"2024-04-26T07:51:40.431762+0000","last_became_peered":"2024-04-26T07:51:40.431762+0000","last_unstale":"2024-04-26T07:51:40.432738+0000","last_undegraded":"2024-04-26T07:51:40.432738+0000","last_fullsized":"2024-04-26T07:51:40.432738+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:25.659741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386934+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:40.386934+0000","last_peered":"2024-04-26T07:51:40.386934+0000","last_clean":"2024-04-26T07:51:40.386934+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:40.386934+0000","last_undegraded":"2024-04-26T07:51:40.386934+0000","last_fullsized":"2024-04-26T07:51:40.386934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391261+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:51:40.391261+0000","last_peered":"2024-04-26T07:51:40.391261+0000","last_clean":"2024-04-26T07:51:40.391261+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:51:40.391261+0000","last_undegraded":"2024-04-26T07:51:40.391261+0000","last_fullsized":"2024-04-26T07:51:40.391261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416629+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:40.416629+0000","last_peered":"2024-04-26T07:51:40.416629+0000","last_clean":"2024-04-26T07:51:40.416629+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:40.416629+0000","last_undegraded":"2024-04-26T07:51:40.416629+0000","last_fullsized":"2024-04-26T07:51:40.416629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444554+0000","last_change":"2024-04-26T07:51:40.444554+0000","last_active":"2024-04-26T07:51:40.444554+0000","last_peered":"2024-04-26T07:51:40.444554+0000","last_clean":"2024-04-26T07:51:40.444554+0000","last_became_active":"2024-04-26T07:51:40.439845+0000","last_became_peered":"2024-04-26T07:51:40.439845+0000","last_unstale":"2024-04-26T07:51:40.444554+0000","last_undegraded":"2024-04-26T07:51:40.444554+0000","last_fullsized":"2024-04-26T07:51:40.444554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:41.631699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"90'20","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392088+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:51:40.392088+0000","last_peered":"2024-04-26T07:51:40.392088+0000","last_clean":"2024-04-26T07:51:40.392088+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:51:40.392088+0000","last_undegraded":"2024-04-26T07:51:40.392088+0000","last_fullsized":"2024-04-26T07:51:40.392088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409988+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:40.409988+0000","last_peered":"2024-04-26T07:51:40.409988+0000","last_clean":"2024-04-26T07:51:40.409988+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:40.409988+0000","last_undegraded":"2024-04-26T07:51:40.409988+0000","last_fullsized":"2024-04-26T07:51:40.409988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413668+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:40.413668+0000","last_peered":"2024-04-26T07:51:40.413668+0000","last_clean":"2024-04-26T07:51:40.413668+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:40.413668+0000","last_undegraded":"2024-04-26T07:51:40.413668+0000","last_fullsized":"2024-04-26T07:51:40.413668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390764+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:51:40.390764+0000","last_peered":"2024-04-26T07:51:40.390764+0000","last_clean":"2024-04-26T07:51:40.390764+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:51:40.390764+0000","last_undegraded":"2024-04-26T07:51:40.390764+0000","last_fullsized":"2024-04-26T07:51:40.390764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'25","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388325+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:40.388325+0000","last_peered":"2024-04-26T07:51:40.388325+0000","last_clean":"2024-04-26T07:51:40.388325+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:40.388325+0000","last_undegraded":"2024-04-26T07:51:40.388325+0000","last_fullsized":"2024-04-26T07:51:40.388325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409141+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:51:40.409141+0000","last_peered":"2024-04-26T07:51:40.409141+0000","last_clean":"2024-04-26T07:51:40.409141+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:51:40.409141+0000","last_undegraded":"2024-04-26T07:51:40.409141+0000","last_fullsized":"2024-04-26T07:51:40.409141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"90'18","reported_seq":160,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.418821+0000","last_change":"2024-04-26T07:51:40.418821+0000","last_active":"2024-04-26T07:51:40.418821+0000","last_peered":"2024-04-26T07:51:40.418821+0000","last_clean":"2024-04-26T07:51:40.418821+0000","last_became_active":"2024-04-26T07:51:40.417916+0000","last_became_peered":"2024-04-26T07:51:40.417916+0000","last_unstale":"2024-04-26T07:51:40.418821+0000","last_undegraded":"2024-04-26T07:51:40.418821+0000","last_fullsized":"2024-04-26T07:51:40.418821+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:36.135343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387218+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:51:40.387218+0000","last_peered":"2024-04-26T07:51:40.387218+0000","last_clean":"2024-04-26T07:51:40.387218+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:51:40.387218+0000","last_undegraded":"2024-04-26T07:51:40.387218+0000","last_fullsized":"2024-04-26T07:51:40.387218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412561+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:51:40.412561+0000","last_peered":"2024-04-26T07:51:40.412561+0000","last_clean":"2024-04-26T07:51:40.412561+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:51:40.412561+0000","last_undegraded":"2024-04-26T07:51:40.412561+0000","last_fullsized":"2024-04-26T07:51:40.412561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390860+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:40.390860+0000","last_peered":"2024-04-26T07:51:40.390860+0000","last_clean":"2024-04-26T07:51:40.390860+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:40.390860+0000","last_undegraded":"2024-04-26T07:51:40.390860+0000","last_fullsized":"2024-04-26T07:51:40.390860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388623+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:51:40.388623+0000","last_peered":"2024-04-26T07:51:40.388623+0000","last_clean":"2024-04-26T07:51:40.388623+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:51:40.388623+0000","last_undegraded":"2024-04-26T07:51:40.388623+0000","last_fullsized":"2024-04-26T07:51:40.388623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"90'29","reported_seq":220,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409906+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:51:40.409906+0000","last_peered":"2024-04-26T07:51:40.409906+0000","last_clean":"2024-04-26T07:51:40.409906+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:51:40.409906+0000","last_undegraded":"2024-04-26T07:51:40.409906+0000","last_fullsized":"2024-04-26T07:51:40.409906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414293+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:40.414293+0000","last_peered":"2024-04-26T07:51:40.414293+0000","last_clean":"2024-04-26T07:51:40.414293+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:40.414293+0000","last_undegraded":"2024-04-26T07:51:40.414293+0000","last_fullsized":"2024-04-26T07:51:40.414293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391766+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:40.391766+0000","last_peered":"2024-04-26T07:51:40.391766+0000","last_clean":"2024-04-26T07:51:40.391766+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:40.391766+0000","last_undegraded":"2024-04-26T07:51:40.391766+0000","last_fullsized":"2024-04-26T07:51:40.391766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388746+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:51:40.388746+0000","last_peered":"2024-04-26T07:51:40.388746+0000","last_clean":"2024-04-26T07:51:40.388746+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:51:40.388746+0000","last_undegraded":"2024-04-26T07:51:40.388746+0000","last_fullsized":"2024-04-26T07:51:40.388746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'16","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409372+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:51:40.409372+0000","last_peered":"2024-04-26T07:51:40.409372+0000","last_clean":"2024-04-26T07:51:40.409372+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:51:40.409372+0000","last_undegraded":"2024-04-26T07:51:40.409372+0000","last_fullsized":"2024-04-26T07:51:40.409372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412316+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:51:40.412316+0000","last_peered":"2024-04-26T07:51:40.412316+0000","last_clean":"2024-04-26T07:51:40.412316+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:51:40.412316+0000","last_undegraded":"2024-04-26T07:51:40.412316+0000","last_fullsized":"2024-04-26T07:51:40.412316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"90'25","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427441+0000","last_change":"2024-04-26T07:51:40.427441+0000","last_active":"2024-04-26T07:51:40.427441+0000","last_peered":"2024-04-26T07:51:40.427441+0000","last_clean":"2024-04-26T07:51:40.427441+0000","last_became_active":"2024-04-26T07:51:40.424476+0000","last_became_peered":"2024-04-26T07:51:40.424476+0000","last_unstale":"2024-04-26T07:51:40.427441+0000","last_undegraded":"2024-04-26T07:51:40.427441+0000","last_fullsized":"2024-04-26T07:51:40.427441+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:35.964067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410009+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:40.410009+0000","last_peered":"2024-04-26T07:51:40.410009+0000","last_clean":"2024-04-26T07:51:40.410009+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:40.410009+0000","last_undegraded":"2024-04-26T07:51:40.410009+0000","last_fullsized":"2024-04-26T07:51:40.410009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408176+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:40.408176+0000","last_peered":"2024-04-26T07:51:40.408176+0000","last_clean":"2024-04-26T07:51:40.408176+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:40.408176+0000","last_undegraded":"2024-04-26T07:51:40.408176+0000","last_fullsized":"2024-04-26T07:51:40.408176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393585+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:51:40.393585+0000","last_peered":"2024-04-26T07:51:40.393585+0000","last_clean":"2024-04-26T07:51:40.393585+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:51:40.393585+0000","last_undegraded":"2024-04-26T07:51:40.393585+0000","last_fullsized":"2024-04-26T07:51:40.393585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'31","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401530+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:40.401530+0000","last_peered":"2024-04-26T07:51:40.401530+0000","last_clean":"2024-04-26T07:51:40.401530+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:40.401530+0000","last_undegraded":"2024-04-26T07:51:40.401530+0000","last_fullsized":"2024-04-26T07:51:40.401530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399362+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:51:40.399362+0000","last_peered":"2024-04-26T07:51:40.399362+0000","last_clean":"2024-04-26T07:51:40.399362+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:51:40.399362+0000","last_undegraded":"2024-04-26T07:51:40.399362+0000","last_fullsized":"2024-04-26T07:51:40.399362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"90'19","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394701+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:51:40.394701+0000","last_peered":"2024-04-26T07:51:40.394701+0000","last_clean":"2024-04-26T07:51:40.394701+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:51:40.394701+0000","last_undegraded":"2024-04-26T07:51:40.394701+0000","last_fullsized":"2024-04-26T07:51:40.394701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409809+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:40.409809+0000","last_peered":"2024-04-26T07:51:40.409809+0000","last_clean":"2024-04-26T07:51:40.409809+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:40.409809+0000","last_undegraded":"2024-04-26T07:51:40.409809+0000","last_fullsized":"2024-04-26T07:51:40.409809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410392+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:40.410392+0000","last_peered":"2024-04-26T07:51:40.410392+0000","last_clean":"2024-04-26T07:51:40.410392+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:40.410392+0000","last_undegraded":"2024-04-26T07:51:40.410392+0000","last_fullsized":"2024-04-26T07:51:40.410392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399847+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:51:40.399847+0000","last_peered":"2024-04-26T07:51:40.399847+0000","last_clean":"2024-04-26T07:51:40.399847+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:51:40.399847+0000","last_undegraded":"2024-04-26T07:51:40.399847+0000","last_fullsized":"2024-04-26T07:51:40.399847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"88'18","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387314+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:40.387314+0000","last_peered":"2024-04-26T07:51:40.387314+0000","last_clean":"2024-04-26T07:51:40.387314+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:40.387314+0000","last_undegraded":"2024-04-26T07:51:40.387314+0000","last_fullsized":"2024-04-26T07:51:40.387314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410199+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:51:40.410199+0000","last_peered":"2024-04-26T07:51:40.410199+0000","last_clean":"2024-04-26T07:51:40.410199+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:51:40.410199+0000","last_undegraded":"2024-04-26T07:51:40.410199+0000","last_fullsized":"2024-04-26T07:51:40.410199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396852+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:51:40.396852+0000","last_peered":"2024-04-26T07:51:40.396852+0000","last_clean":"2024-04-26T07:51:40.396852+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:51:40.396852+0000","last_undegraded":"2024-04-26T07:51:40.396852+0000","last_fullsized":"2024-04-26T07:51:40.396852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'134","reported_seq":427,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411997+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:51:40.411997+0000","last_peered":"2024-04-26T07:51:40.411997+0000","last_clean":"2024-04-26T07:51:40.411997+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:51:40.411997+0000","last_undegraded":"2024-04-26T07:51:40.411997+0000","last_fullsized":"2024-04-26T07:51:40.411997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":136,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437366+0000","last_change":"2024-04-26T07:51:40.437366+0000","last_active":"2024-04-26T07:51:40.437366+0000","last_peered":"2024-04-26T07:51:40.437366+0000","last_clean":"2024-04-26T07:51:40.437366+0000","last_became_active":"2024-04-26T07:51:40.436379+0000","last_became_peered":"2024-04-26T07:51:40.436379+0000","last_unstale":"2024-04-26T07:51:40.437366+0000","last_undegraded":"2024-04-26T07:51:40.437366+0000","last_fullsized":"2024-04-26T07:51:40.437366+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:48:37.824192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396217+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:40.396217+0000","last_peered":"2024-04-26T07:51:40.396217+0000","last_clean":"2024-04-26T07:51:40.396217+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:40.396217+0000","last_undegraded":"2024-04-26T07:51:40.396217+0000","last_fullsized":"2024-04-26T07:51:40.396217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"89'14","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399466+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:40.399466+0000","last_peered":"2024-04-26T07:51:40.399466+0000","last_clean":"2024-04-26T07:51:40.399466+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:40.399466+0000","last_undegraded":"2024-04-26T07:51:40.399466+0000","last_fullsized":"2024-04-26T07:51:40.399466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:16.352834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428700+0000","last_change":"2024-04-26T07:51:40.428700+0000","last_active":"2024-04-26T07:51:40.428700+0000","last_peered":"2024-04-26T07:51:40.428700+0000","last_clean":"2024-04-26T07:51:40.428700+0000","last_became_active":"2024-04-26T07:51:40.427906+0000","last_became_peered":"2024-04-26T07:51:40.427906+0000","last_unstale":"2024-04-26T07:51:40.428700+0000","last_undegraded":"2024-04-26T07:51:40.428700+0000","last_fullsized":"2024-04-26T07:51:40.428700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:31.624570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"90'23","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410799+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:51:40.410799+0000","last_peered":"2024-04-26T07:51:40.410799+0000","last_clean":"2024-04-26T07:51:40.410799+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:51:40.410799+0000","last_undegraded":"2024-04-26T07:51:40.410799+0000","last_fullsized":"2024-04-26T07:51:40.410799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385502+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:51:40.385502+0000","last_peered":"2024-04-26T07:51:40.385502+0000","last_clean":"2024-04-26T07:51:40.385502+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:51:40.385502+0000","last_undegraded":"2024-04-26T07:51:40.385502+0000","last_fullsized":"2024-04-26T07:51:40.385502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433368+0000","last_change":"2024-04-26T07:51:40.433368+0000","last_active":"2024-04-26T07:51:40.433368+0000","last_peered":"2024-04-26T07:51:40.433368+0000","last_clean":"2024-04-26T07:51:40.433368+0000","last_became_active":"2024-04-26T07:51:40.432230+0000","last_became_peered":"2024-04-26T07:51:40.432230+0000","last_unstale":"2024-04-26T07:51:40.433368+0000","last_undegraded":"2024-04-26T07:51:40.433368+0000","last_fullsized":"2024-04-26T07:51:40.433368+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:04.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401063+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:51:40.401063+0000","last_peered":"2024-04-26T07:51:40.401063+0000","last_clean":"2024-04-26T07:51:40.401063+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:51:40.401063+0000","last_undegraded":"2024-04-26T07:51:40.401063+0000","last_fullsized":"2024-04-26T07:51:40.401063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"90'28","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415147+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:51:40.415147+0000","last_peered":"2024-04-26T07:51:40.415147+0000","last_clean":"2024-04-26T07:51:40.415147+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:51:40.415147+0000","last_undegraded":"2024-04-26T07:51:40.415147+0000","last_fullsized":"2024-04-26T07:51:40.415147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413866+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:51:40.413866+0000","last_peered":"2024-04-26T07:51:40.413866+0000","last_clean":"2024-04-26T07:51:40.413866+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:51:40.413866+0000","last_undegraded":"2024-04-26T07:51:40.413866+0000","last_fullsized":"2024-04-26T07:51:40.413866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"90'18","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385678+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:40.385678+0000","last_peered":"2024-04-26T07:51:40.385678+0000","last_clean":"2024-04-26T07:51:40.385678+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:40.385678+0000","last_undegraded":"2024-04-26T07:51:40.385678+0000","last_fullsized":"2024-04-26T07:51:40.385678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408447+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:40.408447+0000","last_peered":"2024-04-26T07:51:40.408447+0000","last_clean":"2024-04-26T07:51:40.408447+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:40.408447+0000","last_undegraded":"2024-04-26T07:51:40.408447+0000","last_fullsized":"2024-04-26T07:51:40.408447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393764+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:40.393764+0000","last_peered":"2024-04-26T07:51:40.393764+0000","last_clean":"2024-04-26T07:51:40.393764+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:40.393764+0000","last_undegraded":"2024-04-26T07:51:40.393764+0000","last_fullsized":"2024-04-26T07:51:40.393764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391427+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:40.391427+0000","last_peered":"2024-04-26T07:51:40.391427+0000","last_clean":"2024-04-26T07:51:40.391427+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:40.391427+0000","last_undegraded":"2024-04-26T07:51:40.391427+0000","last_fullsized":"2024-04-26T07:51:40.391427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'27","reported_seq":163,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399353+0000","last_change":"2024-04-26T07:49:08.971107+0000","last_active":"2024-04-26T07:51:40.399353+0000","last_peered":"2024-04-26T07:51:40.399353+0000","last_clean":"2024-04-26T07:51:40.399353+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:51:40.399353+0000","last_undegraded":"2024-04-26T07:51:40.399353+0000","last_fullsized":"2024-04-26T07:51:40.399353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:06.980641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394746+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:40.394746+0000","last_peered":"2024-04-26T07:51:40.394746+0000","last_clean":"2024-04-26T07:51:40.394746+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:40.394746+0000","last_undegraded":"2024-04-26T07:51:40.394746+0000","last_fullsized":"2024-04-26T07:51:40.394746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"90'13","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392754+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:51:40.392754+0000","last_peered":"2024-04-26T07:51:40.392754+0000","last_clean":"2024-04-26T07:51:40.392754+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:51:40.392754+0000","last_undegraded":"2024-04-26T07:51:40.392754+0000","last_fullsized":"2024-04-26T07:51:40.392754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395141+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:40.395141+0000","last_peered":"2024-04-26T07:51:40.395141+0000","last_clean":"2024-04-26T07:51:40.395141+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:40.395141+0000","last_undegraded":"2024-04-26T07:51:40.395141+0000","last_fullsized":"2024-04-26T07:51:40.395141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":128,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.446873+0000","last_change":"2024-04-26T07:51:40.446873+0000","last_active":"2024-04-26T07:51:40.446873+0000","last_peered":"2024-04-26T07:51:40.446873+0000","last_clean":"2024-04-26T07:51:40.446873+0000","last_became_active":"2024-04-26T07:51:40.440377+0000","last_became_peered":"2024-04-26T07:51:40.440377+0000","last_unstale":"2024-04-26T07:51:40.446873+0000","last_undegraded":"2024-04-26T07:51:40.446873+0000","last_fullsized":"2024-04-26T07:51:40.446873+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:01.888159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395378+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:40.395378+0000","last_peered":"2024-04-26T07:51:40.395378+0000","last_clean":"2024-04-26T07:51:40.395378+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:40.395378+0000","last_undegraded":"2024-04-26T07:51:40.395378+0000","last_fullsized":"2024-04-26T07:51:40.395378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'25","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388214+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:40.388214+0000","last_peered":"2024-04-26T07:51:40.388214+0000","last_clean":"2024-04-26T07:51:40.388214+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:40.388214+0000","last_undegraded":"2024-04-26T07:51:40.388214+0000","last_fullsized":"2024-04-26T07:51:40.388214+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:34.437375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408789+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:51:40.408789+0000","last_peered":"2024-04-26T07:51:40.408789+0000","last_clean":"2024-04-26T07:51:40.408789+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:51:40.408789+0000","last_undegraded":"2024-04-26T07:51:40.408789+0000","last_fullsized":"2024-04-26T07:51:40.408789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"90'17","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400133+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:51:40.400133+0000","last_peered":"2024-04-26T07:51:40.400133+0000","last_clean":"2024-04-26T07:51:40.400133+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:51:40.400133+0000","last_undegraded":"2024-04-26T07:51:40.400133+0000","last_fullsized":"2024-04-26T07:51:40.400133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387124+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:51:40.387124+0000","last_peered":"2024-04-26T07:51:40.387124+0000","last_clean":"2024-04-26T07:51:40.387124+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:40.387124+0000","last_undegraded":"2024-04-26T07:51:40.387124+0000","last_fullsized":"2024-04-26T07:51:40.387124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399528+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:40.399528+0000","last_peered":"2024-04-26T07:51:40.399528+0000","last_clean":"2024-04-26T07:51:40.399528+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:40.399528+0000","last_undegraded":"2024-04-26T07:51:40.399528+0000","last_fullsized":"2024-04-26T07:51:40.399528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410351+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:51:40.410351+0000","last_peered":"2024-04-26T07:51:40.410351+0000","last_clean":"2024-04-26T07:51:40.410351+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:51:40.410351+0000","last_undegraded":"2024-04-26T07:51:40.410351+0000","last_fullsized":"2024-04-26T07:51:40.410351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408072+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:51:40.408072+0000","last_peered":"2024-04-26T07:51:40.408072+0000","last_clean":"2024-04-26T07:51:40.408072+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:51:40.408072+0000","last_undegraded":"2024-04-26T07:51:40.408072+0000","last_fullsized":"2024-04-26T07:51:40.408072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410664+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:51:40.410664+0000","last_peered":"2024-04-26T07:51:40.410664+0000","last_clean":"2024-04-26T07:51:40.410664+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:51:40.410664+0000","last_undegraded":"2024-04-26T07:51:40.410664+0000","last_fullsized":"2024-04-26T07:51:40.410664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'26","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398857+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:51:40.398857+0000","last_peered":"2024-04-26T07:51:40.398857+0000","last_clean":"2024-04-26T07:51:40.398857+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:51:40.398857+0000","last_undegraded":"2024-04-26T07:51:40.398857+0000","last_fullsized":"2024-04-26T07:51:40.398857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414531+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:51:40.414531+0000","last_peered":"2024-04-26T07:51:40.414531+0000","last_clean":"2024-04-26T07:51:40.414531+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:51:40.414531+0000","last_undegraded":"2024-04-26T07:51:40.414531+0000","last_fullsized":"2024-04-26T07:51:40.414531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"89'18","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414182+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:40.414182+0000","last_peered":"2024-04-26T07:51:40.414182+0000","last_clean":"2024-04-26T07:51:40.414182+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:40.414182+0000","last_undegraded":"2024-04-26T07:51:40.414182+0000","last_fullsized":"2024-04-26T07:51:40.414182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409820+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:51:40.409820+0000","last_peered":"2024-04-26T07:51:40.409820+0000","last_clean":"2024-04-26T07:51:40.409820+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:51:40.409820+0000","last_undegraded":"2024-04-26T07:51:40.409820+0000","last_fullsized":"2024-04-26T07:51:40.409820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'23","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387539+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:40.387539+0000","last_peered":"2024-04-26T07:51:40.387539+0000","last_clean":"2024-04-26T07:51:40.387539+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:40.387539+0000","last_undegraded":"2024-04-26T07:51:40.387539+0000","last_fullsized":"2024-04-26T07:51:40.387539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392517+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:51:40.392517+0000","last_peered":"2024-04-26T07:51:40.392517+0000","last_clean":"2024-04-26T07:51:40.392517+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:51:40.392517+0000","last_undegraded":"2024-04-26T07:51:40.392517+0000","last_fullsized":"2024-04-26T07:51:40.392517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'32","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393638+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:40.393638+0000","last_peered":"2024-04-26T07:51:40.393638+0000","last_clean":"2024-04-26T07:51:40.393638+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:40.393638+0000","last_undegraded":"2024-04-26T07:51:40.393638+0000","last_fullsized":"2024-04-26T07:51:40.393638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401267+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:51:40.401267+0000","last_peered":"2024-04-26T07:51:40.401267+0000","last_clean":"2024-04-26T07:51:40.401267+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:51:40.401267+0000","last_undegraded":"2024-04-26T07:51:40.401267+0000","last_fullsized":"2024-04-26T07:51:40.401267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"89'35","reported_seq":227,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410520+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:40.410520+0000","last_peered":"2024-04-26T07:51:40.410520+0000","last_clean":"2024-04-26T07:51:40.410520+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:40.410520+0000","last_undegraded":"2024-04-26T07:51:40.410520+0000","last_fullsized":"2024-04-26T07:51:40.410520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391161+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:51:40.391161+0000","last_peered":"2024-04-26T07:51:40.391161+0000","last_clean":"2024-04-26T07:51:40.391161+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:51:40.391161+0000","last_undegraded":"2024-04-26T07:51:40.391161+0000","last_fullsized":"2024-04-26T07:51:40.391161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"89'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412598+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:51:40.412598+0000","last_peered":"2024-04-26T07:51:40.412598+0000","last_clean":"2024-04-26T07:51:40.412598+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:51:40.412598+0000","last_undegraded":"2024-04-26T07:51:40.412598+0000","last_fullsized":"2024-04-26T07:51:40.412598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407803+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:51:40.407803+0000","last_peered":"2024-04-26T07:51:40.407803+0000","last_clean":"2024-04-26T07:51:40.407803+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:51:40.407803+0000","last_undegraded":"2024-04-26T07:51:40.407803+0000","last_fullsized":"2024-04-26T07:51:40.407803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394239+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:40.394239+0000","last_peered":"2024-04-26T07:51:40.394239+0000","last_clean":"2024-04-26T07:51:40.394239+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:40.394239+0000","last_undegraded":"2024-04-26T07:51:40.394239+0000","last_fullsized":"2024-04-26T07:51:40.394239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388114+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:51:40.388114+0000","last_peered":"2024-04-26T07:51:40.388114+0000","last_clean":"2024-04-26T07:51:40.388114+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:51:40.388114+0000","last_undegraded":"2024-04-26T07:51:40.388114+0000","last_fullsized":"2024-04-26T07:51:40.388114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410876+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:40.410876+0000","last_peered":"2024-04-26T07:51:40.410876+0000","last_clean":"2024-04-26T07:51:40.410876+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:40.410876+0000","last_undegraded":"2024-04-26T07:51:40.410876+0000","last_fullsized":"2024-04-26T07:51:40.410876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397867+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:51:40.397867+0000","last_peered":"2024-04-26T07:51:40.397867+0000","last_clean":"2024-04-26T07:51:40.397867+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:51:40.397867+0000","last_undegraded":"2024-04-26T07:51:40.397867+0000","last_fullsized":"2024-04-26T07:51:40.397867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391523+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:40.391523+0000","last_peered":"2024-04-26T07:51:40.391523+0000","last_clean":"2024-04-26T07:51:40.391523+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:40.391523+0000","last_undegraded":"2024-04-26T07:51:40.391523+0000","last_fullsized":"2024-04-26T07:51:40.391523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399068+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:51:40.399068+0000","last_peered":"2024-04-26T07:51:40.399068+0000","last_clean":"2024-04-26T07:51:40.399068+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:51:40.399068+0000","last_undegraded":"2024-04-26T07:51:40.399068+0000","last_fullsized":"2024-04-26T07:51:40.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'14","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414006+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:51:40.414006+0000","last_peered":"2024-04-26T07:51:40.414006+0000","last_clean":"2024-04-26T07:51:40.414006+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:51:40.414006+0000","last_undegraded":"2024-04-26T07:51:40.414006+0000","last_fullsized":"2024-04-26T07:51:40.414006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398879+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:51:40.398879+0000","last_peered":"2024-04-26T07:51:40.398879+0000","last_clean":"2024-04-26T07:51:40.398879+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:51:40.398879+0000","last_undegraded":"2024-04-26T07:51:40.398879+0000","last_fullsized":"2024-04-26T07:51:40.398879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'27","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387769+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:40.387769+0000","last_peered":"2024-04-26T07:51:40.387769+0000","last_clean":"2024-04-26T07:51:40.387769+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:40.387769+0000","last_undegraded":"2024-04-26T07:51:40.387769+0000","last_fullsized":"2024-04-26T07:51:40.387769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":162,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428116+0000","last_change":"2024-04-26T07:51:40.428116+0000","last_active":"2024-04-26T07:51:40.428116+0000","last_peered":"2024-04-26T07:51:40.428116+0000","last_clean":"2024-04-26T07:51:40.428116+0000","last_became_active":"2024-04-26T07:51:40.427193+0000","last_became_peered":"2024-04-26T07:51:40.427193+0000","last_unstale":"2024-04-26T07:51:40.428116+0000","last_undegraded":"2024-04-26T07:51:40.428116+0000","last_fullsized":"2024-04-26T07:51:40.428116+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:06.591882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411819+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:40.411819+0000","last_peered":"2024-04-26T07:51:40.411819+0000","last_clean":"2024-04-26T07:51:40.411819+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:40.411819+0000","last_undegraded":"2024-04-26T07:51:40.411819+0000","last_fullsized":"2024-04-26T07:51:40.411819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386601+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:51:40.386601+0000","last_peered":"2024-04-26T07:51:40.386601+0000","last_clean":"2024-04-26T07:51:40.386601+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:51:40.386601+0000","last_undegraded":"2024-04-26T07:51:40.386601+0000","last_fullsized":"2024-04-26T07:51:40.386601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.449013+0000","last_change":"2024-04-26T07:51:40.449013+0000","last_active":"2024-04-26T07:51:40.449013+0000","last_peered":"2024-04-26T07:51:40.449013+0000","last_clean":"2024-04-26T07:51:40.449013+0000","last_became_active":"2024-04-26T07:51:40.445977+0000","last_became_peered":"2024-04-26T07:51:40.445977+0000","last_unstale":"2024-04-26T07:51:40.449013+0000","last_undegraded":"2024-04-26T07:51:40.449013+0000","last_fullsized":"2024-04-26T07:51:40.449013+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:19.331650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391050+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:51:40.391050+0000","last_peered":"2024-04-26T07:51:40.391050+0000","last_clean":"2024-04-26T07:51:40.391050+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:51:40.391050+0000","last_undegraded":"2024-04-26T07:51:40.391050+0000","last_fullsized":"2024-04-26T07:51:40.391050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"89'32","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399748+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:51:40.399748+0000","last_peered":"2024-04-26T07:51:40.399748+0000","last_clean":"2024-04-26T07:51:40.399748+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:51:40.399748+0000","last_undegraded":"2024-04-26T07:51:40.399748+0000","last_fullsized":"2024-04-26T07:51:40.399748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":169,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436803+0000","last_change":"2024-04-26T07:51:40.436803+0000","last_active":"2024-04-26T07:51:40.436803+0000","last_peered":"2024-04-26T07:51:40.436803+0000","last_clean":"2024-04-26T07:51:40.436803+0000","last_became_active":"2024-04-26T07:51:40.433471+0000","last_became_peered":"2024-04-26T07:51:40.433471+0000","last_unstale":"2024-04-26T07:51:40.436803+0000","last_undegraded":"2024-04-26T07:51:40.436803+0000","last_fullsized":"2024-04-26T07:51:40.436803+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:23.227977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417251+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:40.417251+0000","last_peered":"2024-04-26T07:51:40.417251+0000","last_clean":"2024-04-26T07:51:40.417251+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:40.417251+0000","last_undegraded":"2024-04-26T07:51:40.417251+0000","last_fullsized":"2024-04-26T07:51:40.417251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"89'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410612+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:40.410612+0000","last_peered":"2024-04-26T07:51:40.410612+0000","last_clean":"2024-04-26T07:51:40.410612+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:40.410612+0000","last_undegraded":"2024-04-26T07:51:40.410612+0000","last_fullsized":"2024-04-26T07:51:40.410612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388025+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:51:40.388025+0000","last_peered":"2024-04-26T07:51:40.388025+0000","last_clean":"2024-04-26T07:51:40.388025+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:51:40.388025+0000","last_undegraded":"2024-04-26T07:51:40.388025+0000","last_fullsized":"2024-04-26T07:51:40.388025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'29","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409213+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:51:40.409213+0000","last_peered":"2024-04-26T07:51:40.409213+0000","last_clean":"2024-04-26T07:51:40.409213+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:51:40.409213+0000","last_undegraded":"2024-04-26T07:51:40.409213+0000","last_fullsized":"2024-04-26T07:51:40.409213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415075+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:51:40.415075+0000","last_peered":"2024-04-26T07:51:40.415075+0000","last_clean":"2024-04-26T07:51:40.415075+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:51:40.415075+0000","last_undegraded":"2024-04-26T07:51:40.415075+0000","last_fullsized":"2024-04-26T07:51:40.415075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1074,"ondisk_log_size":1074,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":852,"num_read_kb":617,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":759,"ondisk_log_size":759,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1446,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716668,"kb_used_data":1685480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92655172,"statfs":{"total":96636764160,"available":94878896128,"internally_reserved":0,"allocated":1725931520,"data_stored":1725333608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203996,"kb_used_data":1172812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93167844,"statfs":{"total":96636764160,"available":95403872256,"internally_reserved":0,"allocated":1200959488,"data_stored":1200395317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812536,"kb_used_data":1777192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92559304,"statfs":{"total":96636764160,"available":94780727296,"internally_reserved":0,"allocated":1819844608,"data_stored":1819232747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1935060,"kb_used_data":1903876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92436780,"statfs":{"total":96636764160,"available":94655262720,"internally_reserved":0,"allocated":1949569024,"data_stored":1949020427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1877944,"kb_used_data":1842600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92493896,"statfs":{"total":96636764160,"available":94713749504,"internally_reserved":0,"allocated":1886822400,"data_stored":1886225804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1122128,"kb_used_data":1086784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93249712,"statfs":{"total":96636764160,"available":95487705088,"internally_reserved":0,"allocated":1112866816,"data_stored":1112315550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185708,"kb_used_data":1150364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93186132,"statfs":{"total":96636764160,"available":95422599168,"internally_reserved":0,"allocated":1177972736,"data_stored":1177387279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1732984,"kb_used_data":1697636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92638856,"statfs":{"total":96636764160,"available":94862188544,"internally_reserved":0,"allocated":1738379264,"data_stored":1737800572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1736441856,"data_stored":1736441856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1176502272,"data_stored":1176502272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1885339648,"data_stored":1885339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1948254208,"data_stored":1948254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1199570944,"data_stored":1199570944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1723858944,"data_stored":1723858944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":118389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:51:48.583 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T07:51:48.583 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T07:51:48.952 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-26T07:51:48.962 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-26T07:51:48.962 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:51:48.963 INFO:tasks.rgw.client.0.smithi053.stdout:2024-04-26T07:51:48.961+0000 7f2fb510e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31242) UID: 0 2024-04-26T07:51:48.963 INFO:tasks.rgw.client.0.smithi053.stdout:2024-04-26T07:51:48.961+0000 7f2fb8956a40 -1 shutting down 2024-04-26T07:51:50.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-26T07:51:55.064 INFO:tasks.rgw.client.0:Stopped 2024-04-26T07:51:55.065 DEBUG:teuthology.orchestra.run.smithi053:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-26T07:51:55.072 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/vault-root-token 2024-04-26T07:51:55.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-26T07:51:55.183 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-26T07:51:55.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-26T07:51:55.183 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-26T07:51:56.498 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T07:51:56.508 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T07:51:56.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:51:56.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-26T07:51:56.824 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:56.830 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:51:56.841 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-26T07:51:55.855160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3285,"num_read_kb":2974,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3904,"ondisk_log_size":3904,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12586972,"kb_used_data":12316744,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":742387748,"statfs":{"total":773094113280,"available":760205053952,"internally_reserved":0,"allocated":12612345856,"data_stored":12607711304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005853"},"pg_stats":[{"pgid":"3.3f","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.419563+0000","last_change":"2024-04-26T07:51:40.419563+0000","last_active":"2024-04-26T07:51:40.419563+0000","last_peered":"2024-04-26T07:51:40.419563+0000","last_clean":"2024-04-26T07:51:40.419563+0000","last_became_active":"2024-04-26T07:51:40.418691+0000","last_became_peered":"2024-04-26T07:51:40.418691+0000","last_unstale":"2024-04-26T07:51:40.419563+0000","last_undegraded":"2024-04-26T07:51:40.419563+0000","last_fullsized":"2024-04-26T07:51:40.419563+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:26.560585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410032+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:51:40.410032+0000","last_peered":"2024-04-26T07:51:40.410032+0000","last_clean":"2024-04-26T07:51:40.410032+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:51:40.410032+0000","last_undegraded":"2024-04-26T07:51:40.410032+0000","last_fullsized":"2024-04-26T07:51:40.410032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'26","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410817+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:51:40.410817+0000","last_peered":"2024-04-26T07:51:40.410817+0000","last_clean":"2024-04-26T07:51:40.410817+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:51:40.410817+0000","last_undegraded":"2024-04-26T07:51:40.410817+0000","last_fullsized":"2024-04-26T07:51:40.410817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":144,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.439485+0000","last_change":"2024-04-26T07:51:40.439485+0000","last_active":"2024-04-26T07:51:40.439485+0000","last_peered":"2024-04-26T07:51:40.439485+0000","last_clean":"2024-04-26T07:51:40.439485+0000","last_became_active":"2024-04-26T07:51:40.437448+0000","last_became_peered":"2024-04-26T07:51:40.437448+0000","last_unstale":"2024-04-26T07:51:40.439485+0000","last_undegraded":"2024-04-26T07:51:40.439485+0000","last_fullsized":"2024-04-26T07:51:40.439485+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:31.108593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387511+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:40.387511+0000","last_peered":"2024-04-26T07:51:40.387511+0000","last_clean":"2024-04-26T07:51:40.387511+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:40.387511+0000","last_undegraded":"2024-04-26T07:51:40.387511+0000","last_fullsized":"2024-04-26T07:51:40.387511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":226,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400767+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:51:40.400767+0000","last_peered":"2024-04-26T07:51:40.400767+0000","last_clean":"2024-04-26T07:51:40.400767+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:51:40.400767+0000","last_undegraded":"2024-04-26T07:51:40.400767+0000","last_fullsized":"2024-04-26T07:51:40.400767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414495+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:40.414495+0000","last_peered":"2024-04-26T07:51:40.414495+0000","last_clean":"2024-04-26T07:51:40.414495+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:40.414495+0000","last_undegraded":"2024-04-26T07:51:40.414495+0000","last_fullsized":"2024-04-26T07:51:40.414495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387443+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:40.387443+0000","last_peered":"2024-04-26T07:51:40.387443+0000","last_clean":"2024-04-26T07:51:40.387443+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:40.387443+0000","last_undegraded":"2024-04-26T07:51:40.387443+0000","last_fullsized":"2024-04-26T07:51:40.387443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'23","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435742+0000","last_change":"2024-04-26T07:51:40.435742+0000","last_active":"2024-04-26T07:51:40.435742+0000","last_peered":"2024-04-26T07:51:40.435742+0000","last_clean":"2024-04-26T07:51:40.435742+0000","last_became_active":"2024-04-26T07:51:40.433215+0000","last_became_peered":"2024-04-26T07:51:40.433215+0000","last_unstale":"2024-04-26T07:51:40.435742+0000","last_undegraded":"2024-04-26T07:51:40.435742+0000","last_fullsized":"2024-04-26T07:51:40.435742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:42.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411494+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:51:40.411494+0000","last_peered":"2024-04-26T07:51:40.411494+0000","last_clean":"2024-04-26T07:51:40.411494+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:51:40.411494+0000","last_undegraded":"2024-04-26T07:51:40.411494+0000","last_fullsized":"2024-04-26T07:51:40.411494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'22","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413726+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:51:40.413726+0000","last_peered":"2024-04-26T07:51:40.413726+0000","last_clean":"2024-04-26T07:51:40.413726+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:51:40.413726+0000","last_undegraded":"2024-04-26T07:51:40.413726+0000","last_fullsized":"2024-04-26T07:51:40.413726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396370+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:51:40.396370+0000","last_peered":"2024-04-26T07:51:40.396370+0000","last_clean":"2024-04-26T07:51:40.396370+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:51:40.396370+0000","last_undegraded":"2024-04-26T07:51:40.396370+0000","last_fullsized":"2024-04-26T07:51:40.396370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'19","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429122+0000","last_change":"2024-04-26T07:51:40.429122+0000","last_active":"2024-04-26T07:51:40.429122+0000","last_peered":"2024-04-26T07:51:40.429122+0000","last_clean":"2024-04-26T07:51:40.429122+0000","last_became_active":"2024-04-26T07:51:40.428267+0000","last_became_peered":"2024-04-26T07:51:40.428267+0000","last_unstale":"2024-04-26T07:51:40.429122+0000","last_undegraded":"2024-04-26T07:51:40.429122+0000","last_fullsized":"2024-04-26T07:51:40.429122+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.892584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414674+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:51:40.414674+0000","last_peered":"2024-04-26T07:51:40.414674+0000","last_clean":"2024-04-26T07:51:40.414674+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:51:40.414674+0000","last_undegraded":"2024-04-26T07:51:40.414674+0000","last_fullsized":"2024-04-26T07:51:40.414674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"89'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390795+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:40.390795+0000","last_peered":"2024-04-26T07:51:40.390795+0000","last_clean":"2024-04-26T07:51:40.390795+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:40.390795+0000","last_undegraded":"2024-04-26T07:51:40.390795+0000","last_fullsized":"2024-04-26T07:51:40.390795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399387+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:51:40.399387+0000","last_peered":"2024-04-26T07:51:40.399387+0000","last_clean":"2024-04-26T07:51:40.399387+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:51:40.399387+0000","last_undegraded":"2024-04-26T07:51:40.399387+0000","last_fullsized":"2024-04-26T07:51:40.399387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395530+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:51:40.395530+0000","last_peered":"2024-04-26T07:51:40.395530+0000","last_clean":"2024-04-26T07:51:40.395530+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:51:40.395530+0000","last_undegraded":"2024-04-26T07:51:40.395530+0000","last_fullsized":"2024-04-26T07:51:40.395530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'25","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429380+0000","last_change":"2024-04-26T07:51:40.429380+0000","last_active":"2024-04-26T07:51:40.429380+0000","last_peered":"2024-04-26T07:51:40.429380+0000","last_clean":"2024-04-26T07:51:40.429380+0000","last_became_active":"2024-04-26T07:51:40.428461+0000","last_became_peered":"2024-04-26T07:51:40.428461+0000","last_unstale":"2024-04-26T07:51:40.429380+0000","last_undegraded":"2024-04-26T07:51:40.429380+0000","last_fullsized":"2024-04-26T07:51:40.429380+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.386208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437638+0000","last_change":"2024-04-26T07:51:40.437638+0000","last_active":"2024-04-26T07:51:40.437638+0000","last_peered":"2024-04-26T07:51:40.437638+0000","last_clean":"2024-04-26T07:51:40.437638+0000","last_became_active":"2024-04-26T07:51:40.435585+0000","last_became_peered":"2024-04-26T07:51:40.435585+0000","last_unstale":"2024-04-26T07:51:40.437638+0000","last_undegraded":"2024-04-26T07:51:40.437638+0000","last_fullsized":"2024-04-26T07:51:40.437638+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:03.283810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'31","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412304+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:51:40.412304+0000","last_peered":"2024-04-26T07:51:40.412304+0000","last_clean":"2024-04-26T07:51:40.412304+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:51:40.412304+0000","last_undegraded":"2024-04-26T07:51:40.412304+0000","last_fullsized":"2024-04-26T07:51:40.412304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":41,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413895+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:51:40.413895+0000","last_peered":"2024-04-26T07:51:40.413895+0000","last_clean":"2024-04-26T07:51:40.413895+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:51:40.413895+0000","last_undegraded":"2024-04-26T07:51:40.413895+0000","last_fullsized":"2024-04-26T07:51:40.413895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412401+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:51:40.412401+0000","last_peered":"2024-04-26T07:51:40.412401+0000","last_clean":"2024-04-26T07:51:40.412401+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:51:40.412401+0000","last_undegraded":"2024-04-26T07:51:40.412401+0000","last_fullsized":"2024-04-26T07:51:40.412401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401519+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:51:40.401519+0000","last_peered":"2024-04-26T07:51:40.401519+0000","last_clean":"2024-04-26T07:51:40.401519+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:51:40.401519+0000","last_undegraded":"2024-04-26T07:51:40.401519+0000","last_fullsized":"2024-04-26T07:51:40.401519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'24","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397971+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:40.397971+0000","last_peered":"2024-04-26T07:51:40.397971+0000","last_clean":"2024-04-26T07:51:40.397971+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:40.397971+0000","last_undegraded":"2024-04-26T07:51:40.397971+0000","last_fullsized":"2024-04-26T07:51:40.397971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399756+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:51:40.399756+0000","last_peered":"2024-04-26T07:51:40.399756+0000","last_clean":"2024-04-26T07:51:40.399756+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:51:40.399756+0000","last_undegraded":"2024-04-26T07:51:40.399756+0000","last_fullsized":"2024-04-26T07:51:40.399756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392181+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:40.392181+0000","last_peered":"2024-04-26T07:51:40.392181+0000","last_clean":"2024-04-26T07:51:40.392181+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:40.392181+0000","last_undegraded":"2024-04-26T07:51:40.392181+0000","last_fullsized":"2024-04-26T07:51:40.392181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396627+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:51:40.396627+0000","last_peered":"2024-04-26T07:51:40.396627+0000","last_clean":"2024-04-26T07:51:40.396627+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:51:40.396627+0000","last_undegraded":"2024-04-26T07:51:40.396627+0000","last_fullsized":"2024-04-26T07:51:40.396627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"90'24","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386874+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:40.386874+0000","last_peered":"2024-04-26T07:51:40.386874+0000","last_clean":"2024-04-26T07:51:40.386874+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:40.386874+0000","last_undegraded":"2024-04-26T07:51:40.386874+0000","last_fullsized":"2024-04-26T07:51:40.386874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394620+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:40.394620+0000","last_peered":"2024-04-26T07:51:40.394620+0000","last_clean":"2024-04-26T07:51:40.394620+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:40.394620+0000","last_undegraded":"2024-04-26T07:51:40.394620+0000","last_fullsized":"2024-04-26T07:51:40.394620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393414+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:40.393414+0000","last_peered":"2024-04-26T07:51:40.393414+0000","last_clean":"2024-04-26T07:51:40.393414+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:40.393414+0000","last_undegraded":"2024-04-26T07:51:40.393414+0000","last_fullsized":"2024-04-26T07:51:40.393414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'19","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401423+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:40.401423+0000","last_peered":"2024-04-26T07:51:40.401423+0000","last_clean":"2024-04-26T07:51:40.401423+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:40.401423+0000","last_undegraded":"2024-04-26T07:51:40.401423+0000","last_fullsized":"2024-04-26T07:51:40.401423+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:08.704021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414398+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:40.414398+0000","last_peered":"2024-04-26T07:51:40.414398+0000","last_clean":"2024-04-26T07:51:40.414398+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:40.414398+0000","last_undegraded":"2024-04-26T07:51:40.414398+0000","last_fullsized":"2024-04-26T07:51:40.414398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"90'17","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387664+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:40.387664+0000","last_peered":"2024-04-26T07:51:40.387664+0000","last_clean":"2024-04-26T07:51:40.387664+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:40.387664+0000","last_undegraded":"2024-04-26T07:51:40.387664+0000","last_fullsized":"2024-04-26T07:51:40.387664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427384+0000","last_change":"2024-04-26T07:51:40.427384+0000","last_active":"2024-04-26T07:51:40.427384+0000","last_peered":"2024-04-26T07:51:40.427384+0000","last_clean":"2024-04-26T07:51:40.427384+0000","last_became_active":"2024-04-26T07:51:40.424563+0000","last_became_peered":"2024-04-26T07:51:40.424563+0000","last_unstale":"2024-04-26T07:51:40.427384+0000","last_undegraded":"2024-04-26T07:51:40.427384+0000","last_fullsized":"2024-04-26T07:51:40.427384+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:45.363785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409995+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:40.409995+0000","last_peered":"2024-04-26T07:51:40.409995+0000","last_clean":"2024-04-26T07:51:40.409995+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:40.409995+0000","last_undegraded":"2024-04-26T07:51:40.409995+0000","last_fullsized":"2024-04-26T07:51:40.409995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415011+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:51:40.415011+0000","last_peered":"2024-04-26T07:51:40.415011+0000","last_clean":"2024-04-26T07:51:40.415011+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:51:40.415011+0000","last_undegraded":"2024-04-26T07:51:40.415011+0000","last_fullsized":"2024-04-26T07:51:40.415011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386993+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:40.386993+0000","last_peered":"2024-04-26T07:51:40.386993+0000","last_clean":"2024-04-26T07:51:40.386993+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:40.386993+0000","last_undegraded":"2024-04-26T07:51:40.386993+0000","last_fullsized":"2024-04-26T07:51:40.386993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393282+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:40.393282+0000","last_peered":"2024-04-26T07:51:40.393282+0000","last_clean":"2024-04-26T07:51:40.393282+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:40.393282+0000","last_undegraded":"2024-04-26T07:51:40.393282+0000","last_fullsized":"2024-04-26T07:51:40.393282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"53'7","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397138+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:51:40.397138+0000","last_peered":"2024-04-26T07:51:40.397138+0000","last_clean":"2024-04-26T07:51:40.397138+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:51:40.397138+0000","last_undegraded":"2024-04-26T07:51:40.397138+0000","last_fullsized":"2024-04-26T07:51:40.397138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396318+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:40.396318+0000","last_peered":"2024-04-26T07:51:40.396318+0000","last_clean":"2024-04-26T07:51:40.396318+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:40.396318+0000","last_undegraded":"2024-04-26T07:51:40.396318+0000","last_fullsized":"2024-04-26T07:51:40.396318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386651+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:51:40.386651+0000","last_peered":"2024-04-26T07:51:40.386651+0000","last_clean":"2024-04-26T07:51:40.386651+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:51:40.386651+0000","last_undegraded":"2024-04-26T07:51:40.386651+0000","last_fullsized":"2024-04-26T07:51:40.386651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388934+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:51:40.388934+0000","last_peered":"2024-04-26T07:51:40.388934+0000","last_clean":"2024-04-26T07:51:40.388934+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:51:40.388934+0000","last_undegraded":"2024-04-26T07:51:40.388934+0000","last_fullsized":"2024-04-26T07:51:40.388934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'22","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441938+0000","last_change":"2024-04-26T07:51:40.441938+0000","last_active":"2024-04-26T07:51:40.441938+0000","last_peered":"2024-04-26T07:51:40.441938+0000","last_clean":"2024-04-26T07:51:40.441938+0000","last_became_active":"2024-04-26T07:51:40.440255+0000","last_became_peered":"2024-04-26T07:51:40.440255+0000","last_unstale":"2024-04-26T07:51:40.441938+0000","last_undegraded":"2024-04-26T07:51:40.441938+0000","last_fullsized":"2024-04-26T07:51:40.441938+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:49.106793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394846+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:40.394846+0000","last_peered":"2024-04-26T07:51:40.394846+0000","last_clean":"2024-04-26T07:51:40.394846+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:40.394846+0000","last_undegraded":"2024-04-26T07:51:40.394846+0000","last_fullsized":"2024-04-26T07:51:40.394846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399562+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:51:40.399562+0000","last_peered":"2024-04-26T07:51:40.399562+0000","last_clean":"2024-04-26T07:51:40.399562+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:51:40.399562+0000","last_undegraded":"2024-04-26T07:51:40.399562+0000","last_fullsized":"2024-04-26T07:51:40.399562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"109'137","reported_seq":311,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807192+0000","last_change":"2024-04-26T07:51:40.446383+0000","last_active":"2024-04-26T07:51:45.807192+0000","last_peered":"2024-04-26T07:51:45.807192+0000","last_clean":"2024-04-26T07:51:45.807192+0000","last_became_active":"2024-04-26T07:51:40.439601+0000","last_became_peered":"2024-04-26T07:51:40.439601+0000","last_unstale":"2024-04-26T07:51:45.807192+0000","last_undegraded":"2024-04-26T07:51:45.807192+0000","last_fullsized":"2024-04-26T07:51:45.807192+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:32.966811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395932+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:40.395932+0000","last_peered":"2024-04-26T07:51:40.395932+0000","last_clean":"2024-04-26T07:51:40.395932+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:40.395932+0000","last_undegraded":"2024-04-26T07:51:40.395932+0000","last_fullsized":"2024-04-26T07:51:40.395932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394102+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:51:40.394102+0000","last_peered":"2024-04-26T07:51:40.394102+0000","last_clean":"2024-04-26T07:51:40.394102+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:51:40.394102+0000","last_undegraded":"2024-04-26T07:51:40.394102+0000","last_fullsized":"2024-04-26T07:51:40.394102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'17","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408341+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:51:40.408341+0000","last_peered":"2024-04-26T07:51:40.408341+0000","last_clean":"2024-04-26T07:51:40.408341+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:51:40.408341+0000","last_undegraded":"2024-04-26T07:51:40.408341+0000","last_fullsized":"2024-04-26T07:51:40.408341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414412+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:40.414412+0000","last_peered":"2024-04-26T07:51:40.414412+0000","last_clean":"2024-04-26T07:51:40.414412+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:40.414412+0000","last_undegraded":"2024-04-26T07:51:40.414412+0000","last_fullsized":"2024-04-26T07:51:40.414412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"90'17","reported_seq":159,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.447428+0000","last_change":"2024-04-26T07:51:40.447428+0000","last_active":"2024-04-26T07:51:40.447428+0000","last_peered":"2024-04-26T07:51:40.447428+0000","last_clean":"2024-04-26T07:51:40.447428+0000","last_became_active":"2024-04-26T07:51:40.441381+0000","last_became_peered":"2024-04-26T07:51:40.441381+0000","last_unstale":"2024-04-26T07:51:40.447428+0000","last_undegraded":"2024-04-26T07:51:40.447428+0000","last_fullsized":"2024-04-26T07:51:40.447428+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:19.309516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"109'135","reported_seq":352,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804804+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:51:45.804804+0000","last_peered":"2024-04-26T07:51:45.804804+0000","last_clean":"2024-04-26T07:51:45.804804+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:51:45.804804+0000","last_undegraded":"2024-04-26T07:51:45.804804+0000","last_fullsized":"2024-04-26T07:51:45.804804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410355+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:51:40.410355+0000","last_peered":"2024-04-26T07:51:40.410355+0000","last_clean":"2024-04-26T07:51:40.410355+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:51:40.410355+0000","last_undegraded":"2024-04-26T07:51:40.410355+0000","last_fullsized":"2024-04-26T07:51:40.410355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433314+0000","last_change":"2024-04-26T07:51:40.433314+0000","last_active":"2024-04-26T07:51:40.433314+0000","last_peered":"2024-04-26T07:51:40.433314+0000","last_clean":"2024-04-26T07:51:40.433314+0000","last_became_active":"2024-04-26T07:51:40.432352+0000","last_became_peered":"2024-04-26T07:51:40.432352+0000","last_unstale":"2024-04-26T07:51:40.433314+0000","last_undegraded":"2024-04-26T07:51:40.433314+0000","last_fullsized":"2024-04-26T07:51:40.433314+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:27.681250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436814+0000","last_change":"2024-04-26T07:51:40.436814+0000","last_active":"2024-04-26T07:51:40.436814+0000","last_peered":"2024-04-26T07:51:40.436814+0000","last_clean":"2024-04-26T07:51:40.436814+0000","last_became_active":"2024-04-26T07:51:40.432366+0000","last_became_peered":"2024-04-26T07:51:40.432366+0000","last_unstale":"2024-04-26T07:51:40.436814+0000","last_undegraded":"2024-04-26T07:51:40.436814+0000","last_fullsized":"2024-04-26T07:51:40.436814+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.091620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"90'27","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412936+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:51:40.412936+0000","last_peered":"2024-04-26T07:51:40.412936+0000","last_clean":"2024-04-26T07:51:40.412936+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:51:40.412936+0000","last_undegraded":"2024-04-26T07:51:40.412936+0000","last_fullsized":"2024-04-26T07:51:40.412936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409381+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:40.409381+0000","last_peered":"2024-04-26T07:51:40.409381+0000","last_clean":"2024-04-26T07:51:40.409381+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:40.409381+0000","last_undegraded":"2024-04-26T07:51:40.409381+0000","last_fullsized":"2024-04-26T07:51:40.409381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413984+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:40.413984+0000","last_peered":"2024-04-26T07:51:40.413984+0000","last_clean":"2024-04-26T07:51:40.413984+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:40.413984+0000","last_undegraded":"2024-04-26T07:51:40.413984+0000","last_fullsized":"2024-04-26T07:51:40.413984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395453+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:51:40.395453+0000","last_peered":"2024-04-26T07:51:40.395453+0000","last_clean":"2024-04-26T07:51:40.395453+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:51:40.395453+0000","last_undegraded":"2024-04-26T07:51:40.395453+0000","last_fullsized":"2024-04-26T07:51:40.395453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'24","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432790+0000","last_change":"2024-04-26T07:51:40.432790+0000","last_active":"2024-04-26T07:51:40.432790+0000","last_peered":"2024-04-26T07:51:40.432790+0000","last_clean":"2024-04-26T07:51:40.432790+0000","last_became_active":"2024-04-26T07:51:40.431661+0000","last_became_peered":"2024-04-26T07:51:40.431661+0000","last_unstale":"2024-04-26T07:51:40.432790+0000","last_undegraded":"2024-04-26T07:51:40.432790+0000","last_fullsized":"2024-04-26T07:51:40.432790+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:44.955807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399129+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:51:40.399129+0000","last_peered":"2024-04-26T07:51:40.399129+0000","last_clean":"2024-04-26T07:51:40.399129+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:51:40.399129+0000","last_undegraded":"2024-04-26T07:51:40.399129+0000","last_fullsized":"2024-04-26T07:51:40.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"90'17","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392602+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:51:40.392602+0000","last_peered":"2024-04-26T07:51:40.392602+0000","last_clean":"2024-04-26T07:51:40.392602+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:51:40.392602+0000","last_undegraded":"2024-04-26T07:51:40.392602+0000","last_fullsized":"2024-04-26T07:51:40.392602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391295+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:51:40.391295+0000","last_peered":"2024-04-26T07:51:40.391295+0000","last_clean":"2024-04-26T07:51:40.391295+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:51:40.391295+0000","last_undegraded":"2024-04-26T07:51:40.391295+0000","last_fullsized":"2024-04-26T07:51:40.391295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411466+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:40.411466+0000","last_peered":"2024-04-26T07:51:40.411466+0000","last_clean":"2024-04-26T07:51:40.411466+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:40.411466+0000","last_undegraded":"2024-04-26T07:51:40.411466+0000","last_fullsized":"2024-04-26T07:51:40.411466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409163+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:51:40.409163+0000","last_peered":"2024-04-26T07:51:40.409163+0000","last_clean":"2024-04-26T07:51:40.409163+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:51:40.409163+0000","last_undegraded":"2024-04-26T07:51:40.409163+0000","last_fullsized":"2024-04-26T07:51:40.409163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"89'25","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.448016+0000","last_change":"2024-04-26T07:51:40.448016+0000","last_active":"2024-04-26T07:51:40.448016+0000","last_peered":"2024-04-26T07:51:40.448016+0000","last_clean":"2024-04-26T07:51:40.448016+0000","last_became_active":"2024-04-26T07:51:40.444713+0000","last_became_peered":"2024-04-26T07:51:40.444713+0000","last_unstale":"2024-04-26T07:51:40.448016+0000","last_undegraded":"2024-04-26T07:51:40.448016+0000","last_fullsized":"2024-04-26T07:51:40.448016+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:01.400431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401762+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:51:40.401762+0000","last_peered":"2024-04-26T07:51:40.401762+0000","last_clean":"2024-04-26T07:51:40.401762+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:51:40.401762+0000","last_undegraded":"2024-04-26T07:51:40.401762+0000","last_fullsized":"2024-04-26T07:51:40.401762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"90'25","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444435+0000","last_change":"2024-04-26T07:51:40.444435+0000","last_active":"2024-04-26T07:51:40.444435+0000","last_peered":"2024-04-26T07:51:40.444435+0000","last_clean":"2024-04-26T07:51:40.444435+0000","last_became_active":"2024-04-26T07:51:40.438940+0000","last_became_peered":"2024-04-26T07:51:40.438940+0000","last_unstale":"2024-04-26T07:51:40.444435+0000","last_undegraded":"2024-04-26T07:51:40.444435+0000","last_fullsized":"2024-04-26T07:51:40.444435+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:00.682036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62803,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"109'135","reported_seq":350,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804641+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:51:45.804641+0000","last_peered":"2024-04-26T07:51:45.804641+0000","last_clean":"2024-04-26T07:51:45.804641+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:51:45.804641+0000","last_undegraded":"2024-04-26T07:51:45.804641+0000","last_fullsized":"2024-04-26T07:51:45.804641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387775+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:40.387775+0000","last_peered":"2024-04-26T07:51:40.387775+0000","last_clean":"2024-04-26T07:51:40.387775+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:40.387775+0000","last_undegraded":"2024-04-26T07:51:40.387775+0000","last_fullsized":"2024-04-26T07:51:40.387775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388194+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:40.388194+0000","last_peered":"2024-04-26T07:51:40.388194+0000","last_clean":"2024-04-26T07:51:40.388194+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:40.388194+0000","last_undegraded":"2024-04-26T07:51:40.388194+0000","last_fullsized":"2024-04-26T07:51:40.388194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414745+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:40.414745+0000","last_peered":"2024-04-26T07:51:40.414745+0000","last_clean":"2024-04-26T07:51:40.414745+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:40.414745+0000","last_undegraded":"2024-04-26T07:51:40.414745+0000","last_fullsized":"2024-04-26T07:51:40.414745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400425+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:51:40.400425+0000","last_peered":"2024-04-26T07:51:40.400425+0000","last_clean":"2024-04-26T07:51:40.400425+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:51:40.400425+0000","last_undegraded":"2024-04-26T07:51:40.400425+0000","last_fullsized":"2024-04-26T07:51:40.400425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'29","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387270+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:40.387270+0000","last_peered":"2024-04-26T07:51:40.387270+0000","last_clean":"2024-04-26T07:51:40.387270+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:40.387270+0000","last_undegraded":"2024-04-26T07:51:40.387270+0000","last_fullsized":"2024-04-26T07:51:40.387270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398515+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:51:40.398515+0000","last_peered":"2024-04-26T07:51:40.398515+0000","last_clean":"2024-04-26T07:51:40.398515+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:51:40.398515+0000","last_undegraded":"2024-04-26T07:51:40.398515+0000","last_fullsized":"2024-04-26T07:51:40.398515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410194+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:40.410194+0000","last_peered":"2024-04-26T07:51:40.410194+0000","last_clean":"2024-04-26T07:51:40.410194+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:40.410194+0000","last_undegraded":"2024-04-26T07:51:40.410194+0000","last_fullsized":"2024-04-26T07:51:40.410194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398461+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:40.398461+0000","last_peered":"2024-04-26T07:51:40.398461+0000","last_clean":"2024-04-26T07:51:40.398461+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:40.398461+0000","last_undegraded":"2024-04-26T07:51:40.398461+0000","last_fullsized":"2024-04-26T07:51:40.398461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391868+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:40.391868+0000","last_peered":"2024-04-26T07:51:40.391868+0000","last_clean":"2024-04-26T07:51:40.391868+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:40.391868+0000","last_undegraded":"2024-04-26T07:51:40.391868+0000","last_fullsized":"2024-04-26T07:51:40.391868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398811+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:51:40.398811+0000","last_peered":"2024-04-26T07:51:40.398811+0000","last_clean":"2024-04-26T07:51:40.398811+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:51:40.398811+0000","last_undegraded":"2024-04-26T07:51:40.398811+0000","last_fullsized":"2024-04-26T07:51:40.398811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"90'20","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396590+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:51:40.396590+0000","last_peered":"2024-04-26T07:51:40.396590+0000","last_clean":"2024-04-26T07:51:40.396590+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:51:40.396590+0000","last_undegraded":"2024-04-26T07:51:40.396590+0000","last_fullsized":"2024-04-26T07:51:40.396590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388406+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:51:40.388406+0000","last_peered":"2024-04-26T07:51:40.388406+0000","last_clean":"2024-04-26T07:51:40.388406+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:51:40.388406+0000","last_undegraded":"2024-04-26T07:51:40.388406+0000","last_fullsized":"2024-04-26T07:51:40.388406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390097+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:40.390097+0000","last_peered":"2024-04-26T07:51:40.390097+0000","last_clean":"2024-04-26T07:51:40.390097+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:40.390097+0000","last_undegraded":"2024-04-26T07:51:40.390097+0000","last_fullsized":"2024-04-26T07:51:40.390097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396856+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:40.396856+0000","last_peered":"2024-04-26T07:51:40.396856+0000","last_clean":"2024-04-26T07:51:40.396856+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:40.396856+0000","last_undegraded":"2024-04-26T07:51:40.396856+0000","last_fullsized":"2024-04-26T07:51:40.396856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'25","reported_seq":217,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409628+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:51:40.409628+0000","last_peered":"2024-04-26T07:51:40.409628+0000","last_clean":"2024-04-26T07:51:40.409628+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:51:40.409628+0000","last_undegraded":"2024-04-26T07:51:40.409628+0000","last_fullsized":"2024-04-26T07:51:40.409628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409449+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:51:40.409449+0000","last_peered":"2024-04-26T07:51:40.409449+0000","last_clean":"2024-04-26T07:51:40.409449+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:51:40.409449+0000","last_undegraded":"2024-04-26T07:51:40.409449+0000","last_fullsized":"2024-04-26T07:51:40.409449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"90'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399211+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:51:40.399211+0000","last_peered":"2024-04-26T07:51:40.399211+0000","last_clean":"2024-04-26T07:51:40.399211+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:51:40.399211+0000","last_undegraded":"2024-04-26T07:51:40.399211+0000","last_fullsized":"2024-04-26T07:51:40.399211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"109'135","reported_seq":367,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804709+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:51:45.804709+0000","last_peered":"2024-04-26T07:51:45.804709+0000","last_clean":"2024-04-26T07:51:45.804709+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:51:45.804709+0000","last_undegraded":"2024-04-26T07:51:45.804709+0000","last_fullsized":"2024-04-26T07:51:45.804709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409050+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:40.409050+0000","last_peered":"2024-04-26T07:51:40.409050+0000","last_clean":"2024-04-26T07:51:40.409050+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:40.409050+0000","last_undegraded":"2024-04-26T07:51:40.409050+0000","last_fullsized":"2024-04-26T07:51:40.409050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398129+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:51:40.398129+0000","last_peered":"2024-04-26T07:51:40.398129+0000","last_clean":"2024-04-26T07:51:40.398129+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:51:40.398129+0000","last_undegraded":"2024-04-26T07:51:40.398129+0000","last_fullsized":"2024-04-26T07:51:40.398129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"89'30","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396862+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:40.396862+0000","last_peered":"2024-04-26T07:51:40.396862+0000","last_clean":"2024-04-26T07:51:40.396862+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:40.396862+0000","last_undegraded":"2024-04-26T07:51:40.396862+0000","last_fullsized":"2024-04-26T07:51:40.396862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":363,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416681+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:51:40.416681+0000","last_peered":"2024-04-26T07:51:40.416681+0000","last_clean":"2024-04-26T07:51:40.416681+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:51:40.416681+0000","last_undegraded":"2024-04-26T07:51:40.416681+0000","last_fullsized":"2024-04-26T07:51:40.416681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393097+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:51:40.393097+0000","last_peered":"2024-04-26T07:51:40.393097+0000","last_clean":"2024-04-26T07:51:40.393097+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:51:40.393097+0000","last_undegraded":"2024-04-26T07:51:40.393097+0000","last_fullsized":"2024-04-26T07:51:40.393097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"109'135","reported_seq":402,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807119+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:45.807119+0000","last_peered":"2024-04-26T07:51:45.807119+0000","last_clean":"2024-04-26T07:51:45.807119+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:45.807119+0000","last_undegraded":"2024-04-26T07:51:45.807119+0000","last_fullsized":"2024-04-26T07:51:45.807119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400533+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:40.400533+0000","last_peered":"2024-04-26T07:51:40.400533+0000","last_clean":"2024-04-26T07:51:40.400533+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:40.400533+0000","last_undegraded":"2024-04-26T07:51:40.400533+0000","last_fullsized":"2024-04-26T07:51:40.400533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":165,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394484+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:40.394484+0000","last_peered":"2024-04-26T07:51:40.394484+0000","last_clean":"2024-04-26T07:51:40.394484+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:40.394484+0000","last_undegraded":"2024-04-26T07:51:40.394484+0000","last_fullsized":"2024-04-26T07:51:40.394484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390895+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:40.390895+0000","last_peered":"2024-04-26T07:51:40.390895+0000","last_clean":"2024-04-26T07:51:40.390895+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:40.390895+0000","last_undegraded":"2024-04-26T07:51:40.390895+0000","last_fullsized":"2024-04-26T07:51:40.390895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397629+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:51:40.397629+0000","last_peered":"2024-04-26T07:51:40.397629+0000","last_clean":"2024-04-26T07:51:40.397629+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:51:40.397629+0000","last_undegraded":"2024-04-26T07:51:40.397629+0000","last_fullsized":"2024-04-26T07:51:40.397629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"90'26","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414130+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:51:40.414130+0000","last_peered":"2024-04-26T07:51:40.414130+0000","last_clean":"2024-04-26T07:51:40.414130+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:51:40.414130+0000","last_undegraded":"2024-04-26T07:51:40.414130+0000","last_fullsized":"2024-04-26T07:51:40.414130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409728+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:40.409728+0000","last_peered":"2024-04-26T07:51:40.409728+0000","last_clean":"2024-04-26T07:51:40.409728+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:40.409728+0000","last_undegraded":"2024-04-26T07:51:40.409728+0000","last_fullsized":"2024-04-26T07:51:40.409728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409337+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:40.409337+0000","last_peered":"2024-04-26T07:51:40.409337+0000","last_clean":"2024-04-26T07:51:40.409337+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:40.409337+0000","last_undegraded":"2024-04-26T07:51:40.409337+0000","last_fullsized":"2024-04-26T07:51:40.409337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412130+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:51:40.412130+0000","last_peered":"2024-04-26T07:51:40.412130+0000","last_clean":"2024-04-26T07:51:40.412130+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:51:40.412130+0000","last_undegraded":"2024-04-26T07:51:40.412130+0000","last_fullsized":"2024-04-26T07:51:40.412130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435552+0000","last_change":"2024-04-26T07:51:40.435552+0000","last_active":"2024-04-26T07:51:40.435552+0000","last_peered":"2024-04-26T07:51:40.435552+0000","last_clean":"2024-04-26T07:51:40.435552+0000","last_became_active":"2024-04-26T07:51:40.429475+0000","last_became_peered":"2024-04-26T07:51:40.429475+0000","last_unstale":"2024-04-26T07:51:40.435552+0000","last_undegraded":"2024-04-26T07:51:40.435552+0000","last_fullsized":"2024-04-26T07:51:40.435552+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:19.379343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414577+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:40.414577+0000","last_peered":"2024-04-26T07:51:40.414577+0000","last_clean":"2024-04-26T07:51:40.414577+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:40.414577+0000","last_undegraded":"2024-04-26T07:51:40.414577+0000","last_fullsized":"2024-04-26T07:51:40.414577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391655+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:40.391655+0000","last_peered":"2024-04-26T07:51:40.391655+0000","last_clean":"2024-04-26T07:51:40.391655+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:40.391655+0000","last_undegraded":"2024-04-26T07:51:40.391655+0000","last_fullsized":"2024-04-26T07:51:40.391655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429427+0000","last_change":"2024-04-26T07:51:40.429427+0000","last_active":"2024-04-26T07:51:40.429427+0000","last_peered":"2024-04-26T07:51:40.429427+0000","last_clean":"2024-04-26T07:51:40.429427+0000","last_became_active":"2024-04-26T07:51:40.428641+0000","last_became_peered":"2024-04-26T07:51:40.428641+0000","last_unstale":"2024-04-26T07:51:40.429427+0000","last_undegraded":"2024-04-26T07:51:40.429427+0000","last_fullsized":"2024-04-26T07:51:40.429427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:31.406741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"90'39","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416828+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:51:40.416828+0000","last_peered":"2024-04-26T07:51:40.416828+0000","last_clean":"2024-04-26T07:51:40.416828+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:51:40.416828+0000","last_undegraded":"2024-04-26T07:51:40.416828+0000","last_fullsized":"2024-04-26T07:51:40.416828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388551+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:51:40.388551+0000","last_peered":"2024-04-26T07:51:40.388551+0000","last_clean":"2024-04-26T07:51:40.388551+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:51:40.388551+0000","last_undegraded":"2024-04-26T07:51:40.388551+0000","last_fullsized":"2024-04-26T07:51:40.388551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407507+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:40.407507+0000","last_peered":"2024-04-26T07:51:40.407507+0000","last_clean":"2024-04-26T07:51:40.407507+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:40.407507+0000","last_undegraded":"2024-04-26T07:51:40.407507+0000","last_fullsized":"2024-04-26T07:51:40.407507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388819+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:51:40.388819+0000","last_peered":"2024-04-26T07:51:40.388819+0000","last_clean":"2024-04-26T07:51:40.388819+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:51:40.388819+0000","last_undegraded":"2024-04-26T07:51:40.388819+0000","last_fullsized":"2024-04-26T07:51:40.388819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.440837+0000","last_change":"2024-04-26T07:51:40.440837+0000","last_active":"2024-04-26T07:51:40.440837+0000","last_peered":"2024-04-26T07:51:40.440837+0000","last_clean":"2024-04-26T07:51:40.440837+0000","last_became_active":"2024-04-26T07:51:40.437582+0000","last_became_peered":"2024-04-26T07:51:40.437582+0000","last_unstale":"2024-04-26T07:51:40.440837+0000","last_undegraded":"2024-04-26T07:51:40.440837+0000","last_fullsized":"2024-04-26T07:51:40.440837+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.908604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"89'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387392+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:40.387392+0000","last_peered":"2024-04-26T07:51:40.387392+0000","last_clean":"2024-04-26T07:51:40.387392+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:40.387392+0000","last_undegraded":"2024-04-26T07:51:40.387392+0000","last_fullsized":"2024-04-26T07:51:40.387392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417014+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:40.417014+0000","last_peered":"2024-04-26T07:51:40.417014+0000","last_clean":"2024-04-26T07:51:40.417014+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:40.417014+0000","last_undegraded":"2024-04-26T07:51:40.417014+0000","last_fullsized":"2024-04-26T07:51:40.417014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"109'138","reported_seq":420,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804711+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:51:45.804711+0000","last_peered":"2024-04-26T07:51:45.804711+0000","last_clean":"2024-04-26T07:51:45.804711+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:51:45.804711+0000","last_undegraded":"2024-04-26T07:51:45.804711+0000","last_fullsized":"2024-04-26T07:51:45.804711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444144+0000","last_change":"2024-04-26T07:51:40.444144+0000","last_active":"2024-04-26T07:51:40.444144+0000","last_peered":"2024-04-26T07:51:40.444144+0000","last_clean":"2024-04-26T07:51:40.444144+0000","last_became_active":"2024-04-26T07:51:40.439356+0000","last_became_peered":"2024-04-26T07:51:40.439356+0000","last_unstale":"2024-04-26T07:51:40.444144+0000","last_undegraded":"2024-04-26T07:51:40.444144+0000","last_fullsized":"2024-04-26T07:51:40.444144+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:37.987341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408252+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:40.408252+0000","last_peered":"2024-04-26T07:51:40.408252+0000","last_clean":"2024-04-26T07:51:40.408252+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:40.408252+0000","last_undegraded":"2024-04-26T07:51:40.408252+0000","last_fullsized":"2024-04-26T07:51:40.408252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410446+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:51:40.410446+0000","last_peered":"2024-04-26T07:51:40.410446+0000","last_clean":"2024-04-26T07:51:40.410446+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:51:40.410446+0000","last_undegraded":"2024-04-26T07:51:40.410446+0000","last_fullsized":"2024-04-26T07:51:40.410446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399025+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:51:40.399025+0000","last_peered":"2024-04-26T07:51:40.399025+0000","last_clean":"2024-04-26T07:51:40.399025+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:51:40.399025+0000","last_undegraded":"2024-04-26T07:51:40.399025+0000","last_fullsized":"2024-04-26T07:51:40.399025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'26","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408371+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:40.408371+0000","last_peered":"2024-04-26T07:51:40.408371+0000","last_clean":"2024-04-26T07:51:40.408371+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:40.408371+0000","last_undegraded":"2024-04-26T07:51:40.408371+0000","last_fullsized":"2024-04-26T07:51:40.408371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399455+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:51:40.399455+0000","last_peered":"2024-04-26T07:51:40.399455+0000","last_clean":"2024-04-26T07:51:40.399455+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:51:40.399455+0000","last_undegraded":"2024-04-26T07:51:40.399455+0000","last_fullsized":"2024-04-26T07:51:40.399455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"109'18","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807316+0000","last_change":"2024-04-26T07:51:40.448691+0000","last_active":"2024-04-26T07:51:45.807316+0000","last_peered":"2024-04-26T07:51:45.807316+0000","last_clean":"2024-04-26T07:51:45.807316+0000","last_became_active":"2024-04-26T07:51:40.445444+0000","last_became_peered":"2024-04-26T07:51:40.445444+0000","last_unstale":"2024-04-26T07:51:45.807316+0000","last_undegraded":"2024-04-26T07:51:45.807316+0000","last_fullsized":"2024-04-26T07:51:45.807316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:23.750359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387011+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:51:40.387011+0000","last_peered":"2024-04-26T07:51:40.387011+0000","last_clean":"2024-04-26T07:51:40.387011+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:51:40.387011+0000","last_undegraded":"2024-04-26T07:51:40.387011+0000","last_fullsized":"2024-04-26T07:51:40.387011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392361+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:40.392361+0000","last_peered":"2024-04-26T07:51:40.392361+0000","last_clean":"2024-04-26T07:51:40.392361+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:40.392361+0000","last_undegraded":"2024-04-26T07:51:40.392361+0000","last_fullsized":"2024-04-26T07:51:40.392361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409549+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:51:40.409549+0000","last_peered":"2024-04-26T07:51:40.409549+0000","last_clean":"2024-04-26T07:51:40.409549+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:51:40.409549+0000","last_undegraded":"2024-04-26T07:51:40.409549+0000","last_fullsized":"2024-04-26T07:51:40.409549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414326+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:40.414326+0000","last_peered":"2024-04-26T07:51:40.414326+0000","last_clean":"2024-04-26T07:51:40.414326+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:40.414326+0000","last_undegraded":"2024-04-26T07:51:40.414326+0000","last_fullsized":"2024-04-26T07:51:40.414326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'20","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397271+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:40.397271+0000","last_peered":"2024-04-26T07:51:40.397271+0000","last_clean":"2024-04-26T07:51:40.397271+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:40.397271+0000","last_undegraded":"2024-04-26T07:51:40.397271+0000","last_fullsized":"2024-04-26T07:51:40.397271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387118+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:51:40.387118+0000","last_peered":"2024-04-26T07:51:40.387118+0000","last_clean":"2024-04-26T07:51:40.387118+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:51:40.387118+0000","last_undegraded":"2024-04-26T07:51:40.387118+0000","last_fullsized":"2024-04-26T07:51:40.387118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393907+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:40.393907+0000","last_peered":"2024-04-26T07:51:40.393907+0000","last_clean":"2024-04-26T07:51:40.393907+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:40.393907+0000","last_undegraded":"2024-04-26T07:51:40.393907+0000","last_fullsized":"2024-04-26T07:51:40.393907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412184+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:40.412184+0000","last_peered":"2024-04-26T07:51:40.412184+0000","last_clean":"2024-04-26T07:51:40.412184+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:40.412184+0000","last_undegraded":"2024-04-26T07:51:40.412184+0000","last_fullsized":"2024-04-26T07:51:40.412184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409446+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:40.409446+0000","last_peered":"2024-04-26T07:51:40.409446+0000","last_clean":"2024-04-26T07:51:40.409446+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:40.409446+0000","last_undegraded":"2024-04-26T07:51:40.409446+0000","last_fullsized":"2024-04-26T07:51:40.409446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408654+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:51:40.408654+0000","last_peered":"2024-04-26T07:51:40.408654+0000","last_clean":"2024-04-26T07:51:40.408654+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:51:40.408654+0000","last_undegraded":"2024-04-26T07:51:40.408654+0000","last_fullsized":"2024-04-26T07:51:40.408654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"88'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415304+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:40.415304+0000","last_peered":"2024-04-26T07:51:40.415304+0000","last_clean":"2024-04-26T07:51:40.415304+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:40.415304+0000","last_undegraded":"2024-04-26T07:51:40.415304+0000","last_fullsized":"2024-04-26T07:51:40.415304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409916+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:51:40.409916+0000","last_peered":"2024-04-26T07:51:40.409916+0000","last_clean":"2024-04-26T07:51:40.409916+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:51:40.409916+0000","last_undegraded":"2024-04-26T07:51:40.409916+0000","last_fullsized":"2024-04-26T07:51:40.409916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387667+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:51:40.387667+0000","last_peered":"2024-04-26T07:51:40.387667+0000","last_clean":"2024-04-26T07:51:40.387667+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:51:40.387667+0000","last_undegraded":"2024-04-26T07:51:40.387667+0000","last_fullsized":"2024-04-26T07:51:40.387667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"90'35","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386306+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:51:40.386306+0000","last_peered":"2024-04-26T07:51:40.386306+0000","last_clean":"2024-04-26T07:51:40.386306+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:51:40.386306+0000","last_undegraded":"2024-04-26T07:51:40.386306+0000","last_fullsized":"2024-04-26T07:51:40.386306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394908+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:40.394908+0000","last_peered":"2024-04-26T07:51:40.394908+0000","last_clean":"2024-04-26T07:51:40.394908+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:40.394908+0000","last_undegraded":"2024-04-26T07:51:40.394908+0000","last_fullsized":"2024-04-26T07:51:40.394908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387516+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:40.387516+0000","last_peered":"2024-04-26T07:51:40.387516+0000","last_clean":"2024-04-26T07:51:40.387516+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:40.387516+0000","last_undegraded":"2024-04-26T07:51:40.387516+0000","last_fullsized":"2024-04-26T07:51:40.387516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388105+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:51:40.388105+0000","last_peered":"2024-04-26T07:51:40.388105+0000","last_clean":"2024-04-26T07:51:40.388105+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:51:40.388105+0000","last_undegraded":"2024-04-26T07:51:40.388105+0000","last_fullsized":"2024-04-26T07:51:40.388105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409722+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:51:40.409722+0000","last_peered":"2024-04-26T07:51:40.409722+0000","last_clean":"2024-04-26T07:51:40.409722+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:51:40.409722+0000","last_undegraded":"2024-04-26T07:51:40.409722+0000","last_fullsized":"2024-04-26T07:51:40.409722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441852+0000","last_change":"2024-04-26T07:51:40.441852+0000","last_active":"2024-04-26T07:51:40.441852+0000","last_peered":"2024-04-26T07:51:40.441852+0000","last_clean":"2024-04-26T07:51:40.441852+0000","last_became_active":"2024-04-26T07:51:40.433293+0000","last_became_peered":"2024-04-26T07:51:40.433293+0000","last_unstale":"2024-04-26T07:51:40.441852+0000","last_undegraded":"2024-04-26T07:51:40.441852+0000","last_fullsized":"2024-04-26T07:51:40.441852+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:25.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408513+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:51:40.408513+0000","last_peered":"2024-04-26T07:51:40.408513+0000","last_clean":"2024-04-26T07:51:40.408513+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:51:40.408513+0000","last_undegraded":"2024-04-26T07:51:40.408513+0000","last_fullsized":"2024-04-26T07:51:40.408513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408684+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:40.408684+0000","last_peered":"2024-04-26T07:51:40.408684+0000","last_clean":"2024-04-26T07:51:40.408684+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:40.408684+0000","last_undegraded":"2024-04-26T07:51:40.408684+0000","last_fullsized":"2024-04-26T07:51:40.408684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"109'135","reported_seq":380,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807170+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:51:45.807170+0000","last_peered":"2024-04-26T07:51:45.807170+0000","last_clean":"2024-04-26T07:51:45.807170+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:51:45.807170+0000","last_undegraded":"2024-04-26T07:51:45.807170+0000","last_fullsized":"2024-04-26T07:51:45.807170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394363+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:40.394363+0000","last_peered":"2024-04-26T07:51:40.394363+0000","last_clean":"2024-04-26T07:51:40.394363+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:40.394363+0000","last_undegraded":"2024-04-26T07:51:40.394363+0000","last_fullsized":"2024-04-26T07:51:40.394363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390662+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:51:40.390662+0000","last_peered":"2024-04-26T07:51:40.390662+0000","last_clean":"2024-04-26T07:51:40.390662+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:51:40.390662+0000","last_undegraded":"2024-04-26T07:51:40.390662+0000","last_fullsized":"2024-04-26T07:51:40.390662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'19","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393883+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:40.393883+0000","last_peered":"2024-04-26T07:51:40.393883+0000","last_clean":"2024-04-26T07:51:40.393883+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:40.393883+0000","last_undegraded":"2024-04-26T07:51:40.393883+0000","last_fullsized":"2024-04-26T07:51:40.393883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410909+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:51:40.410909+0000","last_peered":"2024-04-26T07:51:40.410909+0000","last_clean":"2024-04-26T07:51:40.410909+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:51:40.410909+0000","last_undegraded":"2024-04-26T07:51:40.410909+0000","last_fullsized":"2024-04-26T07:51:40.410909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395337+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:40.395337+0000","last_peered":"2024-04-26T07:51:40.395337+0000","last_clean":"2024-04-26T07:51:40.395337+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:40.395337+0000","last_undegraded":"2024-04-26T07:51:40.395337+0000","last_fullsized":"2024-04-26T07:51:40.395337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400935+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:51:40.400935+0000","last_peered":"2024-04-26T07:51:40.400935+0000","last_clean":"2024-04-26T07:51:40.400935+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:51:40.400935+0000","last_undegraded":"2024-04-26T07:51:40.400935+0000","last_fullsized":"2024-04-26T07:51:40.400935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"109'135","reported_seq":352,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804722+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:51:45.804722+0000","last_peered":"2024-04-26T07:51:45.804722+0000","last_clean":"2024-04-26T07:51:45.804722+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:51:45.804722+0000","last_undegraded":"2024-04-26T07:51:45.804722+0000","last_fullsized":"2024-04-26T07:51:45.804722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387074+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:40.387074+0000","last_peered":"2024-04-26T07:51:40.387074+0000","last_clean":"2024-04-26T07:51:40.387074+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:40.387074+0000","last_undegraded":"2024-04-26T07:51:40.387074+0000","last_fullsized":"2024-04-26T07:51:40.387074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395762+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:40.395762+0000","last_peered":"2024-04-26T07:51:40.395762+0000","last_clean":"2024-04-26T07:51:40.395762+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:40.395762+0000","last_undegraded":"2024-04-26T07:51:40.395762+0000","last_fullsized":"2024-04-26T07:51:40.395762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.389005+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:40.389005+0000","last_peered":"2024-04-26T07:51:40.389005+0000","last_clean":"2024-04-26T07:51:40.389005+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:40.389005+0000","last_undegraded":"2024-04-26T07:51:40.389005+0000","last_fullsized":"2024-04-26T07:51:40.389005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412692+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:51:40.412692+0000","last_peered":"2024-04-26T07:51:40.412692+0000","last_clean":"2024-04-26T07:51:40.412692+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:51:40.412692+0000","last_undegraded":"2024-04-26T07:51:40.412692+0000","last_fullsized":"2024-04-26T07:51:40.412692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":275,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390337+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:40.390337+0000","last_peered":"2024-04-26T07:51:40.390337+0000","last_clean":"2024-04-26T07:51:40.390337+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:40.390337+0000","last_undegraded":"2024-04-26T07:51:40.390337+0000","last_fullsized":"2024-04-26T07:51:40.390337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"90'44","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.419562+0000","last_change":"2024-04-26T07:51:40.419562+0000","last_active":"2024-04-26T07:51:40.419562+0000","last_peered":"2024-04-26T07:51:40.419562+0000","last_clean":"2024-04-26T07:51:40.419562+0000","last_became_active":"2024-04-26T07:51:40.418680+0000","last_became_peered":"2024-04-26T07:51:40.418680+0000","last_unstale":"2024-04-26T07:51:40.419562+0000","last_undegraded":"2024-04-26T07:51:40.419562+0000","last_fullsized":"2024-04-26T07:51:40.419562+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:42.333538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391389+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:51:40.391389+0000","last_peered":"2024-04-26T07:51:40.391389+0000","last_clean":"2024-04-26T07:51:40.391389+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:51:40.391389+0000","last_undegraded":"2024-04-26T07:51:40.391389+0000","last_fullsized":"2024-04-26T07:51:40.391389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413846+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:40.413846+0000","last_peered":"2024-04-26T07:51:40.413846+0000","last_clean":"2024-04-26T07:51:40.413846+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:40.413846+0000","last_undegraded":"2024-04-26T07:51:40.413846+0000","last_fullsized":"2024-04-26T07:51:40.413846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387849+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:40.387849+0000","last_peered":"2024-04-26T07:51:40.387849+0000","last_clean":"2024-04-26T07:51:40.387849+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:40.387849+0000","last_undegraded":"2024-04-26T07:51:40.387849+0000","last_fullsized":"2024-04-26T07:51:40.387849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396489+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:51:40.396489+0000","last_peered":"2024-04-26T07:51:40.396489+0000","last_clean":"2024-04-26T07:51:40.396489+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:51:40.396489+0000","last_undegraded":"2024-04-26T07:51:40.396489+0000","last_fullsized":"2024-04-26T07:51:40.396489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"89'31","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397695+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:40.397695+0000","last_peered":"2024-04-26T07:51:40.397695+0000","last_clean":"2024-04-26T07:51:40.397695+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:40.397695+0000","last_undegraded":"2024-04-26T07:51:40.397695+0000","last_fullsized":"2024-04-26T07:51:40.397695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408744+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:51:40.408744+0000","last_peered":"2024-04-26T07:51:40.408744+0000","last_clean":"2024-04-26T07:51:40.408744+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:51:40.408744+0000","last_undegraded":"2024-04-26T07:51:40.408744+0000","last_fullsized":"2024-04-26T07:51:40.408744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"90'19","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.389984+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:51:40.389984+0000","last_peered":"2024-04-26T07:51:40.389984+0000","last_clean":"2024-04-26T07:51:40.389984+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:51:40.389984+0000","last_undegraded":"2024-04-26T07:51:40.389984+0000","last_fullsized":"2024-04-26T07:51:40.389984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390188+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:51:40.390188+0000","last_peered":"2024-04-26T07:51:40.390188+0000","last_clean":"2024-04-26T07:51:40.390188+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:51:40.390188+0000","last_undegraded":"2024-04-26T07:51:40.390188+0000","last_fullsized":"2024-04-26T07:51:40.390188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393594+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:40.393594+0000","last_peered":"2024-04-26T07:51:40.393594+0000","last_clean":"2024-04-26T07:51:40.393594+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:40.393594+0000","last_undegraded":"2024-04-26T07:51:40.393594+0000","last_fullsized":"2024-04-26T07:51:40.393594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408560+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:51:40.408560+0000","last_peered":"2024-04-26T07:51:40.408560+0000","last_clean":"2024-04-26T07:51:40.408560+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:51:40.408560+0000","last_undegraded":"2024-04-26T07:51:40.408560+0000","last_fullsized":"2024-04-26T07:51:40.408560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'18","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.447435+0000","last_change":"2024-04-26T07:51:40.447435+0000","last_active":"2024-04-26T07:51:40.447435+0000","last_peered":"2024-04-26T07:51:40.447435+0000","last_clean":"2024-04-26T07:51:40.447435+0000","last_became_active":"2024-04-26T07:51:40.444446+0000","last_became_peered":"2024-04-26T07:51:40.444446+0000","last_unstale":"2024-04-26T07:51:40.447435+0000","last_undegraded":"2024-04-26T07:51:40.447435+0000","last_fullsized":"2024-04-26T07:51:40.447435+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:01.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":275,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392275+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:40.392275+0000","last_peered":"2024-04-26T07:51:40.392275+0000","last_clean":"2024-04-26T07:51:40.392275+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:40.392275+0000","last_undegraded":"2024-04-26T07:51:40.392275+0000","last_fullsized":"2024-04-26T07:51:40.392275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"101'10","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386065+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:51:40.386065+0000","last_peered":"2024-04-26T07:51:40.386065+0000","last_clean":"2024-04-26T07:51:40.386065+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:51:40.386065+0000","last_undegraded":"2024-04-26T07:51:40.386065+0000","last_fullsized":"2024-04-26T07:51:40.386065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432738+0000","last_change":"2024-04-26T07:51:40.432738+0000","last_active":"2024-04-26T07:51:40.432738+0000","last_peered":"2024-04-26T07:51:40.432738+0000","last_clean":"2024-04-26T07:51:40.432738+0000","last_became_active":"2024-04-26T07:51:40.431762+0000","last_became_peered":"2024-04-26T07:51:40.431762+0000","last_unstale":"2024-04-26T07:51:40.432738+0000","last_undegraded":"2024-04-26T07:51:40.432738+0000","last_fullsized":"2024-04-26T07:51:40.432738+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:25.659741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386934+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:40.386934+0000","last_peered":"2024-04-26T07:51:40.386934+0000","last_clean":"2024-04-26T07:51:40.386934+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:40.386934+0000","last_undegraded":"2024-04-26T07:51:40.386934+0000","last_fullsized":"2024-04-26T07:51:40.386934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391261+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:51:40.391261+0000","last_peered":"2024-04-26T07:51:40.391261+0000","last_clean":"2024-04-26T07:51:40.391261+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:51:40.391261+0000","last_undegraded":"2024-04-26T07:51:40.391261+0000","last_fullsized":"2024-04-26T07:51:40.391261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416629+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:40.416629+0000","last_peered":"2024-04-26T07:51:40.416629+0000","last_clean":"2024-04-26T07:51:40.416629+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:40.416629+0000","last_undegraded":"2024-04-26T07:51:40.416629+0000","last_fullsized":"2024-04-26T07:51:40.416629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444554+0000","last_change":"2024-04-26T07:51:40.444554+0000","last_active":"2024-04-26T07:51:40.444554+0000","last_peered":"2024-04-26T07:51:40.444554+0000","last_clean":"2024-04-26T07:51:40.444554+0000","last_became_active":"2024-04-26T07:51:40.439845+0000","last_became_peered":"2024-04-26T07:51:40.439845+0000","last_unstale":"2024-04-26T07:51:40.444554+0000","last_undegraded":"2024-04-26T07:51:40.444554+0000","last_fullsized":"2024-04-26T07:51:40.444554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:41.631699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"90'20","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392088+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:51:40.392088+0000","last_peered":"2024-04-26T07:51:40.392088+0000","last_clean":"2024-04-26T07:51:40.392088+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:51:40.392088+0000","last_undegraded":"2024-04-26T07:51:40.392088+0000","last_fullsized":"2024-04-26T07:51:40.392088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409988+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:40.409988+0000","last_peered":"2024-04-26T07:51:40.409988+0000","last_clean":"2024-04-26T07:51:40.409988+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:40.409988+0000","last_undegraded":"2024-04-26T07:51:40.409988+0000","last_fullsized":"2024-04-26T07:51:40.409988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413668+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:40.413668+0000","last_peered":"2024-04-26T07:51:40.413668+0000","last_clean":"2024-04-26T07:51:40.413668+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:40.413668+0000","last_undegraded":"2024-04-26T07:51:40.413668+0000","last_fullsized":"2024-04-26T07:51:40.413668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390764+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:51:40.390764+0000","last_peered":"2024-04-26T07:51:40.390764+0000","last_clean":"2024-04-26T07:51:40.390764+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:51:40.390764+0000","last_undegraded":"2024-04-26T07:51:40.390764+0000","last_fullsized":"2024-04-26T07:51:40.390764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'25","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388325+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:40.388325+0000","last_peered":"2024-04-26T07:51:40.388325+0000","last_clean":"2024-04-26T07:51:40.388325+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:40.388325+0000","last_undegraded":"2024-04-26T07:51:40.388325+0000","last_fullsized":"2024-04-26T07:51:40.388325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409141+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:51:40.409141+0000","last_peered":"2024-04-26T07:51:40.409141+0000","last_clean":"2024-04-26T07:51:40.409141+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:51:40.409141+0000","last_undegraded":"2024-04-26T07:51:40.409141+0000","last_fullsized":"2024-04-26T07:51:40.409141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"90'18","reported_seq":160,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.418821+0000","last_change":"2024-04-26T07:51:40.418821+0000","last_active":"2024-04-26T07:51:40.418821+0000","last_peered":"2024-04-26T07:51:40.418821+0000","last_clean":"2024-04-26T07:51:40.418821+0000","last_became_active":"2024-04-26T07:51:40.417916+0000","last_became_peered":"2024-04-26T07:51:40.417916+0000","last_unstale":"2024-04-26T07:51:40.418821+0000","last_undegraded":"2024-04-26T07:51:40.418821+0000","last_fullsized":"2024-04-26T07:51:40.418821+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:36.135343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387218+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:51:40.387218+0000","last_peered":"2024-04-26T07:51:40.387218+0000","last_clean":"2024-04-26T07:51:40.387218+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:51:40.387218+0000","last_undegraded":"2024-04-26T07:51:40.387218+0000","last_fullsized":"2024-04-26T07:51:40.387218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412561+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:51:40.412561+0000","last_peered":"2024-04-26T07:51:40.412561+0000","last_clean":"2024-04-26T07:51:40.412561+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:51:40.412561+0000","last_undegraded":"2024-04-26T07:51:40.412561+0000","last_fullsized":"2024-04-26T07:51:40.412561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390860+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:40.390860+0000","last_peered":"2024-04-26T07:51:40.390860+0000","last_clean":"2024-04-26T07:51:40.390860+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:40.390860+0000","last_undegraded":"2024-04-26T07:51:40.390860+0000","last_fullsized":"2024-04-26T07:51:40.390860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388623+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:51:40.388623+0000","last_peered":"2024-04-26T07:51:40.388623+0000","last_clean":"2024-04-26T07:51:40.388623+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:51:40.388623+0000","last_undegraded":"2024-04-26T07:51:40.388623+0000","last_fullsized":"2024-04-26T07:51:40.388623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"90'29","reported_seq":220,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409906+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:51:40.409906+0000","last_peered":"2024-04-26T07:51:40.409906+0000","last_clean":"2024-04-26T07:51:40.409906+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:51:40.409906+0000","last_undegraded":"2024-04-26T07:51:40.409906+0000","last_fullsized":"2024-04-26T07:51:40.409906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414293+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:40.414293+0000","last_peered":"2024-04-26T07:51:40.414293+0000","last_clean":"2024-04-26T07:51:40.414293+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:40.414293+0000","last_undegraded":"2024-04-26T07:51:40.414293+0000","last_fullsized":"2024-04-26T07:51:40.414293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391766+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:40.391766+0000","last_peered":"2024-04-26T07:51:40.391766+0000","last_clean":"2024-04-26T07:51:40.391766+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:40.391766+0000","last_undegraded":"2024-04-26T07:51:40.391766+0000","last_fullsized":"2024-04-26T07:51:40.391766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388746+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:51:40.388746+0000","last_peered":"2024-04-26T07:51:40.388746+0000","last_clean":"2024-04-26T07:51:40.388746+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:51:40.388746+0000","last_undegraded":"2024-04-26T07:51:40.388746+0000","last_fullsized":"2024-04-26T07:51:40.388746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'16","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409372+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:51:40.409372+0000","last_peered":"2024-04-26T07:51:40.409372+0000","last_clean":"2024-04-26T07:51:40.409372+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:51:40.409372+0000","last_undegraded":"2024-04-26T07:51:40.409372+0000","last_fullsized":"2024-04-26T07:51:40.409372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412316+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:51:40.412316+0000","last_peered":"2024-04-26T07:51:40.412316+0000","last_clean":"2024-04-26T07:51:40.412316+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:51:40.412316+0000","last_undegraded":"2024-04-26T07:51:40.412316+0000","last_fullsized":"2024-04-26T07:51:40.412316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"90'25","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427441+0000","last_change":"2024-04-26T07:51:40.427441+0000","last_active":"2024-04-26T07:51:40.427441+0000","last_peered":"2024-04-26T07:51:40.427441+0000","last_clean":"2024-04-26T07:51:40.427441+0000","last_became_active":"2024-04-26T07:51:40.424476+0000","last_became_peered":"2024-04-26T07:51:40.424476+0000","last_unstale":"2024-04-26T07:51:40.427441+0000","last_undegraded":"2024-04-26T07:51:40.427441+0000","last_fullsized":"2024-04-26T07:51:40.427441+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:35.964067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410009+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:40.410009+0000","last_peered":"2024-04-26T07:51:40.410009+0000","last_clean":"2024-04-26T07:51:40.410009+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:40.410009+0000","last_undegraded":"2024-04-26T07:51:40.410009+0000","last_fullsized":"2024-04-26T07:51:40.410009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408176+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:40.408176+0000","last_peered":"2024-04-26T07:51:40.408176+0000","last_clean":"2024-04-26T07:51:40.408176+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:40.408176+0000","last_undegraded":"2024-04-26T07:51:40.408176+0000","last_fullsized":"2024-04-26T07:51:40.408176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393585+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:51:40.393585+0000","last_peered":"2024-04-26T07:51:40.393585+0000","last_clean":"2024-04-26T07:51:40.393585+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:51:40.393585+0000","last_undegraded":"2024-04-26T07:51:40.393585+0000","last_fullsized":"2024-04-26T07:51:40.393585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'31","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401530+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:40.401530+0000","last_peered":"2024-04-26T07:51:40.401530+0000","last_clean":"2024-04-26T07:51:40.401530+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:40.401530+0000","last_undegraded":"2024-04-26T07:51:40.401530+0000","last_fullsized":"2024-04-26T07:51:40.401530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399362+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:51:40.399362+0000","last_peered":"2024-04-26T07:51:40.399362+0000","last_clean":"2024-04-26T07:51:40.399362+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:51:40.399362+0000","last_undegraded":"2024-04-26T07:51:40.399362+0000","last_fullsized":"2024-04-26T07:51:40.399362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"90'19","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394701+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:51:40.394701+0000","last_peered":"2024-04-26T07:51:40.394701+0000","last_clean":"2024-04-26T07:51:40.394701+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:51:40.394701+0000","last_undegraded":"2024-04-26T07:51:40.394701+0000","last_fullsized":"2024-04-26T07:51:40.394701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409809+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:40.409809+0000","last_peered":"2024-04-26T07:51:40.409809+0000","last_clean":"2024-04-26T07:51:40.409809+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:40.409809+0000","last_undegraded":"2024-04-26T07:51:40.409809+0000","last_fullsized":"2024-04-26T07:51:40.409809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410392+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:40.410392+0000","last_peered":"2024-04-26T07:51:40.410392+0000","last_clean":"2024-04-26T07:51:40.410392+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:40.410392+0000","last_undegraded":"2024-04-26T07:51:40.410392+0000","last_fullsized":"2024-04-26T07:51:40.410392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399847+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:51:40.399847+0000","last_peered":"2024-04-26T07:51:40.399847+0000","last_clean":"2024-04-26T07:51:40.399847+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:51:40.399847+0000","last_undegraded":"2024-04-26T07:51:40.399847+0000","last_fullsized":"2024-04-26T07:51:40.399847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"88'18","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387314+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:40.387314+0000","last_peered":"2024-04-26T07:51:40.387314+0000","last_clean":"2024-04-26T07:51:40.387314+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:40.387314+0000","last_undegraded":"2024-04-26T07:51:40.387314+0000","last_fullsized":"2024-04-26T07:51:40.387314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410199+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:51:40.410199+0000","last_peered":"2024-04-26T07:51:40.410199+0000","last_clean":"2024-04-26T07:51:40.410199+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:51:40.410199+0000","last_undegraded":"2024-04-26T07:51:40.410199+0000","last_fullsized":"2024-04-26T07:51:40.410199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396852+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:51:40.396852+0000","last_peered":"2024-04-26T07:51:40.396852+0000","last_clean":"2024-04-26T07:51:40.396852+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:51:40.396852+0000","last_undegraded":"2024-04-26T07:51:40.396852+0000","last_fullsized":"2024-04-26T07:51:40.396852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"109'135","reported_seq":429,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807087+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:51:45.807087+0000","last_peered":"2024-04-26T07:51:45.807087+0000","last_clean":"2024-04-26T07:51:45.807087+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:51:45.807087+0000","last_undegraded":"2024-04-26T07:51:45.807087+0000","last_fullsized":"2024-04-26T07:51:45.807087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":136,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437366+0000","last_change":"2024-04-26T07:51:40.437366+0000","last_active":"2024-04-26T07:51:40.437366+0000","last_peered":"2024-04-26T07:51:40.437366+0000","last_clean":"2024-04-26T07:51:40.437366+0000","last_became_active":"2024-04-26T07:51:40.436379+0000","last_became_peered":"2024-04-26T07:51:40.436379+0000","last_unstale":"2024-04-26T07:51:40.437366+0000","last_undegraded":"2024-04-26T07:51:40.437366+0000","last_fullsized":"2024-04-26T07:51:40.437366+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:48:37.824192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396217+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:40.396217+0000","last_peered":"2024-04-26T07:51:40.396217+0000","last_clean":"2024-04-26T07:51:40.396217+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:40.396217+0000","last_undegraded":"2024-04-26T07:51:40.396217+0000","last_fullsized":"2024-04-26T07:51:40.396217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"89'14","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399466+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:40.399466+0000","last_peered":"2024-04-26T07:51:40.399466+0000","last_clean":"2024-04-26T07:51:40.399466+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:40.399466+0000","last_undegraded":"2024-04-26T07:51:40.399466+0000","last_fullsized":"2024-04-26T07:51:40.399466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:16.352834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428700+0000","last_change":"2024-04-26T07:51:40.428700+0000","last_active":"2024-04-26T07:51:40.428700+0000","last_peered":"2024-04-26T07:51:40.428700+0000","last_clean":"2024-04-26T07:51:40.428700+0000","last_became_active":"2024-04-26T07:51:40.427906+0000","last_became_peered":"2024-04-26T07:51:40.427906+0000","last_unstale":"2024-04-26T07:51:40.428700+0000","last_undegraded":"2024-04-26T07:51:40.428700+0000","last_fullsized":"2024-04-26T07:51:40.428700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:31.624570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"90'23","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410799+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:51:40.410799+0000","last_peered":"2024-04-26T07:51:40.410799+0000","last_clean":"2024-04-26T07:51:40.410799+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:51:40.410799+0000","last_undegraded":"2024-04-26T07:51:40.410799+0000","last_fullsized":"2024-04-26T07:51:40.410799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385502+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:51:40.385502+0000","last_peered":"2024-04-26T07:51:40.385502+0000","last_clean":"2024-04-26T07:51:40.385502+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:51:40.385502+0000","last_undegraded":"2024-04-26T07:51:40.385502+0000","last_fullsized":"2024-04-26T07:51:40.385502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433368+0000","last_change":"2024-04-26T07:51:40.433368+0000","last_active":"2024-04-26T07:51:40.433368+0000","last_peered":"2024-04-26T07:51:40.433368+0000","last_clean":"2024-04-26T07:51:40.433368+0000","last_became_active":"2024-04-26T07:51:40.432230+0000","last_became_peered":"2024-04-26T07:51:40.432230+0000","last_unstale":"2024-04-26T07:51:40.433368+0000","last_undegraded":"2024-04-26T07:51:40.433368+0000","last_fullsized":"2024-04-26T07:51:40.433368+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:04.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401063+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:51:40.401063+0000","last_peered":"2024-04-26T07:51:40.401063+0000","last_clean":"2024-04-26T07:51:40.401063+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:51:40.401063+0000","last_undegraded":"2024-04-26T07:51:40.401063+0000","last_fullsized":"2024-04-26T07:51:40.401063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"90'28","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415147+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:51:40.415147+0000","last_peered":"2024-04-26T07:51:40.415147+0000","last_clean":"2024-04-26T07:51:40.415147+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:51:40.415147+0000","last_undegraded":"2024-04-26T07:51:40.415147+0000","last_fullsized":"2024-04-26T07:51:40.415147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413866+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:51:40.413866+0000","last_peered":"2024-04-26T07:51:40.413866+0000","last_clean":"2024-04-26T07:51:40.413866+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:51:40.413866+0000","last_undegraded":"2024-04-26T07:51:40.413866+0000","last_fullsized":"2024-04-26T07:51:40.413866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"90'18","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385678+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:40.385678+0000","last_peered":"2024-04-26T07:51:40.385678+0000","last_clean":"2024-04-26T07:51:40.385678+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:40.385678+0000","last_undegraded":"2024-04-26T07:51:40.385678+0000","last_fullsized":"2024-04-26T07:51:40.385678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408447+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:40.408447+0000","last_peered":"2024-04-26T07:51:40.408447+0000","last_clean":"2024-04-26T07:51:40.408447+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:40.408447+0000","last_undegraded":"2024-04-26T07:51:40.408447+0000","last_fullsized":"2024-04-26T07:51:40.408447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393764+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:40.393764+0000","last_peered":"2024-04-26T07:51:40.393764+0000","last_clean":"2024-04-26T07:51:40.393764+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:40.393764+0000","last_undegraded":"2024-04-26T07:51:40.393764+0000","last_fullsized":"2024-04-26T07:51:40.393764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391427+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:40.391427+0000","last_peered":"2024-04-26T07:51:40.391427+0000","last_clean":"2024-04-26T07:51:40.391427+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:40.391427+0000","last_undegraded":"2024-04-26T07:51:40.391427+0000","last_fullsized":"2024-04-26T07:51:40.391427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'27","reported_seq":163,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399353+0000","last_change":"2024-04-26T07:49:08.971107+0000","last_active":"2024-04-26T07:51:40.399353+0000","last_peered":"2024-04-26T07:51:40.399353+0000","last_clean":"2024-04-26T07:51:40.399353+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:51:40.399353+0000","last_undegraded":"2024-04-26T07:51:40.399353+0000","last_fullsized":"2024-04-26T07:51:40.399353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:06.980641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394746+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:40.394746+0000","last_peered":"2024-04-26T07:51:40.394746+0000","last_clean":"2024-04-26T07:51:40.394746+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:40.394746+0000","last_undegraded":"2024-04-26T07:51:40.394746+0000","last_fullsized":"2024-04-26T07:51:40.394746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"90'13","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392754+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:51:40.392754+0000","last_peered":"2024-04-26T07:51:40.392754+0000","last_clean":"2024-04-26T07:51:40.392754+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:51:40.392754+0000","last_undegraded":"2024-04-26T07:51:40.392754+0000","last_fullsized":"2024-04-26T07:51:40.392754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395141+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:40.395141+0000","last_peered":"2024-04-26T07:51:40.395141+0000","last_clean":"2024-04-26T07:51:40.395141+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:40.395141+0000","last_undegraded":"2024-04-26T07:51:40.395141+0000","last_fullsized":"2024-04-26T07:51:40.395141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":128,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.446873+0000","last_change":"2024-04-26T07:51:40.446873+0000","last_active":"2024-04-26T07:51:40.446873+0000","last_peered":"2024-04-26T07:51:40.446873+0000","last_clean":"2024-04-26T07:51:40.446873+0000","last_became_active":"2024-04-26T07:51:40.440377+0000","last_became_peered":"2024-04-26T07:51:40.440377+0000","last_unstale":"2024-04-26T07:51:40.446873+0000","last_undegraded":"2024-04-26T07:51:40.446873+0000","last_fullsized":"2024-04-26T07:51:40.446873+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:01.888159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395378+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:40.395378+0000","last_peered":"2024-04-26T07:51:40.395378+0000","last_clean":"2024-04-26T07:51:40.395378+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:40.395378+0000","last_undegraded":"2024-04-26T07:51:40.395378+0000","last_fullsized":"2024-04-26T07:51:40.395378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'25","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388214+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:40.388214+0000","last_peered":"2024-04-26T07:51:40.388214+0000","last_clean":"2024-04-26T07:51:40.388214+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:40.388214+0000","last_undegraded":"2024-04-26T07:51:40.388214+0000","last_fullsized":"2024-04-26T07:51:40.388214+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:34.437375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408789+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:51:40.408789+0000","last_peered":"2024-04-26T07:51:40.408789+0000","last_clean":"2024-04-26T07:51:40.408789+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:51:40.408789+0000","last_undegraded":"2024-04-26T07:51:40.408789+0000","last_fullsized":"2024-04-26T07:51:40.408789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"90'17","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400133+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:51:40.400133+0000","last_peered":"2024-04-26T07:51:40.400133+0000","last_clean":"2024-04-26T07:51:40.400133+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:51:40.400133+0000","last_undegraded":"2024-04-26T07:51:40.400133+0000","last_fullsized":"2024-04-26T07:51:40.400133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387124+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:51:40.387124+0000","last_peered":"2024-04-26T07:51:40.387124+0000","last_clean":"2024-04-26T07:51:40.387124+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:40.387124+0000","last_undegraded":"2024-04-26T07:51:40.387124+0000","last_fullsized":"2024-04-26T07:51:40.387124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399528+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:40.399528+0000","last_peered":"2024-04-26T07:51:40.399528+0000","last_clean":"2024-04-26T07:51:40.399528+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:40.399528+0000","last_undegraded":"2024-04-26T07:51:40.399528+0000","last_fullsized":"2024-04-26T07:51:40.399528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410351+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:51:40.410351+0000","last_peered":"2024-04-26T07:51:40.410351+0000","last_clean":"2024-04-26T07:51:40.410351+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:51:40.410351+0000","last_undegraded":"2024-04-26T07:51:40.410351+0000","last_fullsized":"2024-04-26T07:51:40.410351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408072+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:51:40.408072+0000","last_peered":"2024-04-26T07:51:40.408072+0000","last_clean":"2024-04-26T07:51:40.408072+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:51:40.408072+0000","last_undegraded":"2024-04-26T07:51:40.408072+0000","last_fullsized":"2024-04-26T07:51:40.408072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410664+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:51:40.410664+0000","last_peered":"2024-04-26T07:51:40.410664+0000","last_clean":"2024-04-26T07:51:40.410664+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:51:40.410664+0000","last_undegraded":"2024-04-26T07:51:40.410664+0000","last_fullsized":"2024-04-26T07:51:40.410664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'26","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398857+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:51:40.398857+0000","last_peered":"2024-04-26T07:51:40.398857+0000","last_clean":"2024-04-26T07:51:40.398857+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:51:40.398857+0000","last_undegraded":"2024-04-26T07:51:40.398857+0000","last_fullsized":"2024-04-26T07:51:40.398857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414531+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:51:40.414531+0000","last_peered":"2024-04-26T07:51:40.414531+0000","last_clean":"2024-04-26T07:51:40.414531+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:51:40.414531+0000","last_undegraded":"2024-04-26T07:51:40.414531+0000","last_fullsized":"2024-04-26T07:51:40.414531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"89'18","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414182+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:40.414182+0000","last_peered":"2024-04-26T07:51:40.414182+0000","last_clean":"2024-04-26T07:51:40.414182+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:40.414182+0000","last_undegraded":"2024-04-26T07:51:40.414182+0000","last_fullsized":"2024-04-26T07:51:40.414182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409820+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:51:40.409820+0000","last_peered":"2024-04-26T07:51:40.409820+0000","last_clean":"2024-04-26T07:51:40.409820+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:51:40.409820+0000","last_undegraded":"2024-04-26T07:51:40.409820+0000","last_fullsized":"2024-04-26T07:51:40.409820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'23","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387539+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:40.387539+0000","last_peered":"2024-04-26T07:51:40.387539+0000","last_clean":"2024-04-26T07:51:40.387539+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:40.387539+0000","last_undegraded":"2024-04-26T07:51:40.387539+0000","last_fullsized":"2024-04-26T07:51:40.387539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392517+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:51:40.392517+0000","last_peered":"2024-04-26T07:51:40.392517+0000","last_clean":"2024-04-26T07:51:40.392517+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:51:40.392517+0000","last_undegraded":"2024-04-26T07:51:40.392517+0000","last_fullsized":"2024-04-26T07:51:40.392517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'32","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393638+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:40.393638+0000","last_peered":"2024-04-26T07:51:40.393638+0000","last_clean":"2024-04-26T07:51:40.393638+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:40.393638+0000","last_undegraded":"2024-04-26T07:51:40.393638+0000","last_fullsized":"2024-04-26T07:51:40.393638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401267+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:51:40.401267+0000","last_peered":"2024-04-26T07:51:40.401267+0000","last_clean":"2024-04-26T07:51:40.401267+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:51:40.401267+0000","last_undegraded":"2024-04-26T07:51:40.401267+0000","last_fullsized":"2024-04-26T07:51:40.401267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"89'35","reported_seq":227,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410520+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:40.410520+0000","last_peered":"2024-04-26T07:51:40.410520+0000","last_clean":"2024-04-26T07:51:40.410520+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:40.410520+0000","last_undegraded":"2024-04-26T07:51:40.410520+0000","last_fullsized":"2024-04-26T07:51:40.410520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391161+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:51:40.391161+0000","last_peered":"2024-04-26T07:51:40.391161+0000","last_clean":"2024-04-26T07:51:40.391161+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:51:40.391161+0000","last_undegraded":"2024-04-26T07:51:40.391161+0000","last_fullsized":"2024-04-26T07:51:40.391161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"89'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412598+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:51:40.412598+0000","last_peered":"2024-04-26T07:51:40.412598+0000","last_clean":"2024-04-26T07:51:40.412598+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:51:40.412598+0000","last_undegraded":"2024-04-26T07:51:40.412598+0000","last_fullsized":"2024-04-26T07:51:40.412598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407803+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:51:40.407803+0000","last_peered":"2024-04-26T07:51:40.407803+0000","last_clean":"2024-04-26T07:51:40.407803+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:51:40.407803+0000","last_undegraded":"2024-04-26T07:51:40.407803+0000","last_fullsized":"2024-04-26T07:51:40.407803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394239+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:40.394239+0000","last_peered":"2024-04-26T07:51:40.394239+0000","last_clean":"2024-04-26T07:51:40.394239+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:40.394239+0000","last_undegraded":"2024-04-26T07:51:40.394239+0000","last_fullsized":"2024-04-26T07:51:40.394239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388114+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:51:40.388114+0000","last_peered":"2024-04-26T07:51:40.388114+0000","last_clean":"2024-04-26T07:51:40.388114+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:51:40.388114+0000","last_undegraded":"2024-04-26T07:51:40.388114+0000","last_fullsized":"2024-04-26T07:51:40.388114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410876+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:40.410876+0000","last_peered":"2024-04-26T07:51:40.410876+0000","last_clean":"2024-04-26T07:51:40.410876+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:40.410876+0000","last_undegraded":"2024-04-26T07:51:40.410876+0000","last_fullsized":"2024-04-26T07:51:40.410876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397867+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:51:40.397867+0000","last_peered":"2024-04-26T07:51:40.397867+0000","last_clean":"2024-04-26T07:51:40.397867+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:51:40.397867+0000","last_undegraded":"2024-04-26T07:51:40.397867+0000","last_fullsized":"2024-04-26T07:51:40.397867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391523+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:40.391523+0000","last_peered":"2024-04-26T07:51:40.391523+0000","last_clean":"2024-04-26T07:51:40.391523+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:40.391523+0000","last_undegraded":"2024-04-26T07:51:40.391523+0000","last_fullsized":"2024-04-26T07:51:40.391523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399068+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:51:40.399068+0000","last_peered":"2024-04-26T07:51:40.399068+0000","last_clean":"2024-04-26T07:51:40.399068+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:51:40.399068+0000","last_undegraded":"2024-04-26T07:51:40.399068+0000","last_fullsized":"2024-04-26T07:51:40.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'14","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414006+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:51:40.414006+0000","last_peered":"2024-04-26T07:51:40.414006+0000","last_clean":"2024-04-26T07:51:40.414006+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:51:40.414006+0000","last_undegraded":"2024-04-26T07:51:40.414006+0000","last_fullsized":"2024-04-26T07:51:40.414006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398879+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:51:40.398879+0000","last_peered":"2024-04-26T07:51:40.398879+0000","last_clean":"2024-04-26T07:51:40.398879+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:51:40.398879+0000","last_undegraded":"2024-04-26T07:51:40.398879+0000","last_fullsized":"2024-04-26T07:51:40.398879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'27","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387769+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:40.387769+0000","last_peered":"2024-04-26T07:51:40.387769+0000","last_clean":"2024-04-26T07:51:40.387769+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:40.387769+0000","last_undegraded":"2024-04-26T07:51:40.387769+0000","last_fullsized":"2024-04-26T07:51:40.387769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":162,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428116+0000","last_change":"2024-04-26T07:51:40.428116+0000","last_active":"2024-04-26T07:51:40.428116+0000","last_peered":"2024-04-26T07:51:40.428116+0000","last_clean":"2024-04-26T07:51:40.428116+0000","last_became_active":"2024-04-26T07:51:40.427193+0000","last_became_peered":"2024-04-26T07:51:40.427193+0000","last_unstale":"2024-04-26T07:51:40.428116+0000","last_undegraded":"2024-04-26T07:51:40.428116+0000","last_fullsized":"2024-04-26T07:51:40.428116+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:06.591882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411819+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:40.411819+0000","last_peered":"2024-04-26T07:51:40.411819+0000","last_clean":"2024-04-26T07:51:40.411819+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:40.411819+0000","last_undegraded":"2024-04-26T07:51:40.411819+0000","last_fullsized":"2024-04-26T07:51:40.411819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386601+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:51:40.386601+0000","last_peered":"2024-04-26T07:51:40.386601+0000","last_clean":"2024-04-26T07:51:40.386601+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:51:40.386601+0000","last_undegraded":"2024-04-26T07:51:40.386601+0000","last_fullsized":"2024-04-26T07:51:40.386601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.449013+0000","last_change":"2024-04-26T07:51:40.449013+0000","last_active":"2024-04-26T07:51:40.449013+0000","last_peered":"2024-04-26T07:51:40.449013+0000","last_clean":"2024-04-26T07:51:40.449013+0000","last_became_active":"2024-04-26T07:51:40.445977+0000","last_became_peered":"2024-04-26T07:51:40.445977+0000","last_unstale":"2024-04-26T07:51:40.449013+0000","last_undegraded":"2024-04-26T07:51:40.449013+0000","last_fullsized":"2024-04-26T07:51:40.449013+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:19.331650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391050+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:51:40.391050+0000","last_peered":"2024-04-26T07:51:40.391050+0000","last_clean":"2024-04-26T07:51:40.391050+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:51:40.391050+0000","last_undegraded":"2024-04-26T07:51:40.391050+0000","last_fullsized":"2024-04-26T07:51:40.391050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"89'32","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399748+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:51:40.399748+0000","last_peered":"2024-04-26T07:51:40.399748+0000","last_clean":"2024-04-26T07:51:40.399748+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:51:40.399748+0000","last_undegraded":"2024-04-26T07:51:40.399748+0000","last_fullsized":"2024-04-26T07:51:40.399748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":169,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436803+0000","last_change":"2024-04-26T07:51:40.436803+0000","last_active":"2024-04-26T07:51:40.436803+0000","last_peered":"2024-04-26T07:51:40.436803+0000","last_clean":"2024-04-26T07:51:40.436803+0000","last_became_active":"2024-04-26T07:51:40.433471+0000","last_became_peered":"2024-04-26T07:51:40.433471+0000","last_unstale":"2024-04-26T07:51:40.436803+0000","last_undegraded":"2024-04-26T07:51:40.436803+0000","last_fullsized":"2024-04-26T07:51:40.436803+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:23.227977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417251+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:40.417251+0000","last_peered":"2024-04-26T07:51:40.417251+0000","last_clean":"2024-04-26T07:51:40.417251+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:40.417251+0000","last_undegraded":"2024-04-26T07:51:40.417251+0000","last_fullsized":"2024-04-26T07:51:40.417251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"89'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410612+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:40.410612+0000","last_peered":"2024-04-26T07:51:40.410612+0000","last_clean":"2024-04-26T07:51:40.410612+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:40.410612+0000","last_undegraded":"2024-04-26T07:51:40.410612+0000","last_fullsized":"2024-04-26T07:51:40.410612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388025+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:51:40.388025+0000","last_peered":"2024-04-26T07:51:40.388025+0000","last_clean":"2024-04-26T07:51:40.388025+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:51:40.388025+0000","last_undegraded":"2024-04-26T07:51:40.388025+0000","last_fullsized":"2024-04-26T07:51:40.388025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'29","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409213+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:51:40.409213+0000","last_peered":"2024-04-26T07:51:40.409213+0000","last_clean":"2024-04-26T07:51:40.409213+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:51:40.409213+0000","last_undegraded":"2024-04-26T07:51:40.409213+0000","last_fullsized":"2024-04-26T07:51:40.409213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415075+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:51:40.415075+0000","last_peered":"2024-04-26T07:51:40.415075+0000","last_clean":"2024-04-26T07:51:40.415075+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:51:40.415075+0000","last_undegraded":"2024-04-26T07:51:40.415075+0000","last_fullsized":"2024-04-26T07:51:40.415075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1082,"ondisk_log_size":1082,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":852,"num_read_kb":617,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":761,"ondisk_log_size":761,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1446,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716656,"kb_used_data":1685480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92655184,"statfs":{"total":96636764160,"available":94878908416,"internally_reserved":0,"allocated":1725931520,"data_stored":1725333608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203988,"kb_used_data":1172812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93167852,"statfs":{"total":96636764160,"available":95403880448,"internally_reserved":0,"allocated":1200959488,"data_stored":1200395317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812528,"kb_used_data":1777192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92559312,"statfs":{"total":96636764160,"available":94780735488,"internally_reserved":0,"allocated":1819844608,"data_stored":1819232747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1935060,"kb_used_data":1903876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92436780,"statfs":{"total":96636764160,"available":94655262720,"internally_reserved":0,"allocated":1949569024,"data_stored":1949020427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1877936,"kb_used_data":1842600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92493904,"statfs":{"total":96636764160,"available":94713757696,"internally_reserved":0,"allocated":1886822400,"data_stored":1886225804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1122120,"kb_used_data":1086784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93249720,"statfs":{"total":96636764160,"available":95487713280,"internally_reserved":0,"allocated":1112866816,"data_stored":1112315550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185700,"kb_used_data":1150364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93186140,"statfs":{"total":96636764160,"available":95422607360,"internally_reserved":0,"allocated":1177972736,"data_stored":1177387279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1732984,"kb_used_data":1697636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92638856,"statfs":{"total":96636764160,"available":94862188544,"internally_reserved":0,"allocated":1738379264,"data_stored":1737800572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1736441856,"data_stored":1736441856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1176502272,"data_stored":1176502272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1885339648,"data_stored":1885339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1948254208,"data_stored":1948254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1199570944,"data_stored":1199570944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1723858944,"data_stored":1723858944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":118389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:51:56.851 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:51:57.215 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:57.223 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:51:57.231 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-26T07:51:55.855160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3285,"num_read_kb":2974,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3904,"ondisk_log_size":3904,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12586972,"kb_used_data":12316744,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":742387748,"statfs":{"total":773094113280,"available":760205053952,"internally_reserved":0,"allocated":12612345856,"data_stored":12607711304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005853"},"pg_stats":[{"pgid":"3.3f","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.419563+0000","last_change":"2024-04-26T07:51:40.419563+0000","last_active":"2024-04-26T07:51:40.419563+0000","last_peered":"2024-04-26T07:51:40.419563+0000","last_clean":"2024-04-26T07:51:40.419563+0000","last_became_active":"2024-04-26T07:51:40.418691+0000","last_became_peered":"2024-04-26T07:51:40.418691+0000","last_unstale":"2024-04-26T07:51:40.419563+0000","last_undegraded":"2024-04-26T07:51:40.419563+0000","last_fullsized":"2024-04-26T07:51:40.419563+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:26.560585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410032+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:51:40.410032+0000","last_peered":"2024-04-26T07:51:40.410032+0000","last_clean":"2024-04-26T07:51:40.410032+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:51:40.410032+0000","last_undegraded":"2024-04-26T07:51:40.410032+0000","last_fullsized":"2024-04-26T07:51:40.410032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'26","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410817+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:51:40.410817+0000","last_peered":"2024-04-26T07:51:40.410817+0000","last_clean":"2024-04-26T07:51:40.410817+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:51:40.410817+0000","last_undegraded":"2024-04-26T07:51:40.410817+0000","last_fullsized":"2024-04-26T07:51:40.410817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":144,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.439485+0000","last_change":"2024-04-26T07:51:40.439485+0000","last_active":"2024-04-26T07:51:40.439485+0000","last_peered":"2024-04-26T07:51:40.439485+0000","last_clean":"2024-04-26T07:51:40.439485+0000","last_became_active":"2024-04-26T07:51:40.437448+0000","last_became_peered":"2024-04-26T07:51:40.437448+0000","last_unstale":"2024-04-26T07:51:40.439485+0000","last_undegraded":"2024-04-26T07:51:40.439485+0000","last_fullsized":"2024-04-26T07:51:40.439485+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:31.108593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387511+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:40.387511+0000","last_peered":"2024-04-26T07:51:40.387511+0000","last_clean":"2024-04-26T07:51:40.387511+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:40.387511+0000","last_undegraded":"2024-04-26T07:51:40.387511+0000","last_fullsized":"2024-04-26T07:51:40.387511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":226,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400767+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:51:40.400767+0000","last_peered":"2024-04-26T07:51:40.400767+0000","last_clean":"2024-04-26T07:51:40.400767+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:51:40.400767+0000","last_undegraded":"2024-04-26T07:51:40.400767+0000","last_fullsized":"2024-04-26T07:51:40.400767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414495+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:40.414495+0000","last_peered":"2024-04-26T07:51:40.414495+0000","last_clean":"2024-04-26T07:51:40.414495+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:40.414495+0000","last_undegraded":"2024-04-26T07:51:40.414495+0000","last_fullsized":"2024-04-26T07:51:40.414495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387443+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:40.387443+0000","last_peered":"2024-04-26T07:51:40.387443+0000","last_clean":"2024-04-26T07:51:40.387443+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:40.387443+0000","last_undegraded":"2024-04-26T07:51:40.387443+0000","last_fullsized":"2024-04-26T07:51:40.387443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'23","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435742+0000","last_change":"2024-04-26T07:51:40.435742+0000","last_active":"2024-04-26T07:51:40.435742+0000","last_peered":"2024-04-26T07:51:40.435742+0000","last_clean":"2024-04-26T07:51:40.435742+0000","last_became_active":"2024-04-26T07:51:40.433215+0000","last_became_peered":"2024-04-26T07:51:40.433215+0000","last_unstale":"2024-04-26T07:51:40.435742+0000","last_undegraded":"2024-04-26T07:51:40.435742+0000","last_fullsized":"2024-04-26T07:51:40.435742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:42.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411494+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:51:40.411494+0000","last_peered":"2024-04-26T07:51:40.411494+0000","last_clean":"2024-04-26T07:51:40.411494+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:51:40.411494+0000","last_undegraded":"2024-04-26T07:51:40.411494+0000","last_fullsized":"2024-04-26T07:51:40.411494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'22","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413726+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:51:40.413726+0000","last_peered":"2024-04-26T07:51:40.413726+0000","last_clean":"2024-04-26T07:51:40.413726+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:51:40.413726+0000","last_undegraded":"2024-04-26T07:51:40.413726+0000","last_fullsized":"2024-04-26T07:51:40.413726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396370+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:51:40.396370+0000","last_peered":"2024-04-26T07:51:40.396370+0000","last_clean":"2024-04-26T07:51:40.396370+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:51:40.396370+0000","last_undegraded":"2024-04-26T07:51:40.396370+0000","last_fullsized":"2024-04-26T07:51:40.396370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'19","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429122+0000","last_change":"2024-04-26T07:51:40.429122+0000","last_active":"2024-04-26T07:51:40.429122+0000","last_peered":"2024-04-26T07:51:40.429122+0000","last_clean":"2024-04-26T07:51:40.429122+0000","last_became_active":"2024-04-26T07:51:40.428267+0000","last_became_peered":"2024-04-26T07:51:40.428267+0000","last_unstale":"2024-04-26T07:51:40.429122+0000","last_undegraded":"2024-04-26T07:51:40.429122+0000","last_fullsized":"2024-04-26T07:51:40.429122+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.892584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414674+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:51:40.414674+0000","last_peered":"2024-04-26T07:51:40.414674+0000","last_clean":"2024-04-26T07:51:40.414674+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:51:40.414674+0000","last_undegraded":"2024-04-26T07:51:40.414674+0000","last_fullsized":"2024-04-26T07:51:40.414674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"89'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390795+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:40.390795+0000","last_peered":"2024-04-26T07:51:40.390795+0000","last_clean":"2024-04-26T07:51:40.390795+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:40.390795+0000","last_undegraded":"2024-04-26T07:51:40.390795+0000","last_fullsized":"2024-04-26T07:51:40.390795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399387+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:51:40.399387+0000","last_peered":"2024-04-26T07:51:40.399387+0000","last_clean":"2024-04-26T07:51:40.399387+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:51:40.399387+0000","last_undegraded":"2024-04-26T07:51:40.399387+0000","last_fullsized":"2024-04-26T07:51:40.399387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395530+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:51:40.395530+0000","last_peered":"2024-04-26T07:51:40.395530+0000","last_clean":"2024-04-26T07:51:40.395530+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:51:40.395530+0000","last_undegraded":"2024-04-26T07:51:40.395530+0000","last_fullsized":"2024-04-26T07:51:40.395530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'25","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429380+0000","last_change":"2024-04-26T07:51:40.429380+0000","last_active":"2024-04-26T07:51:40.429380+0000","last_peered":"2024-04-26T07:51:40.429380+0000","last_clean":"2024-04-26T07:51:40.429380+0000","last_became_active":"2024-04-26T07:51:40.428461+0000","last_became_peered":"2024-04-26T07:51:40.428461+0000","last_unstale":"2024-04-26T07:51:40.429380+0000","last_undegraded":"2024-04-26T07:51:40.429380+0000","last_fullsized":"2024-04-26T07:51:40.429380+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.386208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437638+0000","last_change":"2024-04-26T07:51:40.437638+0000","last_active":"2024-04-26T07:51:40.437638+0000","last_peered":"2024-04-26T07:51:40.437638+0000","last_clean":"2024-04-26T07:51:40.437638+0000","last_became_active":"2024-04-26T07:51:40.435585+0000","last_became_peered":"2024-04-26T07:51:40.435585+0000","last_unstale":"2024-04-26T07:51:40.437638+0000","last_undegraded":"2024-04-26T07:51:40.437638+0000","last_fullsized":"2024-04-26T07:51:40.437638+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:03.283810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'31","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412304+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:51:40.412304+0000","last_peered":"2024-04-26T07:51:40.412304+0000","last_clean":"2024-04-26T07:51:40.412304+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:51:40.412304+0000","last_undegraded":"2024-04-26T07:51:40.412304+0000","last_fullsized":"2024-04-26T07:51:40.412304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":41,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413895+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:51:40.413895+0000","last_peered":"2024-04-26T07:51:40.413895+0000","last_clean":"2024-04-26T07:51:40.413895+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:51:40.413895+0000","last_undegraded":"2024-04-26T07:51:40.413895+0000","last_fullsized":"2024-04-26T07:51:40.413895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412401+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:51:40.412401+0000","last_peered":"2024-04-26T07:51:40.412401+0000","last_clean":"2024-04-26T07:51:40.412401+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:51:40.412401+0000","last_undegraded":"2024-04-26T07:51:40.412401+0000","last_fullsized":"2024-04-26T07:51:40.412401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401519+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:51:40.401519+0000","last_peered":"2024-04-26T07:51:40.401519+0000","last_clean":"2024-04-26T07:51:40.401519+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:51:40.401519+0000","last_undegraded":"2024-04-26T07:51:40.401519+0000","last_fullsized":"2024-04-26T07:51:40.401519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'24","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397971+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:40.397971+0000","last_peered":"2024-04-26T07:51:40.397971+0000","last_clean":"2024-04-26T07:51:40.397971+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:40.397971+0000","last_undegraded":"2024-04-26T07:51:40.397971+0000","last_fullsized":"2024-04-26T07:51:40.397971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399756+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:51:40.399756+0000","last_peered":"2024-04-26T07:51:40.399756+0000","last_clean":"2024-04-26T07:51:40.399756+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:51:40.399756+0000","last_undegraded":"2024-04-26T07:51:40.399756+0000","last_fullsized":"2024-04-26T07:51:40.399756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392181+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:40.392181+0000","last_peered":"2024-04-26T07:51:40.392181+0000","last_clean":"2024-04-26T07:51:40.392181+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:40.392181+0000","last_undegraded":"2024-04-26T07:51:40.392181+0000","last_fullsized":"2024-04-26T07:51:40.392181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396627+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:51:40.396627+0000","last_peered":"2024-04-26T07:51:40.396627+0000","last_clean":"2024-04-26T07:51:40.396627+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:51:40.396627+0000","last_undegraded":"2024-04-26T07:51:40.396627+0000","last_fullsized":"2024-04-26T07:51:40.396627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"90'24","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386874+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:40.386874+0000","last_peered":"2024-04-26T07:51:40.386874+0000","last_clean":"2024-04-26T07:51:40.386874+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:40.386874+0000","last_undegraded":"2024-04-26T07:51:40.386874+0000","last_fullsized":"2024-04-26T07:51:40.386874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394620+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:40.394620+0000","last_peered":"2024-04-26T07:51:40.394620+0000","last_clean":"2024-04-26T07:51:40.394620+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:40.394620+0000","last_undegraded":"2024-04-26T07:51:40.394620+0000","last_fullsized":"2024-04-26T07:51:40.394620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393414+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:40.393414+0000","last_peered":"2024-04-26T07:51:40.393414+0000","last_clean":"2024-04-26T07:51:40.393414+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:40.393414+0000","last_undegraded":"2024-04-26T07:51:40.393414+0000","last_fullsized":"2024-04-26T07:51:40.393414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'19","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401423+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:40.401423+0000","last_peered":"2024-04-26T07:51:40.401423+0000","last_clean":"2024-04-26T07:51:40.401423+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:40.401423+0000","last_undegraded":"2024-04-26T07:51:40.401423+0000","last_fullsized":"2024-04-26T07:51:40.401423+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:08.704021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414398+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:40.414398+0000","last_peered":"2024-04-26T07:51:40.414398+0000","last_clean":"2024-04-26T07:51:40.414398+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:40.414398+0000","last_undegraded":"2024-04-26T07:51:40.414398+0000","last_fullsized":"2024-04-26T07:51:40.414398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"90'17","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387664+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:40.387664+0000","last_peered":"2024-04-26T07:51:40.387664+0000","last_clean":"2024-04-26T07:51:40.387664+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:40.387664+0000","last_undegraded":"2024-04-26T07:51:40.387664+0000","last_fullsized":"2024-04-26T07:51:40.387664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427384+0000","last_change":"2024-04-26T07:51:40.427384+0000","last_active":"2024-04-26T07:51:40.427384+0000","last_peered":"2024-04-26T07:51:40.427384+0000","last_clean":"2024-04-26T07:51:40.427384+0000","last_became_active":"2024-04-26T07:51:40.424563+0000","last_became_peered":"2024-04-26T07:51:40.424563+0000","last_unstale":"2024-04-26T07:51:40.427384+0000","last_undegraded":"2024-04-26T07:51:40.427384+0000","last_fullsized":"2024-04-26T07:51:40.427384+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:45.363785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409995+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:40.409995+0000","last_peered":"2024-04-26T07:51:40.409995+0000","last_clean":"2024-04-26T07:51:40.409995+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:40.409995+0000","last_undegraded":"2024-04-26T07:51:40.409995+0000","last_fullsized":"2024-04-26T07:51:40.409995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415011+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:51:40.415011+0000","last_peered":"2024-04-26T07:51:40.415011+0000","last_clean":"2024-04-26T07:51:40.415011+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:51:40.415011+0000","last_undegraded":"2024-04-26T07:51:40.415011+0000","last_fullsized":"2024-04-26T07:51:40.415011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386993+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:40.386993+0000","last_peered":"2024-04-26T07:51:40.386993+0000","last_clean":"2024-04-26T07:51:40.386993+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:40.386993+0000","last_undegraded":"2024-04-26T07:51:40.386993+0000","last_fullsized":"2024-04-26T07:51:40.386993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393282+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:40.393282+0000","last_peered":"2024-04-26T07:51:40.393282+0000","last_clean":"2024-04-26T07:51:40.393282+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:40.393282+0000","last_undegraded":"2024-04-26T07:51:40.393282+0000","last_fullsized":"2024-04-26T07:51:40.393282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"53'7","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397138+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:51:40.397138+0000","last_peered":"2024-04-26T07:51:40.397138+0000","last_clean":"2024-04-26T07:51:40.397138+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:51:40.397138+0000","last_undegraded":"2024-04-26T07:51:40.397138+0000","last_fullsized":"2024-04-26T07:51:40.397138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396318+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:40.396318+0000","last_peered":"2024-04-26T07:51:40.396318+0000","last_clean":"2024-04-26T07:51:40.396318+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:40.396318+0000","last_undegraded":"2024-04-26T07:51:40.396318+0000","last_fullsized":"2024-04-26T07:51:40.396318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386651+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:51:40.386651+0000","last_peered":"2024-04-26T07:51:40.386651+0000","last_clean":"2024-04-26T07:51:40.386651+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:51:40.386651+0000","last_undegraded":"2024-04-26T07:51:40.386651+0000","last_fullsized":"2024-04-26T07:51:40.386651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388934+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:51:40.388934+0000","last_peered":"2024-04-26T07:51:40.388934+0000","last_clean":"2024-04-26T07:51:40.388934+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:51:40.388934+0000","last_undegraded":"2024-04-26T07:51:40.388934+0000","last_fullsized":"2024-04-26T07:51:40.388934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'22","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441938+0000","last_change":"2024-04-26T07:51:40.441938+0000","last_active":"2024-04-26T07:51:40.441938+0000","last_peered":"2024-04-26T07:51:40.441938+0000","last_clean":"2024-04-26T07:51:40.441938+0000","last_became_active":"2024-04-26T07:51:40.440255+0000","last_became_peered":"2024-04-26T07:51:40.440255+0000","last_unstale":"2024-04-26T07:51:40.441938+0000","last_undegraded":"2024-04-26T07:51:40.441938+0000","last_fullsized":"2024-04-26T07:51:40.441938+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:49.106793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394846+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:40.394846+0000","last_peered":"2024-04-26T07:51:40.394846+0000","last_clean":"2024-04-26T07:51:40.394846+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:40.394846+0000","last_undegraded":"2024-04-26T07:51:40.394846+0000","last_fullsized":"2024-04-26T07:51:40.394846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399562+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:51:40.399562+0000","last_peered":"2024-04-26T07:51:40.399562+0000","last_clean":"2024-04-26T07:51:40.399562+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:51:40.399562+0000","last_undegraded":"2024-04-26T07:51:40.399562+0000","last_fullsized":"2024-04-26T07:51:40.399562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"109'137","reported_seq":311,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807192+0000","last_change":"2024-04-26T07:51:40.446383+0000","last_active":"2024-04-26T07:51:45.807192+0000","last_peered":"2024-04-26T07:51:45.807192+0000","last_clean":"2024-04-26T07:51:45.807192+0000","last_became_active":"2024-04-26T07:51:40.439601+0000","last_became_peered":"2024-04-26T07:51:40.439601+0000","last_unstale":"2024-04-26T07:51:45.807192+0000","last_undegraded":"2024-04-26T07:51:45.807192+0000","last_fullsized":"2024-04-26T07:51:45.807192+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:32.966811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395932+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:40.395932+0000","last_peered":"2024-04-26T07:51:40.395932+0000","last_clean":"2024-04-26T07:51:40.395932+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:40.395932+0000","last_undegraded":"2024-04-26T07:51:40.395932+0000","last_fullsized":"2024-04-26T07:51:40.395932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394102+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:51:40.394102+0000","last_peered":"2024-04-26T07:51:40.394102+0000","last_clean":"2024-04-26T07:51:40.394102+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:51:40.394102+0000","last_undegraded":"2024-04-26T07:51:40.394102+0000","last_fullsized":"2024-04-26T07:51:40.394102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'17","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408341+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:51:40.408341+0000","last_peered":"2024-04-26T07:51:40.408341+0000","last_clean":"2024-04-26T07:51:40.408341+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:51:40.408341+0000","last_undegraded":"2024-04-26T07:51:40.408341+0000","last_fullsized":"2024-04-26T07:51:40.408341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414412+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:40.414412+0000","last_peered":"2024-04-26T07:51:40.414412+0000","last_clean":"2024-04-26T07:51:40.414412+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:40.414412+0000","last_undegraded":"2024-04-26T07:51:40.414412+0000","last_fullsized":"2024-04-26T07:51:40.414412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"90'17","reported_seq":159,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.447428+0000","last_change":"2024-04-26T07:51:40.447428+0000","last_active":"2024-04-26T07:51:40.447428+0000","last_peered":"2024-04-26T07:51:40.447428+0000","last_clean":"2024-04-26T07:51:40.447428+0000","last_became_active":"2024-04-26T07:51:40.441381+0000","last_became_peered":"2024-04-26T07:51:40.441381+0000","last_unstale":"2024-04-26T07:51:40.447428+0000","last_undegraded":"2024-04-26T07:51:40.447428+0000","last_fullsized":"2024-04-26T07:51:40.447428+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:19.309516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"109'135","reported_seq":352,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804804+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:51:45.804804+0000","last_peered":"2024-04-26T07:51:45.804804+0000","last_clean":"2024-04-26T07:51:45.804804+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:51:45.804804+0000","last_undegraded":"2024-04-26T07:51:45.804804+0000","last_fullsized":"2024-04-26T07:51:45.804804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410355+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:51:40.410355+0000","last_peered":"2024-04-26T07:51:40.410355+0000","last_clean":"2024-04-26T07:51:40.410355+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:51:40.410355+0000","last_undegraded":"2024-04-26T07:51:40.410355+0000","last_fullsized":"2024-04-26T07:51:40.410355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433314+0000","last_change":"2024-04-26T07:51:40.433314+0000","last_active":"2024-04-26T07:51:40.433314+0000","last_peered":"2024-04-26T07:51:40.433314+0000","last_clean":"2024-04-26T07:51:40.433314+0000","last_became_active":"2024-04-26T07:51:40.432352+0000","last_became_peered":"2024-04-26T07:51:40.432352+0000","last_unstale":"2024-04-26T07:51:40.433314+0000","last_undegraded":"2024-04-26T07:51:40.433314+0000","last_fullsized":"2024-04-26T07:51:40.433314+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:27.681250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436814+0000","last_change":"2024-04-26T07:51:40.436814+0000","last_active":"2024-04-26T07:51:40.436814+0000","last_peered":"2024-04-26T07:51:40.436814+0000","last_clean":"2024-04-26T07:51:40.436814+0000","last_became_active":"2024-04-26T07:51:40.432366+0000","last_became_peered":"2024-04-26T07:51:40.432366+0000","last_unstale":"2024-04-26T07:51:40.436814+0000","last_undegraded":"2024-04-26T07:51:40.436814+0000","last_fullsized":"2024-04-26T07:51:40.436814+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.091620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"90'27","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412936+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:51:40.412936+0000","last_peered":"2024-04-26T07:51:40.412936+0000","last_clean":"2024-04-26T07:51:40.412936+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:51:40.412936+0000","last_undegraded":"2024-04-26T07:51:40.412936+0000","last_fullsized":"2024-04-26T07:51:40.412936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409381+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:40.409381+0000","last_peered":"2024-04-26T07:51:40.409381+0000","last_clean":"2024-04-26T07:51:40.409381+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:40.409381+0000","last_undegraded":"2024-04-26T07:51:40.409381+0000","last_fullsized":"2024-04-26T07:51:40.409381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413984+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:40.413984+0000","last_peered":"2024-04-26T07:51:40.413984+0000","last_clean":"2024-04-26T07:51:40.413984+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:40.413984+0000","last_undegraded":"2024-04-26T07:51:40.413984+0000","last_fullsized":"2024-04-26T07:51:40.413984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395453+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:51:40.395453+0000","last_peered":"2024-04-26T07:51:40.395453+0000","last_clean":"2024-04-26T07:51:40.395453+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:51:40.395453+0000","last_undegraded":"2024-04-26T07:51:40.395453+0000","last_fullsized":"2024-04-26T07:51:40.395453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'24","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432790+0000","last_change":"2024-04-26T07:51:40.432790+0000","last_active":"2024-04-26T07:51:40.432790+0000","last_peered":"2024-04-26T07:51:40.432790+0000","last_clean":"2024-04-26T07:51:40.432790+0000","last_became_active":"2024-04-26T07:51:40.431661+0000","last_became_peered":"2024-04-26T07:51:40.431661+0000","last_unstale":"2024-04-26T07:51:40.432790+0000","last_undegraded":"2024-04-26T07:51:40.432790+0000","last_fullsized":"2024-04-26T07:51:40.432790+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:44.955807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399129+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:51:40.399129+0000","last_peered":"2024-04-26T07:51:40.399129+0000","last_clean":"2024-04-26T07:51:40.399129+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:51:40.399129+0000","last_undegraded":"2024-04-26T07:51:40.399129+0000","last_fullsized":"2024-04-26T07:51:40.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"90'17","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392602+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:51:40.392602+0000","last_peered":"2024-04-26T07:51:40.392602+0000","last_clean":"2024-04-26T07:51:40.392602+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:51:40.392602+0000","last_undegraded":"2024-04-26T07:51:40.392602+0000","last_fullsized":"2024-04-26T07:51:40.392602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391295+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:51:40.391295+0000","last_peered":"2024-04-26T07:51:40.391295+0000","last_clean":"2024-04-26T07:51:40.391295+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:51:40.391295+0000","last_undegraded":"2024-04-26T07:51:40.391295+0000","last_fullsized":"2024-04-26T07:51:40.391295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411466+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:40.411466+0000","last_peered":"2024-04-26T07:51:40.411466+0000","last_clean":"2024-04-26T07:51:40.411466+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:40.411466+0000","last_undegraded":"2024-04-26T07:51:40.411466+0000","last_fullsized":"2024-04-26T07:51:40.411466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409163+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:51:40.409163+0000","last_peered":"2024-04-26T07:51:40.409163+0000","last_clean":"2024-04-26T07:51:40.409163+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:51:40.409163+0000","last_undegraded":"2024-04-26T07:51:40.409163+0000","last_fullsized":"2024-04-26T07:51:40.409163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"89'25","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.448016+0000","last_change":"2024-04-26T07:51:40.448016+0000","last_active":"2024-04-26T07:51:40.448016+0000","last_peered":"2024-04-26T07:51:40.448016+0000","last_clean":"2024-04-26T07:51:40.448016+0000","last_became_active":"2024-04-26T07:51:40.444713+0000","last_became_peered":"2024-04-26T07:51:40.444713+0000","last_unstale":"2024-04-26T07:51:40.448016+0000","last_undegraded":"2024-04-26T07:51:40.448016+0000","last_fullsized":"2024-04-26T07:51:40.448016+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:01.400431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401762+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:51:40.401762+0000","last_peered":"2024-04-26T07:51:40.401762+0000","last_clean":"2024-04-26T07:51:40.401762+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:51:40.401762+0000","last_undegraded":"2024-04-26T07:51:40.401762+0000","last_fullsized":"2024-04-26T07:51:40.401762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"90'25","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444435+0000","last_change":"2024-04-26T07:51:40.444435+0000","last_active":"2024-04-26T07:51:40.444435+0000","last_peered":"2024-04-26T07:51:40.444435+0000","last_clean":"2024-04-26T07:51:40.444435+0000","last_became_active":"2024-04-26T07:51:40.438940+0000","last_became_peered":"2024-04-26T07:51:40.438940+0000","last_unstale":"2024-04-26T07:51:40.444435+0000","last_undegraded":"2024-04-26T07:51:40.444435+0000","last_fullsized":"2024-04-26T07:51:40.444435+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:00.682036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62803,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"109'135","reported_seq":350,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804641+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:51:45.804641+0000","last_peered":"2024-04-26T07:51:45.804641+0000","last_clean":"2024-04-26T07:51:45.804641+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:51:45.804641+0000","last_undegraded":"2024-04-26T07:51:45.804641+0000","last_fullsized":"2024-04-26T07:51:45.804641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387775+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:40.387775+0000","last_peered":"2024-04-26T07:51:40.387775+0000","last_clean":"2024-04-26T07:51:40.387775+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:40.387775+0000","last_undegraded":"2024-04-26T07:51:40.387775+0000","last_fullsized":"2024-04-26T07:51:40.387775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388194+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:40.388194+0000","last_peered":"2024-04-26T07:51:40.388194+0000","last_clean":"2024-04-26T07:51:40.388194+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:40.388194+0000","last_undegraded":"2024-04-26T07:51:40.388194+0000","last_fullsized":"2024-04-26T07:51:40.388194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414745+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:40.414745+0000","last_peered":"2024-04-26T07:51:40.414745+0000","last_clean":"2024-04-26T07:51:40.414745+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:40.414745+0000","last_undegraded":"2024-04-26T07:51:40.414745+0000","last_fullsized":"2024-04-26T07:51:40.414745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400425+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:51:40.400425+0000","last_peered":"2024-04-26T07:51:40.400425+0000","last_clean":"2024-04-26T07:51:40.400425+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:51:40.400425+0000","last_undegraded":"2024-04-26T07:51:40.400425+0000","last_fullsized":"2024-04-26T07:51:40.400425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'29","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387270+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:40.387270+0000","last_peered":"2024-04-26T07:51:40.387270+0000","last_clean":"2024-04-26T07:51:40.387270+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:40.387270+0000","last_undegraded":"2024-04-26T07:51:40.387270+0000","last_fullsized":"2024-04-26T07:51:40.387270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398515+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:51:40.398515+0000","last_peered":"2024-04-26T07:51:40.398515+0000","last_clean":"2024-04-26T07:51:40.398515+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:51:40.398515+0000","last_undegraded":"2024-04-26T07:51:40.398515+0000","last_fullsized":"2024-04-26T07:51:40.398515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410194+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:40.410194+0000","last_peered":"2024-04-26T07:51:40.410194+0000","last_clean":"2024-04-26T07:51:40.410194+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:40.410194+0000","last_undegraded":"2024-04-26T07:51:40.410194+0000","last_fullsized":"2024-04-26T07:51:40.410194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398461+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:40.398461+0000","last_peered":"2024-04-26T07:51:40.398461+0000","last_clean":"2024-04-26T07:51:40.398461+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:40.398461+0000","last_undegraded":"2024-04-26T07:51:40.398461+0000","last_fullsized":"2024-04-26T07:51:40.398461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391868+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:40.391868+0000","last_peered":"2024-04-26T07:51:40.391868+0000","last_clean":"2024-04-26T07:51:40.391868+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:40.391868+0000","last_undegraded":"2024-04-26T07:51:40.391868+0000","last_fullsized":"2024-04-26T07:51:40.391868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398811+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:51:40.398811+0000","last_peered":"2024-04-26T07:51:40.398811+0000","last_clean":"2024-04-26T07:51:40.398811+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:51:40.398811+0000","last_undegraded":"2024-04-26T07:51:40.398811+0000","last_fullsized":"2024-04-26T07:51:40.398811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"90'20","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396590+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:51:40.396590+0000","last_peered":"2024-04-26T07:51:40.396590+0000","last_clean":"2024-04-26T07:51:40.396590+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:51:40.396590+0000","last_undegraded":"2024-04-26T07:51:40.396590+0000","last_fullsized":"2024-04-26T07:51:40.396590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388406+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:51:40.388406+0000","last_peered":"2024-04-26T07:51:40.388406+0000","last_clean":"2024-04-26T07:51:40.388406+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:51:40.388406+0000","last_undegraded":"2024-04-26T07:51:40.388406+0000","last_fullsized":"2024-04-26T07:51:40.388406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390097+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:40.390097+0000","last_peered":"2024-04-26T07:51:40.390097+0000","last_clean":"2024-04-26T07:51:40.390097+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:40.390097+0000","last_undegraded":"2024-04-26T07:51:40.390097+0000","last_fullsized":"2024-04-26T07:51:40.390097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396856+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:40.396856+0000","last_peered":"2024-04-26T07:51:40.396856+0000","last_clean":"2024-04-26T07:51:40.396856+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:40.396856+0000","last_undegraded":"2024-04-26T07:51:40.396856+0000","last_fullsized":"2024-04-26T07:51:40.396856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'25","reported_seq":217,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409628+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:51:40.409628+0000","last_peered":"2024-04-26T07:51:40.409628+0000","last_clean":"2024-04-26T07:51:40.409628+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:51:40.409628+0000","last_undegraded":"2024-04-26T07:51:40.409628+0000","last_fullsized":"2024-04-26T07:51:40.409628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409449+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:51:40.409449+0000","last_peered":"2024-04-26T07:51:40.409449+0000","last_clean":"2024-04-26T07:51:40.409449+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:51:40.409449+0000","last_undegraded":"2024-04-26T07:51:40.409449+0000","last_fullsized":"2024-04-26T07:51:40.409449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"90'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399211+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:51:40.399211+0000","last_peered":"2024-04-26T07:51:40.399211+0000","last_clean":"2024-04-26T07:51:40.399211+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:51:40.399211+0000","last_undegraded":"2024-04-26T07:51:40.399211+0000","last_fullsized":"2024-04-26T07:51:40.399211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"109'135","reported_seq":367,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804709+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:51:45.804709+0000","last_peered":"2024-04-26T07:51:45.804709+0000","last_clean":"2024-04-26T07:51:45.804709+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:51:45.804709+0000","last_undegraded":"2024-04-26T07:51:45.804709+0000","last_fullsized":"2024-04-26T07:51:45.804709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409050+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:40.409050+0000","last_peered":"2024-04-26T07:51:40.409050+0000","last_clean":"2024-04-26T07:51:40.409050+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:40.409050+0000","last_undegraded":"2024-04-26T07:51:40.409050+0000","last_fullsized":"2024-04-26T07:51:40.409050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398129+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:51:40.398129+0000","last_peered":"2024-04-26T07:51:40.398129+0000","last_clean":"2024-04-26T07:51:40.398129+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:51:40.398129+0000","last_undegraded":"2024-04-26T07:51:40.398129+0000","last_fullsized":"2024-04-26T07:51:40.398129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"89'30","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396862+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:40.396862+0000","last_peered":"2024-04-26T07:51:40.396862+0000","last_clean":"2024-04-26T07:51:40.396862+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:40.396862+0000","last_undegraded":"2024-04-26T07:51:40.396862+0000","last_fullsized":"2024-04-26T07:51:40.396862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":363,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416681+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:51:40.416681+0000","last_peered":"2024-04-26T07:51:40.416681+0000","last_clean":"2024-04-26T07:51:40.416681+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:51:40.416681+0000","last_undegraded":"2024-04-26T07:51:40.416681+0000","last_fullsized":"2024-04-26T07:51:40.416681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393097+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:51:40.393097+0000","last_peered":"2024-04-26T07:51:40.393097+0000","last_clean":"2024-04-26T07:51:40.393097+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:51:40.393097+0000","last_undegraded":"2024-04-26T07:51:40.393097+0000","last_fullsized":"2024-04-26T07:51:40.393097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"109'135","reported_seq":402,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807119+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:45.807119+0000","last_peered":"2024-04-26T07:51:45.807119+0000","last_clean":"2024-04-26T07:51:45.807119+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:45.807119+0000","last_undegraded":"2024-04-26T07:51:45.807119+0000","last_fullsized":"2024-04-26T07:51:45.807119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400533+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:40.400533+0000","last_peered":"2024-04-26T07:51:40.400533+0000","last_clean":"2024-04-26T07:51:40.400533+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:40.400533+0000","last_undegraded":"2024-04-26T07:51:40.400533+0000","last_fullsized":"2024-04-26T07:51:40.400533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":165,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394484+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:40.394484+0000","last_peered":"2024-04-26T07:51:40.394484+0000","last_clean":"2024-04-26T07:51:40.394484+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:40.394484+0000","last_undegraded":"2024-04-26T07:51:40.394484+0000","last_fullsized":"2024-04-26T07:51:40.394484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390895+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:40.390895+0000","last_peered":"2024-04-26T07:51:40.390895+0000","last_clean":"2024-04-26T07:51:40.390895+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:40.390895+0000","last_undegraded":"2024-04-26T07:51:40.390895+0000","last_fullsized":"2024-04-26T07:51:40.390895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397629+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:51:40.397629+0000","last_peered":"2024-04-26T07:51:40.397629+0000","last_clean":"2024-04-26T07:51:40.397629+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:51:40.397629+0000","last_undegraded":"2024-04-26T07:51:40.397629+0000","last_fullsized":"2024-04-26T07:51:40.397629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"90'26","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414130+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:51:40.414130+0000","last_peered":"2024-04-26T07:51:40.414130+0000","last_clean":"2024-04-26T07:51:40.414130+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:51:40.414130+0000","last_undegraded":"2024-04-26T07:51:40.414130+0000","last_fullsized":"2024-04-26T07:51:40.414130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409728+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:40.409728+0000","last_peered":"2024-04-26T07:51:40.409728+0000","last_clean":"2024-04-26T07:51:40.409728+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:40.409728+0000","last_undegraded":"2024-04-26T07:51:40.409728+0000","last_fullsized":"2024-04-26T07:51:40.409728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409337+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:40.409337+0000","last_peered":"2024-04-26T07:51:40.409337+0000","last_clean":"2024-04-26T07:51:40.409337+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:40.409337+0000","last_undegraded":"2024-04-26T07:51:40.409337+0000","last_fullsized":"2024-04-26T07:51:40.409337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412130+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:51:40.412130+0000","last_peered":"2024-04-26T07:51:40.412130+0000","last_clean":"2024-04-26T07:51:40.412130+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:51:40.412130+0000","last_undegraded":"2024-04-26T07:51:40.412130+0000","last_fullsized":"2024-04-26T07:51:40.412130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435552+0000","last_change":"2024-04-26T07:51:40.435552+0000","last_active":"2024-04-26T07:51:40.435552+0000","last_peered":"2024-04-26T07:51:40.435552+0000","last_clean":"2024-04-26T07:51:40.435552+0000","last_became_active":"2024-04-26T07:51:40.429475+0000","last_became_peered":"2024-04-26T07:51:40.429475+0000","last_unstale":"2024-04-26T07:51:40.435552+0000","last_undegraded":"2024-04-26T07:51:40.435552+0000","last_fullsized":"2024-04-26T07:51:40.435552+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:19.379343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414577+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:40.414577+0000","last_peered":"2024-04-26T07:51:40.414577+0000","last_clean":"2024-04-26T07:51:40.414577+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:40.414577+0000","last_undegraded":"2024-04-26T07:51:40.414577+0000","last_fullsized":"2024-04-26T07:51:40.414577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391655+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:40.391655+0000","last_peered":"2024-04-26T07:51:40.391655+0000","last_clean":"2024-04-26T07:51:40.391655+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:40.391655+0000","last_undegraded":"2024-04-26T07:51:40.391655+0000","last_fullsized":"2024-04-26T07:51:40.391655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429427+0000","last_change":"2024-04-26T07:51:40.429427+0000","last_active":"2024-04-26T07:51:40.429427+0000","last_peered":"2024-04-26T07:51:40.429427+0000","last_clean":"2024-04-26T07:51:40.429427+0000","last_became_active":"2024-04-26T07:51:40.428641+0000","last_became_peered":"2024-04-26T07:51:40.428641+0000","last_unstale":"2024-04-26T07:51:40.429427+0000","last_undegraded":"2024-04-26T07:51:40.429427+0000","last_fullsized":"2024-04-26T07:51:40.429427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:31.406741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"90'39","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416828+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:51:40.416828+0000","last_peered":"2024-04-26T07:51:40.416828+0000","last_clean":"2024-04-26T07:51:40.416828+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:51:40.416828+0000","last_undegraded":"2024-04-26T07:51:40.416828+0000","last_fullsized":"2024-04-26T07:51:40.416828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388551+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:51:40.388551+0000","last_peered":"2024-04-26T07:51:40.388551+0000","last_clean":"2024-04-26T07:51:40.388551+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:51:40.388551+0000","last_undegraded":"2024-04-26T07:51:40.388551+0000","last_fullsized":"2024-04-26T07:51:40.388551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407507+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:40.407507+0000","last_peered":"2024-04-26T07:51:40.407507+0000","last_clean":"2024-04-26T07:51:40.407507+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:40.407507+0000","last_undegraded":"2024-04-26T07:51:40.407507+0000","last_fullsized":"2024-04-26T07:51:40.407507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388819+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:51:40.388819+0000","last_peered":"2024-04-26T07:51:40.388819+0000","last_clean":"2024-04-26T07:51:40.388819+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:51:40.388819+0000","last_undegraded":"2024-04-26T07:51:40.388819+0000","last_fullsized":"2024-04-26T07:51:40.388819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.440837+0000","last_change":"2024-04-26T07:51:40.440837+0000","last_active":"2024-04-26T07:51:40.440837+0000","last_peered":"2024-04-26T07:51:40.440837+0000","last_clean":"2024-04-26T07:51:40.440837+0000","last_became_active":"2024-04-26T07:51:40.437582+0000","last_became_peered":"2024-04-26T07:51:40.437582+0000","last_unstale":"2024-04-26T07:51:40.440837+0000","last_undegraded":"2024-04-26T07:51:40.440837+0000","last_fullsized":"2024-04-26T07:51:40.440837+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.908604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"89'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387392+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:40.387392+0000","last_peered":"2024-04-26T07:51:40.387392+0000","last_clean":"2024-04-26T07:51:40.387392+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:40.387392+0000","last_undegraded":"2024-04-26T07:51:40.387392+0000","last_fullsized":"2024-04-26T07:51:40.387392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417014+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:40.417014+0000","last_peered":"2024-04-26T07:51:40.417014+0000","last_clean":"2024-04-26T07:51:40.417014+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:40.417014+0000","last_undegraded":"2024-04-26T07:51:40.417014+0000","last_fullsized":"2024-04-26T07:51:40.417014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"109'138","reported_seq":420,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804711+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:51:45.804711+0000","last_peered":"2024-04-26T07:51:45.804711+0000","last_clean":"2024-04-26T07:51:45.804711+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:51:45.804711+0000","last_undegraded":"2024-04-26T07:51:45.804711+0000","last_fullsized":"2024-04-26T07:51:45.804711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444144+0000","last_change":"2024-04-26T07:51:40.444144+0000","last_active":"2024-04-26T07:51:40.444144+0000","last_peered":"2024-04-26T07:51:40.444144+0000","last_clean":"2024-04-26T07:51:40.444144+0000","last_became_active":"2024-04-26T07:51:40.439356+0000","last_became_peered":"2024-04-26T07:51:40.439356+0000","last_unstale":"2024-04-26T07:51:40.444144+0000","last_undegraded":"2024-04-26T07:51:40.444144+0000","last_fullsized":"2024-04-26T07:51:40.444144+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:37.987341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408252+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:40.408252+0000","last_peered":"2024-04-26T07:51:40.408252+0000","last_clean":"2024-04-26T07:51:40.408252+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:40.408252+0000","last_undegraded":"2024-04-26T07:51:40.408252+0000","last_fullsized":"2024-04-26T07:51:40.408252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410446+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:51:40.410446+0000","last_peered":"2024-04-26T07:51:40.410446+0000","last_clean":"2024-04-26T07:51:40.410446+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:51:40.410446+0000","last_undegraded":"2024-04-26T07:51:40.410446+0000","last_fullsized":"2024-04-26T07:51:40.410446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399025+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:51:40.399025+0000","last_peered":"2024-04-26T07:51:40.399025+0000","last_clean":"2024-04-26T07:51:40.399025+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:51:40.399025+0000","last_undegraded":"2024-04-26T07:51:40.399025+0000","last_fullsized":"2024-04-26T07:51:40.399025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'26","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408371+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:40.408371+0000","last_peered":"2024-04-26T07:51:40.408371+0000","last_clean":"2024-04-26T07:51:40.408371+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:40.408371+0000","last_undegraded":"2024-04-26T07:51:40.408371+0000","last_fullsized":"2024-04-26T07:51:40.408371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399455+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:51:40.399455+0000","last_peered":"2024-04-26T07:51:40.399455+0000","last_clean":"2024-04-26T07:51:40.399455+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:51:40.399455+0000","last_undegraded":"2024-04-26T07:51:40.399455+0000","last_fullsized":"2024-04-26T07:51:40.399455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"109'18","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807316+0000","last_change":"2024-04-26T07:51:40.448691+0000","last_active":"2024-04-26T07:51:45.807316+0000","last_peered":"2024-04-26T07:51:45.807316+0000","last_clean":"2024-04-26T07:51:45.807316+0000","last_became_active":"2024-04-26T07:51:40.445444+0000","last_became_peered":"2024-04-26T07:51:40.445444+0000","last_unstale":"2024-04-26T07:51:45.807316+0000","last_undegraded":"2024-04-26T07:51:45.807316+0000","last_fullsized":"2024-04-26T07:51:45.807316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:23.750359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387011+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:51:40.387011+0000","last_peered":"2024-04-26T07:51:40.387011+0000","last_clean":"2024-04-26T07:51:40.387011+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:51:40.387011+0000","last_undegraded":"2024-04-26T07:51:40.387011+0000","last_fullsized":"2024-04-26T07:51:40.387011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392361+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:40.392361+0000","last_peered":"2024-04-26T07:51:40.392361+0000","last_clean":"2024-04-26T07:51:40.392361+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:40.392361+0000","last_undegraded":"2024-04-26T07:51:40.392361+0000","last_fullsized":"2024-04-26T07:51:40.392361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409549+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:51:40.409549+0000","last_peered":"2024-04-26T07:51:40.409549+0000","last_clean":"2024-04-26T07:51:40.409549+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:51:40.409549+0000","last_undegraded":"2024-04-26T07:51:40.409549+0000","last_fullsized":"2024-04-26T07:51:40.409549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414326+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:40.414326+0000","last_peered":"2024-04-26T07:51:40.414326+0000","last_clean":"2024-04-26T07:51:40.414326+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:40.414326+0000","last_undegraded":"2024-04-26T07:51:40.414326+0000","last_fullsized":"2024-04-26T07:51:40.414326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'20","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397271+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:40.397271+0000","last_peered":"2024-04-26T07:51:40.397271+0000","last_clean":"2024-04-26T07:51:40.397271+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:40.397271+0000","last_undegraded":"2024-04-26T07:51:40.397271+0000","last_fullsized":"2024-04-26T07:51:40.397271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387118+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:51:40.387118+0000","last_peered":"2024-04-26T07:51:40.387118+0000","last_clean":"2024-04-26T07:51:40.387118+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:51:40.387118+0000","last_undegraded":"2024-04-26T07:51:40.387118+0000","last_fullsized":"2024-04-26T07:51:40.387118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393907+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:40.393907+0000","last_peered":"2024-04-26T07:51:40.393907+0000","last_clean":"2024-04-26T07:51:40.393907+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:40.393907+0000","last_undegraded":"2024-04-26T07:51:40.393907+0000","last_fullsized":"2024-04-26T07:51:40.393907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412184+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:40.412184+0000","last_peered":"2024-04-26T07:51:40.412184+0000","last_clean":"2024-04-26T07:51:40.412184+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:40.412184+0000","last_undegraded":"2024-04-26T07:51:40.412184+0000","last_fullsized":"2024-04-26T07:51:40.412184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409446+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:40.409446+0000","last_peered":"2024-04-26T07:51:40.409446+0000","last_clean":"2024-04-26T07:51:40.409446+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:40.409446+0000","last_undegraded":"2024-04-26T07:51:40.409446+0000","last_fullsized":"2024-04-26T07:51:40.409446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408654+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:51:40.408654+0000","last_peered":"2024-04-26T07:51:40.408654+0000","last_clean":"2024-04-26T07:51:40.408654+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:51:40.408654+0000","last_undegraded":"2024-04-26T07:51:40.408654+0000","last_fullsized":"2024-04-26T07:51:40.408654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"88'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415304+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:40.415304+0000","last_peered":"2024-04-26T07:51:40.415304+0000","last_clean":"2024-04-26T07:51:40.415304+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:40.415304+0000","last_undegraded":"2024-04-26T07:51:40.415304+0000","last_fullsized":"2024-04-26T07:51:40.415304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409916+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:51:40.409916+0000","last_peered":"2024-04-26T07:51:40.409916+0000","last_clean":"2024-04-26T07:51:40.409916+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:51:40.409916+0000","last_undegraded":"2024-04-26T07:51:40.409916+0000","last_fullsized":"2024-04-26T07:51:40.409916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387667+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:51:40.387667+0000","last_peered":"2024-04-26T07:51:40.387667+0000","last_clean":"2024-04-26T07:51:40.387667+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:51:40.387667+0000","last_undegraded":"2024-04-26T07:51:40.387667+0000","last_fullsized":"2024-04-26T07:51:40.387667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"90'35","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386306+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:51:40.386306+0000","last_peered":"2024-04-26T07:51:40.386306+0000","last_clean":"2024-04-26T07:51:40.386306+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:51:40.386306+0000","last_undegraded":"2024-04-26T07:51:40.386306+0000","last_fullsized":"2024-04-26T07:51:40.386306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394908+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:40.394908+0000","last_peered":"2024-04-26T07:51:40.394908+0000","last_clean":"2024-04-26T07:51:40.394908+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:40.394908+0000","last_undegraded":"2024-04-26T07:51:40.394908+0000","last_fullsized":"2024-04-26T07:51:40.394908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387516+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:40.387516+0000","last_peered":"2024-04-26T07:51:40.387516+0000","last_clean":"2024-04-26T07:51:40.387516+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:40.387516+0000","last_undegraded":"2024-04-26T07:51:40.387516+0000","last_fullsized":"2024-04-26T07:51:40.387516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388105+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:51:40.388105+0000","last_peered":"2024-04-26T07:51:40.388105+0000","last_clean":"2024-04-26T07:51:40.388105+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:51:40.388105+0000","last_undegraded":"2024-04-26T07:51:40.388105+0000","last_fullsized":"2024-04-26T07:51:40.388105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409722+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:51:40.409722+0000","last_peered":"2024-04-26T07:51:40.409722+0000","last_clean":"2024-04-26T07:51:40.409722+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:51:40.409722+0000","last_undegraded":"2024-04-26T07:51:40.409722+0000","last_fullsized":"2024-04-26T07:51:40.409722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441852+0000","last_change":"2024-04-26T07:51:40.441852+0000","last_active":"2024-04-26T07:51:40.441852+0000","last_peered":"2024-04-26T07:51:40.441852+0000","last_clean":"2024-04-26T07:51:40.441852+0000","last_became_active":"2024-04-26T07:51:40.433293+0000","last_became_peered":"2024-04-26T07:51:40.433293+0000","last_unstale":"2024-04-26T07:51:40.441852+0000","last_undegraded":"2024-04-26T07:51:40.441852+0000","last_fullsized":"2024-04-26T07:51:40.441852+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:25.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408513+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:51:40.408513+0000","last_peered":"2024-04-26T07:51:40.408513+0000","last_clean":"2024-04-26T07:51:40.408513+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:51:40.408513+0000","last_undegraded":"2024-04-26T07:51:40.408513+0000","last_fullsized":"2024-04-26T07:51:40.408513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408684+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:40.408684+0000","last_peered":"2024-04-26T07:51:40.408684+0000","last_clean":"2024-04-26T07:51:40.408684+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:40.408684+0000","last_undegraded":"2024-04-26T07:51:40.408684+0000","last_fullsized":"2024-04-26T07:51:40.408684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"109'135","reported_seq":380,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807170+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:51:45.807170+0000","last_peered":"2024-04-26T07:51:45.807170+0000","last_clean":"2024-04-26T07:51:45.807170+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:51:45.807170+0000","last_undegraded":"2024-04-26T07:51:45.807170+0000","last_fullsized":"2024-04-26T07:51:45.807170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394363+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:40.394363+0000","last_peered":"2024-04-26T07:51:40.394363+0000","last_clean":"2024-04-26T07:51:40.394363+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:40.394363+0000","last_undegraded":"2024-04-26T07:51:40.394363+0000","last_fullsized":"2024-04-26T07:51:40.394363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390662+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:51:40.390662+0000","last_peered":"2024-04-26T07:51:40.390662+0000","last_clean":"2024-04-26T07:51:40.390662+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:51:40.390662+0000","last_undegraded":"2024-04-26T07:51:40.390662+0000","last_fullsized":"2024-04-26T07:51:40.390662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'19","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393883+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:40.393883+0000","last_peered":"2024-04-26T07:51:40.393883+0000","last_clean":"2024-04-26T07:51:40.393883+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:40.393883+0000","last_undegraded":"2024-04-26T07:51:40.393883+0000","last_fullsized":"2024-04-26T07:51:40.393883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410909+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:51:40.410909+0000","last_peered":"2024-04-26T07:51:40.410909+0000","last_clean":"2024-04-26T07:51:40.410909+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:51:40.410909+0000","last_undegraded":"2024-04-26T07:51:40.410909+0000","last_fullsized":"2024-04-26T07:51:40.410909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395337+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:40.395337+0000","last_peered":"2024-04-26T07:51:40.395337+0000","last_clean":"2024-04-26T07:51:40.395337+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:40.395337+0000","last_undegraded":"2024-04-26T07:51:40.395337+0000","last_fullsized":"2024-04-26T07:51:40.395337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400935+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:51:40.400935+0000","last_peered":"2024-04-26T07:51:40.400935+0000","last_clean":"2024-04-26T07:51:40.400935+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:51:40.400935+0000","last_undegraded":"2024-04-26T07:51:40.400935+0000","last_fullsized":"2024-04-26T07:51:40.400935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"109'135","reported_seq":352,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804722+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:51:45.804722+0000","last_peered":"2024-04-26T07:51:45.804722+0000","last_clean":"2024-04-26T07:51:45.804722+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:51:45.804722+0000","last_undegraded":"2024-04-26T07:51:45.804722+0000","last_fullsized":"2024-04-26T07:51:45.804722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387074+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:40.387074+0000","last_peered":"2024-04-26T07:51:40.387074+0000","last_clean":"2024-04-26T07:51:40.387074+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:40.387074+0000","last_undegraded":"2024-04-26T07:51:40.387074+0000","last_fullsized":"2024-04-26T07:51:40.387074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395762+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:40.395762+0000","last_peered":"2024-04-26T07:51:40.395762+0000","last_clean":"2024-04-26T07:51:40.395762+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:40.395762+0000","last_undegraded":"2024-04-26T07:51:40.395762+0000","last_fullsized":"2024-04-26T07:51:40.395762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.389005+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:40.389005+0000","last_peered":"2024-04-26T07:51:40.389005+0000","last_clean":"2024-04-26T07:51:40.389005+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:40.389005+0000","last_undegraded":"2024-04-26T07:51:40.389005+0000","last_fullsized":"2024-04-26T07:51:40.389005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412692+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:51:40.412692+0000","last_peered":"2024-04-26T07:51:40.412692+0000","last_clean":"2024-04-26T07:51:40.412692+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:51:40.412692+0000","last_undegraded":"2024-04-26T07:51:40.412692+0000","last_fullsized":"2024-04-26T07:51:40.412692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":275,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390337+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:40.390337+0000","last_peered":"2024-04-26T07:51:40.390337+0000","last_clean":"2024-04-26T07:51:40.390337+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:40.390337+0000","last_undegraded":"2024-04-26T07:51:40.390337+0000","last_fullsized":"2024-04-26T07:51:40.390337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"90'44","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.419562+0000","last_change":"2024-04-26T07:51:40.419562+0000","last_active":"2024-04-26T07:51:40.419562+0000","last_peered":"2024-04-26T07:51:40.419562+0000","last_clean":"2024-04-26T07:51:40.419562+0000","last_became_active":"2024-04-26T07:51:40.418680+0000","last_became_peered":"2024-04-26T07:51:40.418680+0000","last_unstale":"2024-04-26T07:51:40.419562+0000","last_undegraded":"2024-04-26T07:51:40.419562+0000","last_fullsized":"2024-04-26T07:51:40.419562+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:42.333538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391389+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:51:40.391389+0000","last_peered":"2024-04-26T07:51:40.391389+0000","last_clean":"2024-04-26T07:51:40.391389+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:51:40.391389+0000","last_undegraded":"2024-04-26T07:51:40.391389+0000","last_fullsized":"2024-04-26T07:51:40.391389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413846+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:40.413846+0000","last_peered":"2024-04-26T07:51:40.413846+0000","last_clean":"2024-04-26T07:51:40.413846+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:40.413846+0000","last_undegraded":"2024-04-26T07:51:40.413846+0000","last_fullsized":"2024-04-26T07:51:40.413846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387849+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:40.387849+0000","last_peered":"2024-04-26T07:51:40.387849+0000","last_clean":"2024-04-26T07:51:40.387849+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:40.387849+0000","last_undegraded":"2024-04-26T07:51:40.387849+0000","last_fullsized":"2024-04-26T07:51:40.387849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396489+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:51:40.396489+0000","last_peered":"2024-04-26T07:51:40.396489+0000","last_clean":"2024-04-26T07:51:40.396489+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:51:40.396489+0000","last_undegraded":"2024-04-26T07:51:40.396489+0000","last_fullsized":"2024-04-26T07:51:40.396489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"89'31","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397695+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:40.397695+0000","last_peered":"2024-04-26T07:51:40.397695+0000","last_clean":"2024-04-26T07:51:40.397695+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:40.397695+0000","last_undegraded":"2024-04-26T07:51:40.397695+0000","last_fullsized":"2024-04-26T07:51:40.397695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408744+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:51:40.408744+0000","last_peered":"2024-04-26T07:51:40.408744+0000","last_clean":"2024-04-26T07:51:40.408744+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:51:40.408744+0000","last_undegraded":"2024-04-26T07:51:40.408744+0000","last_fullsized":"2024-04-26T07:51:40.408744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"90'19","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.389984+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:51:40.389984+0000","last_peered":"2024-04-26T07:51:40.389984+0000","last_clean":"2024-04-26T07:51:40.389984+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:51:40.389984+0000","last_undegraded":"2024-04-26T07:51:40.389984+0000","last_fullsized":"2024-04-26T07:51:40.389984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390188+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:51:40.390188+0000","last_peered":"2024-04-26T07:51:40.390188+0000","last_clean":"2024-04-26T07:51:40.390188+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:51:40.390188+0000","last_undegraded":"2024-04-26T07:51:40.390188+0000","last_fullsized":"2024-04-26T07:51:40.390188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393594+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:40.393594+0000","last_peered":"2024-04-26T07:51:40.393594+0000","last_clean":"2024-04-26T07:51:40.393594+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:40.393594+0000","last_undegraded":"2024-04-26T07:51:40.393594+0000","last_fullsized":"2024-04-26T07:51:40.393594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408560+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:51:40.408560+0000","last_peered":"2024-04-26T07:51:40.408560+0000","last_clean":"2024-04-26T07:51:40.408560+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:51:40.408560+0000","last_undegraded":"2024-04-26T07:51:40.408560+0000","last_fullsized":"2024-04-26T07:51:40.408560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'18","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.447435+0000","last_change":"2024-04-26T07:51:40.447435+0000","last_active":"2024-04-26T07:51:40.447435+0000","last_peered":"2024-04-26T07:51:40.447435+0000","last_clean":"2024-04-26T07:51:40.447435+0000","last_became_active":"2024-04-26T07:51:40.444446+0000","last_became_peered":"2024-04-26T07:51:40.444446+0000","last_unstale":"2024-04-26T07:51:40.447435+0000","last_undegraded":"2024-04-26T07:51:40.447435+0000","last_fullsized":"2024-04-26T07:51:40.447435+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:01.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":275,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392275+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:40.392275+0000","last_peered":"2024-04-26T07:51:40.392275+0000","last_clean":"2024-04-26T07:51:40.392275+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:40.392275+0000","last_undegraded":"2024-04-26T07:51:40.392275+0000","last_fullsized":"2024-04-26T07:51:40.392275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"101'10","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386065+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:51:40.386065+0000","last_peered":"2024-04-26T07:51:40.386065+0000","last_clean":"2024-04-26T07:51:40.386065+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:51:40.386065+0000","last_undegraded":"2024-04-26T07:51:40.386065+0000","last_fullsized":"2024-04-26T07:51:40.386065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432738+0000","last_change":"2024-04-26T07:51:40.432738+0000","last_active":"2024-04-26T07:51:40.432738+0000","last_peered":"2024-04-26T07:51:40.432738+0000","last_clean":"2024-04-26T07:51:40.432738+0000","last_became_active":"2024-04-26T07:51:40.431762+0000","last_became_peered":"2024-04-26T07:51:40.431762+0000","last_unstale":"2024-04-26T07:51:40.432738+0000","last_undegraded":"2024-04-26T07:51:40.432738+0000","last_fullsized":"2024-04-26T07:51:40.432738+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:25.659741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386934+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:40.386934+0000","last_peered":"2024-04-26T07:51:40.386934+0000","last_clean":"2024-04-26T07:51:40.386934+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:40.386934+0000","last_undegraded":"2024-04-26T07:51:40.386934+0000","last_fullsized":"2024-04-26T07:51:40.386934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391261+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:51:40.391261+0000","last_peered":"2024-04-26T07:51:40.391261+0000","last_clean":"2024-04-26T07:51:40.391261+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:51:40.391261+0000","last_undegraded":"2024-04-26T07:51:40.391261+0000","last_fullsized":"2024-04-26T07:51:40.391261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416629+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:40.416629+0000","last_peered":"2024-04-26T07:51:40.416629+0000","last_clean":"2024-04-26T07:51:40.416629+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:40.416629+0000","last_undegraded":"2024-04-26T07:51:40.416629+0000","last_fullsized":"2024-04-26T07:51:40.416629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444554+0000","last_change":"2024-04-26T07:51:40.444554+0000","last_active":"2024-04-26T07:51:40.444554+0000","last_peered":"2024-04-26T07:51:40.444554+0000","last_clean":"2024-04-26T07:51:40.444554+0000","last_became_active":"2024-04-26T07:51:40.439845+0000","last_became_peered":"2024-04-26T07:51:40.439845+0000","last_unstale":"2024-04-26T07:51:40.444554+0000","last_undegraded":"2024-04-26T07:51:40.444554+0000","last_fullsized":"2024-04-26T07:51:40.444554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:41.631699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"90'20","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392088+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:51:40.392088+0000","last_peered":"2024-04-26T07:51:40.392088+0000","last_clean":"2024-04-26T07:51:40.392088+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:51:40.392088+0000","last_undegraded":"2024-04-26T07:51:40.392088+0000","last_fullsized":"2024-04-26T07:51:40.392088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409988+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:40.409988+0000","last_peered":"2024-04-26T07:51:40.409988+0000","last_clean":"2024-04-26T07:51:40.409988+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:40.409988+0000","last_undegraded":"2024-04-26T07:51:40.409988+0000","last_fullsized":"2024-04-26T07:51:40.409988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413668+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:40.413668+0000","last_peered":"2024-04-26T07:51:40.413668+0000","last_clean":"2024-04-26T07:51:40.413668+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:40.413668+0000","last_undegraded":"2024-04-26T07:51:40.413668+0000","last_fullsized":"2024-04-26T07:51:40.413668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390764+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:51:40.390764+0000","last_peered":"2024-04-26T07:51:40.390764+0000","last_clean":"2024-04-26T07:51:40.390764+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:51:40.390764+0000","last_undegraded":"2024-04-26T07:51:40.390764+0000","last_fullsized":"2024-04-26T07:51:40.390764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'25","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388325+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:40.388325+0000","last_peered":"2024-04-26T07:51:40.388325+0000","last_clean":"2024-04-26T07:51:40.388325+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:40.388325+0000","last_undegraded":"2024-04-26T07:51:40.388325+0000","last_fullsized":"2024-04-26T07:51:40.388325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409141+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:51:40.409141+0000","last_peered":"2024-04-26T07:51:40.409141+0000","last_clean":"2024-04-26T07:51:40.409141+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:51:40.409141+0000","last_undegraded":"2024-04-26T07:51:40.409141+0000","last_fullsized":"2024-04-26T07:51:40.409141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"90'18","reported_seq":160,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.418821+0000","last_change":"2024-04-26T07:51:40.418821+0000","last_active":"2024-04-26T07:51:40.418821+0000","last_peered":"2024-04-26T07:51:40.418821+0000","last_clean":"2024-04-26T07:51:40.418821+0000","last_became_active":"2024-04-26T07:51:40.417916+0000","last_became_peered":"2024-04-26T07:51:40.417916+0000","last_unstale":"2024-04-26T07:51:40.418821+0000","last_undegraded":"2024-04-26T07:51:40.418821+0000","last_fullsized":"2024-04-26T07:51:40.418821+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:36.135343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387218+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:51:40.387218+0000","last_peered":"2024-04-26T07:51:40.387218+0000","last_clean":"2024-04-26T07:51:40.387218+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:51:40.387218+0000","last_undegraded":"2024-04-26T07:51:40.387218+0000","last_fullsized":"2024-04-26T07:51:40.387218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412561+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:51:40.412561+0000","last_peered":"2024-04-26T07:51:40.412561+0000","last_clean":"2024-04-26T07:51:40.412561+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:51:40.412561+0000","last_undegraded":"2024-04-26T07:51:40.412561+0000","last_fullsized":"2024-04-26T07:51:40.412561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390860+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:40.390860+0000","last_peered":"2024-04-26T07:51:40.390860+0000","last_clean":"2024-04-26T07:51:40.390860+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:40.390860+0000","last_undegraded":"2024-04-26T07:51:40.390860+0000","last_fullsized":"2024-04-26T07:51:40.390860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388623+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:51:40.388623+0000","last_peered":"2024-04-26T07:51:40.388623+0000","last_clean":"2024-04-26T07:51:40.388623+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:51:40.388623+0000","last_undegraded":"2024-04-26T07:51:40.388623+0000","last_fullsized":"2024-04-26T07:51:40.388623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"90'29","reported_seq":220,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409906+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:51:40.409906+0000","last_peered":"2024-04-26T07:51:40.409906+0000","last_clean":"2024-04-26T07:51:40.409906+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:51:40.409906+0000","last_undegraded":"2024-04-26T07:51:40.409906+0000","last_fullsized":"2024-04-26T07:51:40.409906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414293+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:40.414293+0000","last_peered":"2024-04-26T07:51:40.414293+0000","last_clean":"2024-04-26T07:51:40.414293+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:40.414293+0000","last_undegraded":"2024-04-26T07:51:40.414293+0000","last_fullsized":"2024-04-26T07:51:40.414293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391766+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:40.391766+0000","last_peered":"2024-04-26T07:51:40.391766+0000","last_clean":"2024-04-26T07:51:40.391766+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:40.391766+0000","last_undegraded":"2024-04-26T07:51:40.391766+0000","last_fullsized":"2024-04-26T07:51:40.391766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388746+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:51:40.388746+0000","last_peered":"2024-04-26T07:51:40.388746+0000","last_clean":"2024-04-26T07:51:40.388746+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:51:40.388746+0000","last_undegraded":"2024-04-26T07:51:40.388746+0000","last_fullsized":"2024-04-26T07:51:40.388746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'16","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409372+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:51:40.409372+0000","last_peered":"2024-04-26T07:51:40.409372+0000","last_clean":"2024-04-26T07:51:40.409372+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:51:40.409372+0000","last_undegraded":"2024-04-26T07:51:40.409372+0000","last_fullsized":"2024-04-26T07:51:40.409372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412316+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:51:40.412316+0000","last_peered":"2024-04-26T07:51:40.412316+0000","last_clean":"2024-04-26T07:51:40.412316+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:51:40.412316+0000","last_undegraded":"2024-04-26T07:51:40.412316+0000","last_fullsized":"2024-04-26T07:51:40.412316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"90'25","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427441+0000","last_change":"2024-04-26T07:51:40.427441+0000","last_active":"2024-04-26T07:51:40.427441+0000","last_peered":"2024-04-26T07:51:40.427441+0000","last_clean":"2024-04-26T07:51:40.427441+0000","last_became_active":"2024-04-26T07:51:40.424476+0000","last_became_peered":"2024-04-26T07:51:40.424476+0000","last_unstale":"2024-04-26T07:51:40.427441+0000","last_undegraded":"2024-04-26T07:51:40.427441+0000","last_fullsized":"2024-04-26T07:51:40.427441+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:35.964067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410009+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:40.410009+0000","last_peered":"2024-04-26T07:51:40.410009+0000","last_clean":"2024-04-26T07:51:40.410009+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:40.410009+0000","last_undegraded":"2024-04-26T07:51:40.410009+0000","last_fullsized":"2024-04-26T07:51:40.410009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408176+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:40.408176+0000","last_peered":"2024-04-26T07:51:40.408176+0000","last_clean":"2024-04-26T07:51:40.408176+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:40.408176+0000","last_undegraded":"2024-04-26T07:51:40.408176+0000","last_fullsized":"2024-04-26T07:51:40.408176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393585+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:51:40.393585+0000","last_peered":"2024-04-26T07:51:40.393585+0000","last_clean":"2024-04-26T07:51:40.393585+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:51:40.393585+0000","last_undegraded":"2024-04-26T07:51:40.393585+0000","last_fullsized":"2024-04-26T07:51:40.393585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'31","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401530+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:40.401530+0000","last_peered":"2024-04-26T07:51:40.401530+0000","last_clean":"2024-04-26T07:51:40.401530+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:40.401530+0000","last_undegraded":"2024-04-26T07:51:40.401530+0000","last_fullsized":"2024-04-26T07:51:40.401530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399362+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:51:40.399362+0000","last_peered":"2024-04-26T07:51:40.399362+0000","last_clean":"2024-04-26T07:51:40.399362+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:51:40.399362+0000","last_undegraded":"2024-04-26T07:51:40.399362+0000","last_fullsized":"2024-04-26T07:51:40.399362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"90'19","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394701+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:51:40.394701+0000","last_peered":"2024-04-26T07:51:40.394701+0000","last_clean":"2024-04-26T07:51:40.394701+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:51:40.394701+0000","last_undegraded":"2024-04-26T07:51:40.394701+0000","last_fullsized":"2024-04-26T07:51:40.394701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409809+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:40.409809+0000","last_peered":"2024-04-26T07:51:40.409809+0000","last_clean":"2024-04-26T07:51:40.409809+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:40.409809+0000","last_undegraded":"2024-04-26T07:51:40.409809+0000","last_fullsized":"2024-04-26T07:51:40.409809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410392+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:40.410392+0000","last_peered":"2024-04-26T07:51:40.410392+0000","last_clean":"2024-04-26T07:51:40.410392+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:40.410392+0000","last_undegraded":"2024-04-26T07:51:40.410392+0000","last_fullsized":"2024-04-26T07:51:40.410392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399847+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:51:40.399847+0000","last_peered":"2024-04-26T07:51:40.399847+0000","last_clean":"2024-04-26T07:51:40.399847+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:51:40.399847+0000","last_undegraded":"2024-04-26T07:51:40.399847+0000","last_fullsized":"2024-04-26T07:51:40.399847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"88'18","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387314+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:40.387314+0000","last_peered":"2024-04-26T07:51:40.387314+0000","last_clean":"2024-04-26T07:51:40.387314+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:40.387314+0000","last_undegraded":"2024-04-26T07:51:40.387314+0000","last_fullsized":"2024-04-26T07:51:40.387314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410199+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:51:40.410199+0000","last_peered":"2024-04-26T07:51:40.410199+0000","last_clean":"2024-04-26T07:51:40.410199+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:51:40.410199+0000","last_undegraded":"2024-04-26T07:51:40.410199+0000","last_fullsized":"2024-04-26T07:51:40.410199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396852+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:51:40.396852+0000","last_peered":"2024-04-26T07:51:40.396852+0000","last_clean":"2024-04-26T07:51:40.396852+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:51:40.396852+0000","last_undegraded":"2024-04-26T07:51:40.396852+0000","last_fullsized":"2024-04-26T07:51:40.396852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"109'135","reported_seq":429,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807087+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:51:45.807087+0000","last_peered":"2024-04-26T07:51:45.807087+0000","last_clean":"2024-04-26T07:51:45.807087+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:51:45.807087+0000","last_undegraded":"2024-04-26T07:51:45.807087+0000","last_fullsized":"2024-04-26T07:51:45.807087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":136,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437366+0000","last_change":"2024-04-26T07:51:40.437366+0000","last_active":"2024-04-26T07:51:40.437366+0000","last_peered":"2024-04-26T07:51:40.437366+0000","last_clean":"2024-04-26T07:51:40.437366+0000","last_became_active":"2024-04-26T07:51:40.436379+0000","last_became_peered":"2024-04-26T07:51:40.436379+0000","last_unstale":"2024-04-26T07:51:40.437366+0000","last_undegraded":"2024-04-26T07:51:40.437366+0000","last_fullsized":"2024-04-26T07:51:40.437366+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:48:37.824192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396217+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:40.396217+0000","last_peered":"2024-04-26T07:51:40.396217+0000","last_clean":"2024-04-26T07:51:40.396217+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:40.396217+0000","last_undegraded":"2024-04-26T07:51:40.396217+0000","last_fullsized":"2024-04-26T07:51:40.396217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"89'14","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399466+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:40.399466+0000","last_peered":"2024-04-26T07:51:40.399466+0000","last_clean":"2024-04-26T07:51:40.399466+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:40.399466+0000","last_undegraded":"2024-04-26T07:51:40.399466+0000","last_fullsized":"2024-04-26T07:51:40.399466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:16.352834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428700+0000","last_change":"2024-04-26T07:51:40.428700+0000","last_active":"2024-04-26T07:51:40.428700+0000","last_peered":"2024-04-26T07:51:40.428700+0000","last_clean":"2024-04-26T07:51:40.428700+0000","last_became_active":"2024-04-26T07:51:40.427906+0000","last_became_peered":"2024-04-26T07:51:40.427906+0000","last_unstale":"2024-04-26T07:51:40.428700+0000","last_undegraded":"2024-04-26T07:51:40.428700+0000","last_fullsized":"2024-04-26T07:51:40.428700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:31.624570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"90'23","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410799+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:51:40.410799+0000","last_peered":"2024-04-26T07:51:40.410799+0000","last_clean":"2024-04-26T07:51:40.410799+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:51:40.410799+0000","last_undegraded":"2024-04-26T07:51:40.410799+0000","last_fullsized":"2024-04-26T07:51:40.410799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385502+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:51:40.385502+0000","last_peered":"2024-04-26T07:51:40.385502+0000","last_clean":"2024-04-26T07:51:40.385502+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:51:40.385502+0000","last_undegraded":"2024-04-26T07:51:40.385502+0000","last_fullsized":"2024-04-26T07:51:40.385502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433368+0000","last_change":"2024-04-26T07:51:40.433368+0000","last_active":"2024-04-26T07:51:40.433368+0000","last_peered":"2024-04-26T07:51:40.433368+0000","last_clean":"2024-04-26T07:51:40.433368+0000","last_became_active":"2024-04-26T07:51:40.432230+0000","last_became_peered":"2024-04-26T07:51:40.432230+0000","last_unstale":"2024-04-26T07:51:40.433368+0000","last_undegraded":"2024-04-26T07:51:40.433368+0000","last_fullsized":"2024-04-26T07:51:40.433368+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:04.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401063+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:51:40.401063+0000","last_peered":"2024-04-26T07:51:40.401063+0000","last_clean":"2024-04-26T07:51:40.401063+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:51:40.401063+0000","last_undegraded":"2024-04-26T07:51:40.401063+0000","last_fullsized":"2024-04-26T07:51:40.401063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"90'28","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415147+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:51:40.415147+0000","last_peered":"2024-04-26T07:51:40.415147+0000","last_clean":"2024-04-26T07:51:40.415147+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:51:40.415147+0000","last_undegraded":"2024-04-26T07:51:40.415147+0000","last_fullsized":"2024-04-26T07:51:40.415147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413866+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:51:40.413866+0000","last_peered":"2024-04-26T07:51:40.413866+0000","last_clean":"2024-04-26T07:51:40.413866+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:51:40.413866+0000","last_undegraded":"2024-04-26T07:51:40.413866+0000","last_fullsized":"2024-04-26T07:51:40.413866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"90'18","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385678+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:40.385678+0000","last_peered":"2024-04-26T07:51:40.385678+0000","last_clean":"2024-04-26T07:51:40.385678+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:40.385678+0000","last_undegraded":"2024-04-26T07:51:40.385678+0000","last_fullsized":"2024-04-26T07:51:40.385678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408447+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:40.408447+0000","last_peered":"2024-04-26T07:51:40.408447+0000","last_clean":"2024-04-26T07:51:40.408447+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:40.408447+0000","last_undegraded":"2024-04-26T07:51:40.408447+0000","last_fullsized":"2024-04-26T07:51:40.408447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393764+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:40.393764+0000","last_peered":"2024-04-26T07:51:40.393764+0000","last_clean":"2024-04-26T07:51:40.393764+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:40.393764+0000","last_undegraded":"2024-04-26T07:51:40.393764+0000","last_fullsized":"2024-04-26T07:51:40.393764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391427+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:40.391427+0000","last_peered":"2024-04-26T07:51:40.391427+0000","last_clean":"2024-04-26T07:51:40.391427+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:40.391427+0000","last_undegraded":"2024-04-26T07:51:40.391427+0000","last_fullsized":"2024-04-26T07:51:40.391427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'27","reported_seq":163,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399353+0000","last_change":"2024-04-26T07:49:08.971107+0000","last_active":"2024-04-26T07:51:40.399353+0000","last_peered":"2024-04-26T07:51:40.399353+0000","last_clean":"2024-04-26T07:51:40.399353+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:51:40.399353+0000","last_undegraded":"2024-04-26T07:51:40.399353+0000","last_fullsized":"2024-04-26T07:51:40.399353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:06.980641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394746+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:40.394746+0000","last_peered":"2024-04-26T07:51:40.394746+0000","last_clean":"2024-04-26T07:51:40.394746+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:40.394746+0000","last_undegraded":"2024-04-26T07:51:40.394746+0000","last_fullsized":"2024-04-26T07:51:40.394746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"90'13","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392754+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:51:40.392754+0000","last_peered":"2024-04-26T07:51:40.392754+0000","last_clean":"2024-04-26T07:51:40.392754+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:51:40.392754+0000","last_undegraded":"2024-04-26T07:51:40.392754+0000","last_fullsized":"2024-04-26T07:51:40.392754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395141+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:40.395141+0000","last_peered":"2024-04-26T07:51:40.395141+0000","last_clean":"2024-04-26T07:51:40.395141+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:40.395141+0000","last_undegraded":"2024-04-26T07:51:40.395141+0000","last_fullsized":"2024-04-26T07:51:40.395141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":128,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.446873+0000","last_change":"2024-04-26T07:51:40.446873+0000","last_active":"2024-04-26T07:51:40.446873+0000","last_peered":"2024-04-26T07:51:40.446873+0000","last_clean":"2024-04-26T07:51:40.446873+0000","last_became_active":"2024-04-26T07:51:40.440377+0000","last_became_peered":"2024-04-26T07:51:40.440377+0000","last_unstale":"2024-04-26T07:51:40.446873+0000","last_undegraded":"2024-04-26T07:51:40.446873+0000","last_fullsized":"2024-04-26T07:51:40.446873+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:01.888159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395378+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:40.395378+0000","last_peered":"2024-04-26T07:51:40.395378+0000","last_clean":"2024-04-26T07:51:40.395378+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:40.395378+0000","last_undegraded":"2024-04-26T07:51:40.395378+0000","last_fullsized":"2024-04-26T07:51:40.395378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'25","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388214+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:40.388214+0000","last_peered":"2024-04-26T07:51:40.388214+0000","last_clean":"2024-04-26T07:51:40.388214+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:40.388214+0000","last_undegraded":"2024-04-26T07:51:40.388214+0000","last_fullsized":"2024-04-26T07:51:40.388214+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:34.437375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408789+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:51:40.408789+0000","last_peered":"2024-04-26T07:51:40.408789+0000","last_clean":"2024-04-26T07:51:40.408789+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:51:40.408789+0000","last_undegraded":"2024-04-26T07:51:40.408789+0000","last_fullsized":"2024-04-26T07:51:40.408789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"90'17","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400133+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:51:40.400133+0000","last_peered":"2024-04-26T07:51:40.400133+0000","last_clean":"2024-04-26T07:51:40.400133+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:51:40.400133+0000","last_undegraded":"2024-04-26T07:51:40.400133+0000","last_fullsized":"2024-04-26T07:51:40.400133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387124+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:51:40.387124+0000","last_peered":"2024-04-26T07:51:40.387124+0000","last_clean":"2024-04-26T07:51:40.387124+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:40.387124+0000","last_undegraded":"2024-04-26T07:51:40.387124+0000","last_fullsized":"2024-04-26T07:51:40.387124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399528+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:40.399528+0000","last_peered":"2024-04-26T07:51:40.399528+0000","last_clean":"2024-04-26T07:51:40.399528+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:40.399528+0000","last_undegraded":"2024-04-26T07:51:40.399528+0000","last_fullsized":"2024-04-26T07:51:40.399528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410351+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:51:40.410351+0000","last_peered":"2024-04-26T07:51:40.410351+0000","last_clean":"2024-04-26T07:51:40.410351+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:51:40.410351+0000","last_undegraded":"2024-04-26T07:51:40.410351+0000","last_fullsized":"2024-04-26T07:51:40.410351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408072+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:51:40.408072+0000","last_peered":"2024-04-26T07:51:40.408072+0000","last_clean":"2024-04-26T07:51:40.408072+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:51:40.408072+0000","last_undegraded":"2024-04-26T07:51:40.408072+0000","last_fullsized":"2024-04-26T07:51:40.408072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410664+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:51:40.410664+0000","last_peered":"2024-04-26T07:51:40.410664+0000","last_clean":"2024-04-26T07:51:40.410664+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:51:40.410664+0000","last_undegraded":"2024-04-26T07:51:40.410664+0000","last_fullsized":"2024-04-26T07:51:40.410664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'26","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398857+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:51:40.398857+0000","last_peered":"2024-04-26T07:51:40.398857+0000","last_clean":"2024-04-26T07:51:40.398857+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:51:40.398857+0000","last_undegraded":"2024-04-26T07:51:40.398857+0000","last_fullsized":"2024-04-26T07:51:40.398857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414531+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:51:40.414531+0000","last_peered":"2024-04-26T07:51:40.414531+0000","last_clean":"2024-04-26T07:51:40.414531+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:51:40.414531+0000","last_undegraded":"2024-04-26T07:51:40.414531+0000","last_fullsized":"2024-04-26T07:51:40.414531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"89'18","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414182+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:40.414182+0000","last_peered":"2024-04-26T07:51:40.414182+0000","last_clean":"2024-04-26T07:51:40.414182+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:40.414182+0000","last_undegraded":"2024-04-26T07:51:40.414182+0000","last_fullsized":"2024-04-26T07:51:40.414182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409820+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:51:40.409820+0000","last_peered":"2024-04-26T07:51:40.409820+0000","last_clean":"2024-04-26T07:51:40.409820+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:51:40.409820+0000","last_undegraded":"2024-04-26T07:51:40.409820+0000","last_fullsized":"2024-04-26T07:51:40.409820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'23","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387539+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:40.387539+0000","last_peered":"2024-04-26T07:51:40.387539+0000","last_clean":"2024-04-26T07:51:40.387539+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:40.387539+0000","last_undegraded":"2024-04-26T07:51:40.387539+0000","last_fullsized":"2024-04-26T07:51:40.387539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392517+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:51:40.392517+0000","last_peered":"2024-04-26T07:51:40.392517+0000","last_clean":"2024-04-26T07:51:40.392517+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:51:40.392517+0000","last_undegraded":"2024-04-26T07:51:40.392517+0000","last_fullsized":"2024-04-26T07:51:40.392517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'32","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393638+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:40.393638+0000","last_peered":"2024-04-26T07:51:40.393638+0000","last_clean":"2024-04-26T07:51:40.393638+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:40.393638+0000","last_undegraded":"2024-04-26T07:51:40.393638+0000","last_fullsized":"2024-04-26T07:51:40.393638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401267+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:51:40.401267+0000","last_peered":"2024-04-26T07:51:40.401267+0000","last_clean":"2024-04-26T07:51:40.401267+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:51:40.401267+0000","last_undegraded":"2024-04-26T07:51:40.401267+0000","last_fullsized":"2024-04-26T07:51:40.401267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"89'35","reported_seq":227,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410520+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:40.410520+0000","last_peered":"2024-04-26T07:51:40.410520+0000","last_clean":"2024-04-26T07:51:40.410520+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:40.410520+0000","last_undegraded":"2024-04-26T07:51:40.410520+0000","last_fullsized":"2024-04-26T07:51:40.410520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391161+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:51:40.391161+0000","last_peered":"2024-04-26T07:51:40.391161+0000","last_clean":"2024-04-26T07:51:40.391161+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:51:40.391161+0000","last_undegraded":"2024-04-26T07:51:40.391161+0000","last_fullsized":"2024-04-26T07:51:40.391161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"89'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412598+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:51:40.412598+0000","last_peered":"2024-04-26T07:51:40.412598+0000","last_clean":"2024-04-26T07:51:40.412598+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:51:40.412598+0000","last_undegraded":"2024-04-26T07:51:40.412598+0000","last_fullsized":"2024-04-26T07:51:40.412598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407803+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:51:40.407803+0000","last_peered":"2024-04-26T07:51:40.407803+0000","last_clean":"2024-04-26T07:51:40.407803+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:51:40.407803+0000","last_undegraded":"2024-04-26T07:51:40.407803+0000","last_fullsized":"2024-04-26T07:51:40.407803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394239+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:40.394239+0000","last_peered":"2024-04-26T07:51:40.394239+0000","last_clean":"2024-04-26T07:51:40.394239+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:40.394239+0000","last_undegraded":"2024-04-26T07:51:40.394239+0000","last_fullsized":"2024-04-26T07:51:40.394239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388114+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:51:40.388114+0000","last_peered":"2024-04-26T07:51:40.388114+0000","last_clean":"2024-04-26T07:51:40.388114+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:51:40.388114+0000","last_undegraded":"2024-04-26T07:51:40.388114+0000","last_fullsized":"2024-04-26T07:51:40.388114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410876+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:40.410876+0000","last_peered":"2024-04-26T07:51:40.410876+0000","last_clean":"2024-04-26T07:51:40.410876+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:40.410876+0000","last_undegraded":"2024-04-26T07:51:40.410876+0000","last_fullsized":"2024-04-26T07:51:40.410876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397867+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:51:40.397867+0000","last_peered":"2024-04-26T07:51:40.397867+0000","last_clean":"2024-04-26T07:51:40.397867+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:51:40.397867+0000","last_undegraded":"2024-04-26T07:51:40.397867+0000","last_fullsized":"2024-04-26T07:51:40.397867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391523+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:40.391523+0000","last_peered":"2024-04-26T07:51:40.391523+0000","last_clean":"2024-04-26T07:51:40.391523+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:40.391523+0000","last_undegraded":"2024-04-26T07:51:40.391523+0000","last_fullsized":"2024-04-26T07:51:40.391523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399068+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:51:40.399068+0000","last_peered":"2024-04-26T07:51:40.399068+0000","last_clean":"2024-04-26T07:51:40.399068+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:51:40.399068+0000","last_undegraded":"2024-04-26T07:51:40.399068+0000","last_fullsized":"2024-04-26T07:51:40.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'14","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414006+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:51:40.414006+0000","last_peered":"2024-04-26T07:51:40.414006+0000","last_clean":"2024-04-26T07:51:40.414006+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:51:40.414006+0000","last_undegraded":"2024-04-26T07:51:40.414006+0000","last_fullsized":"2024-04-26T07:51:40.414006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398879+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:51:40.398879+0000","last_peered":"2024-04-26T07:51:40.398879+0000","last_clean":"2024-04-26T07:51:40.398879+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:51:40.398879+0000","last_undegraded":"2024-04-26T07:51:40.398879+0000","last_fullsized":"2024-04-26T07:51:40.398879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'27","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387769+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:40.387769+0000","last_peered":"2024-04-26T07:51:40.387769+0000","last_clean":"2024-04-26T07:51:40.387769+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:40.387769+0000","last_undegraded":"2024-04-26T07:51:40.387769+0000","last_fullsized":"2024-04-26T07:51:40.387769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":162,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428116+0000","last_change":"2024-04-26T07:51:40.428116+0000","last_active":"2024-04-26T07:51:40.428116+0000","last_peered":"2024-04-26T07:51:40.428116+0000","last_clean":"2024-04-26T07:51:40.428116+0000","last_became_active":"2024-04-26T07:51:40.427193+0000","last_became_peered":"2024-04-26T07:51:40.427193+0000","last_unstale":"2024-04-26T07:51:40.428116+0000","last_undegraded":"2024-04-26T07:51:40.428116+0000","last_fullsized":"2024-04-26T07:51:40.428116+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:06.591882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411819+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:40.411819+0000","last_peered":"2024-04-26T07:51:40.411819+0000","last_clean":"2024-04-26T07:51:40.411819+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:40.411819+0000","last_undegraded":"2024-04-26T07:51:40.411819+0000","last_fullsized":"2024-04-26T07:51:40.411819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386601+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:51:40.386601+0000","last_peered":"2024-04-26T07:51:40.386601+0000","last_clean":"2024-04-26T07:51:40.386601+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:51:40.386601+0000","last_undegraded":"2024-04-26T07:51:40.386601+0000","last_fullsized":"2024-04-26T07:51:40.386601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.449013+0000","last_change":"2024-04-26T07:51:40.449013+0000","last_active":"2024-04-26T07:51:40.449013+0000","last_peered":"2024-04-26T07:51:40.449013+0000","last_clean":"2024-04-26T07:51:40.449013+0000","last_became_active":"2024-04-26T07:51:40.445977+0000","last_became_peered":"2024-04-26T07:51:40.445977+0000","last_unstale":"2024-04-26T07:51:40.449013+0000","last_undegraded":"2024-04-26T07:51:40.449013+0000","last_fullsized":"2024-04-26T07:51:40.449013+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:19.331650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391050+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:51:40.391050+0000","last_peered":"2024-04-26T07:51:40.391050+0000","last_clean":"2024-04-26T07:51:40.391050+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:51:40.391050+0000","last_undegraded":"2024-04-26T07:51:40.391050+0000","last_fullsized":"2024-04-26T07:51:40.391050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"89'32","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399748+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:51:40.399748+0000","last_peered":"2024-04-26T07:51:40.399748+0000","last_clean":"2024-04-26T07:51:40.399748+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:51:40.399748+0000","last_undegraded":"2024-04-26T07:51:40.399748+0000","last_fullsized":"2024-04-26T07:51:40.399748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":169,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436803+0000","last_change":"2024-04-26T07:51:40.436803+0000","last_active":"2024-04-26T07:51:40.436803+0000","last_peered":"2024-04-26T07:51:40.436803+0000","last_clean":"2024-04-26T07:51:40.436803+0000","last_became_active":"2024-04-26T07:51:40.433471+0000","last_became_peered":"2024-04-26T07:51:40.433471+0000","last_unstale":"2024-04-26T07:51:40.436803+0000","last_undegraded":"2024-04-26T07:51:40.436803+0000","last_fullsized":"2024-04-26T07:51:40.436803+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:23.227977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417251+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:40.417251+0000","last_peered":"2024-04-26T07:51:40.417251+0000","last_clean":"2024-04-26T07:51:40.417251+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:40.417251+0000","last_undegraded":"2024-04-26T07:51:40.417251+0000","last_fullsized":"2024-04-26T07:51:40.417251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"89'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410612+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:40.410612+0000","last_peered":"2024-04-26T07:51:40.410612+0000","last_clean":"2024-04-26T07:51:40.410612+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:40.410612+0000","last_undegraded":"2024-04-26T07:51:40.410612+0000","last_fullsized":"2024-04-26T07:51:40.410612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388025+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:51:40.388025+0000","last_peered":"2024-04-26T07:51:40.388025+0000","last_clean":"2024-04-26T07:51:40.388025+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:51:40.388025+0000","last_undegraded":"2024-04-26T07:51:40.388025+0000","last_fullsized":"2024-04-26T07:51:40.388025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'29","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409213+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:51:40.409213+0000","last_peered":"2024-04-26T07:51:40.409213+0000","last_clean":"2024-04-26T07:51:40.409213+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:51:40.409213+0000","last_undegraded":"2024-04-26T07:51:40.409213+0000","last_fullsized":"2024-04-26T07:51:40.409213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415075+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:51:40.415075+0000","last_peered":"2024-04-26T07:51:40.415075+0000","last_clean":"2024-04-26T07:51:40.415075+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:51:40.415075+0000","last_undegraded":"2024-04-26T07:51:40.415075+0000","last_fullsized":"2024-04-26T07:51:40.415075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1082,"ondisk_log_size":1082,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":852,"num_read_kb":617,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":761,"ondisk_log_size":761,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1446,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716656,"kb_used_data":1685480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92655184,"statfs":{"total":96636764160,"available":94878908416,"internally_reserved":0,"allocated":1725931520,"data_stored":1725333608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203988,"kb_used_data":1172812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93167852,"statfs":{"total":96636764160,"available":95403880448,"internally_reserved":0,"allocated":1200959488,"data_stored":1200395317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812528,"kb_used_data":1777192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92559312,"statfs":{"total":96636764160,"available":94780735488,"internally_reserved":0,"allocated":1819844608,"data_stored":1819232747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1935060,"kb_used_data":1903876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92436780,"statfs":{"total":96636764160,"available":94655262720,"internally_reserved":0,"allocated":1949569024,"data_stored":1949020427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1877936,"kb_used_data":1842600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92493904,"statfs":{"total":96636764160,"available":94713757696,"internally_reserved":0,"allocated":1886822400,"data_stored":1886225804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1122120,"kb_used_data":1086784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93249720,"statfs":{"total":96636764160,"available":95487713280,"internally_reserved":0,"allocated":1112866816,"data_stored":1112315550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185700,"kb_used_data":1150364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93186140,"statfs":{"total":96636764160,"available":95422607360,"internally_reserved":0,"allocated":1177972736,"data_stored":1177387279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1732984,"kb_used_data":1697636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92638856,"statfs":{"total":96636764160,"available":94862188544,"internally_reserved":0,"allocated":1738379264,"data_stored":1737800572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1736441856,"data_stored":1736441856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1176502272,"data_stored":1176502272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1885339648,"data_stored":1885339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1948254208,"data_stored":1948254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1199570944,"data_stored":1199570944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1723858944,"data_stored":1723858944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":118389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:51:57.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T07:51:57.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:51:57.639 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:57.645 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:51:57.660 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-26T07:51:55.855160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3285,"num_read_kb":2974,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3904,"ondisk_log_size":3904,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12586972,"kb_used_data":12316744,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":742387748,"statfs":{"total":773094113280,"available":760205053952,"internally_reserved":0,"allocated":12612345856,"data_stored":12607711304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005853"},"pg_stats":[{"pgid":"3.3f","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.419563+0000","last_change":"2024-04-26T07:51:40.419563+0000","last_active":"2024-04-26T07:51:40.419563+0000","last_peered":"2024-04-26T07:51:40.419563+0000","last_clean":"2024-04-26T07:51:40.419563+0000","last_became_active":"2024-04-26T07:51:40.418691+0000","last_became_peered":"2024-04-26T07:51:40.418691+0000","last_unstale":"2024-04-26T07:51:40.419563+0000","last_undegraded":"2024-04-26T07:51:40.419563+0000","last_fullsized":"2024-04-26T07:51:40.419563+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:26.560585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410032+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:51:40.410032+0000","last_peered":"2024-04-26T07:51:40.410032+0000","last_clean":"2024-04-26T07:51:40.410032+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:51:40.410032+0000","last_undegraded":"2024-04-26T07:51:40.410032+0000","last_fullsized":"2024-04-26T07:51:40.410032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'26","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410817+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:51:40.410817+0000","last_peered":"2024-04-26T07:51:40.410817+0000","last_clean":"2024-04-26T07:51:40.410817+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:51:40.410817+0000","last_undegraded":"2024-04-26T07:51:40.410817+0000","last_fullsized":"2024-04-26T07:51:40.410817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":144,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.439485+0000","last_change":"2024-04-26T07:51:40.439485+0000","last_active":"2024-04-26T07:51:40.439485+0000","last_peered":"2024-04-26T07:51:40.439485+0000","last_clean":"2024-04-26T07:51:40.439485+0000","last_became_active":"2024-04-26T07:51:40.437448+0000","last_became_peered":"2024-04-26T07:51:40.437448+0000","last_unstale":"2024-04-26T07:51:40.439485+0000","last_undegraded":"2024-04-26T07:51:40.439485+0000","last_fullsized":"2024-04-26T07:51:40.439485+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:31.108593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387511+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:40.387511+0000","last_peered":"2024-04-26T07:51:40.387511+0000","last_clean":"2024-04-26T07:51:40.387511+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:40.387511+0000","last_undegraded":"2024-04-26T07:51:40.387511+0000","last_fullsized":"2024-04-26T07:51:40.387511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":226,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400767+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:51:40.400767+0000","last_peered":"2024-04-26T07:51:40.400767+0000","last_clean":"2024-04-26T07:51:40.400767+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:51:40.400767+0000","last_undegraded":"2024-04-26T07:51:40.400767+0000","last_fullsized":"2024-04-26T07:51:40.400767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414495+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:40.414495+0000","last_peered":"2024-04-26T07:51:40.414495+0000","last_clean":"2024-04-26T07:51:40.414495+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:40.414495+0000","last_undegraded":"2024-04-26T07:51:40.414495+0000","last_fullsized":"2024-04-26T07:51:40.414495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387443+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:40.387443+0000","last_peered":"2024-04-26T07:51:40.387443+0000","last_clean":"2024-04-26T07:51:40.387443+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:40.387443+0000","last_undegraded":"2024-04-26T07:51:40.387443+0000","last_fullsized":"2024-04-26T07:51:40.387443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'23","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435742+0000","last_change":"2024-04-26T07:51:40.435742+0000","last_active":"2024-04-26T07:51:40.435742+0000","last_peered":"2024-04-26T07:51:40.435742+0000","last_clean":"2024-04-26T07:51:40.435742+0000","last_became_active":"2024-04-26T07:51:40.433215+0000","last_became_peered":"2024-04-26T07:51:40.433215+0000","last_unstale":"2024-04-26T07:51:40.435742+0000","last_undegraded":"2024-04-26T07:51:40.435742+0000","last_fullsized":"2024-04-26T07:51:40.435742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:42.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411494+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:51:40.411494+0000","last_peered":"2024-04-26T07:51:40.411494+0000","last_clean":"2024-04-26T07:51:40.411494+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:51:40.411494+0000","last_undegraded":"2024-04-26T07:51:40.411494+0000","last_fullsized":"2024-04-26T07:51:40.411494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'22","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413726+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:51:40.413726+0000","last_peered":"2024-04-26T07:51:40.413726+0000","last_clean":"2024-04-26T07:51:40.413726+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:51:40.413726+0000","last_undegraded":"2024-04-26T07:51:40.413726+0000","last_fullsized":"2024-04-26T07:51:40.413726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396370+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:51:40.396370+0000","last_peered":"2024-04-26T07:51:40.396370+0000","last_clean":"2024-04-26T07:51:40.396370+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:51:40.396370+0000","last_undegraded":"2024-04-26T07:51:40.396370+0000","last_fullsized":"2024-04-26T07:51:40.396370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'19","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429122+0000","last_change":"2024-04-26T07:51:40.429122+0000","last_active":"2024-04-26T07:51:40.429122+0000","last_peered":"2024-04-26T07:51:40.429122+0000","last_clean":"2024-04-26T07:51:40.429122+0000","last_became_active":"2024-04-26T07:51:40.428267+0000","last_became_peered":"2024-04-26T07:51:40.428267+0000","last_unstale":"2024-04-26T07:51:40.429122+0000","last_undegraded":"2024-04-26T07:51:40.429122+0000","last_fullsized":"2024-04-26T07:51:40.429122+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.892584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414674+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:51:40.414674+0000","last_peered":"2024-04-26T07:51:40.414674+0000","last_clean":"2024-04-26T07:51:40.414674+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:51:40.414674+0000","last_undegraded":"2024-04-26T07:51:40.414674+0000","last_fullsized":"2024-04-26T07:51:40.414674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"89'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390795+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:40.390795+0000","last_peered":"2024-04-26T07:51:40.390795+0000","last_clean":"2024-04-26T07:51:40.390795+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:40.390795+0000","last_undegraded":"2024-04-26T07:51:40.390795+0000","last_fullsized":"2024-04-26T07:51:40.390795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399387+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:51:40.399387+0000","last_peered":"2024-04-26T07:51:40.399387+0000","last_clean":"2024-04-26T07:51:40.399387+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:51:40.399387+0000","last_undegraded":"2024-04-26T07:51:40.399387+0000","last_fullsized":"2024-04-26T07:51:40.399387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395530+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:51:40.395530+0000","last_peered":"2024-04-26T07:51:40.395530+0000","last_clean":"2024-04-26T07:51:40.395530+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:51:40.395530+0000","last_undegraded":"2024-04-26T07:51:40.395530+0000","last_fullsized":"2024-04-26T07:51:40.395530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'25","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429380+0000","last_change":"2024-04-26T07:51:40.429380+0000","last_active":"2024-04-26T07:51:40.429380+0000","last_peered":"2024-04-26T07:51:40.429380+0000","last_clean":"2024-04-26T07:51:40.429380+0000","last_became_active":"2024-04-26T07:51:40.428461+0000","last_became_peered":"2024-04-26T07:51:40.428461+0000","last_unstale":"2024-04-26T07:51:40.429380+0000","last_undegraded":"2024-04-26T07:51:40.429380+0000","last_fullsized":"2024-04-26T07:51:40.429380+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.386208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437638+0000","last_change":"2024-04-26T07:51:40.437638+0000","last_active":"2024-04-26T07:51:40.437638+0000","last_peered":"2024-04-26T07:51:40.437638+0000","last_clean":"2024-04-26T07:51:40.437638+0000","last_became_active":"2024-04-26T07:51:40.435585+0000","last_became_peered":"2024-04-26T07:51:40.435585+0000","last_unstale":"2024-04-26T07:51:40.437638+0000","last_undegraded":"2024-04-26T07:51:40.437638+0000","last_fullsized":"2024-04-26T07:51:40.437638+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:03.283810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'31","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412304+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:51:40.412304+0000","last_peered":"2024-04-26T07:51:40.412304+0000","last_clean":"2024-04-26T07:51:40.412304+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:51:40.412304+0000","last_undegraded":"2024-04-26T07:51:40.412304+0000","last_fullsized":"2024-04-26T07:51:40.412304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":41,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413895+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:51:40.413895+0000","last_peered":"2024-04-26T07:51:40.413895+0000","last_clean":"2024-04-26T07:51:40.413895+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:51:40.413895+0000","last_undegraded":"2024-04-26T07:51:40.413895+0000","last_fullsized":"2024-04-26T07:51:40.413895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412401+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:51:40.412401+0000","last_peered":"2024-04-26T07:51:40.412401+0000","last_clean":"2024-04-26T07:51:40.412401+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:51:40.412401+0000","last_undegraded":"2024-04-26T07:51:40.412401+0000","last_fullsized":"2024-04-26T07:51:40.412401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401519+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:51:40.401519+0000","last_peered":"2024-04-26T07:51:40.401519+0000","last_clean":"2024-04-26T07:51:40.401519+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:51:40.401519+0000","last_undegraded":"2024-04-26T07:51:40.401519+0000","last_fullsized":"2024-04-26T07:51:40.401519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'24","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397971+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:40.397971+0000","last_peered":"2024-04-26T07:51:40.397971+0000","last_clean":"2024-04-26T07:51:40.397971+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:40.397971+0000","last_undegraded":"2024-04-26T07:51:40.397971+0000","last_fullsized":"2024-04-26T07:51:40.397971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399756+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:51:40.399756+0000","last_peered":"2024-04-26T07:51:40.399756+0000","last_clean":"2024-04-26T07:51:40.399756+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:51:40.399756+0000","last_undegraded":"2024-04-26T07:51:40.399756+0000","last_fullsized":"2024-04-26T07:51:40.399756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392181+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:40.392181+0000","last_peered":"2024-04-26T07:51:40.392181+0000","last_clean":"2024-04-26T07:51:40.392181+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:40.392181+0000","last_undegraded":"2024-04-26T07:51:40.392181+0000","last_fullsized":"2024-04-26T07:51:40.392181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396627+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:51:40.396627+0000","last_peered":"2024-04-26T07:51:40.396627+0000","last_clean":"2024-04-26T07:51:40.396627+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:51:40.396627+0000","last_undegraded":"2024-04-26T07:51:40.396627+0000","last_fullsized":"2024-04-26T07:51:40.396627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"90'24","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386874+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:40.386874+0000","last_peered":"2024-04-26T07:51:40.386874+0000","last_clean":"2024-04-26T07:51:40.386874+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:40.386874+0000","last_undegraded":"2024-04-26T07:51:40.386874+0000","last_fullsized":"2024-04-26T07:51:40.386874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394620+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:40.394620+0000","last_peered":"2024-04-26T07:51:40.394620+0000","last_clean":"2024-04-26T07:51:40.394620+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:40.394620+0000","last_undegraded":"2024-04-26T07:51:40.394620+0000","last_fullsized":"2024-04-26T07:51:40.394620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393414+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:40.393414+0000","last_peered":"2024-04-26T07:51:40.393414+0000","last_clean":"2024-04-26T07:51:40.393414+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:40.393414+0000","last_undegraded":"2024-04-26T07:51:40.393414+0000","last_fullsized":"2024-04-26T07:51:40.393414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'19","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401423+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:40.401423+0000","last_peered":"2024-04-26T07:51:40.401423+0000","last_clean":"2024-04-26T07:51:40.401423+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:40.401423+0000","last_undegraded":"2024-04-26T07:51:40.401423+0000","last_fullsized":"2024-04-26T07:51:40.401423+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:08.704021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414398+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:40.414398+0000","last_peered":"2024-04-26T07:51:40.414398+0000","last_clean":"2024-04-26T07:51:40.414398+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:40.414398+0000","last_undegraded":"2024-04-26T07:51:40.414398+0000","last_fullsized":"2024-04-26T07:51:40.414398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"90'17","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387664+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:40.387664+0000","last_peered":"2024-04-26T07:51:40.387664+0000","last_clean":"2024-04-26T07:51:40.387664+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:40.387664+0000","last_undegraded":"2024-04-26T07:51:40.387664+0000","last_fullsized":"2024-04-26T07:51:40.387664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427384+0000","last_change":"2024-04-26T07:51:40.427384+0000","last_active":"2024-04-26T07:51:40.427384+0000","last_peered":"2024-04-26T07:51:40.427384+0000","last_clean":"2024-04-26T07:51:40.427384+0000","last_became_active":"2024-04-26T07:51:40.424563+0000","last_became_peered":"2024-04-26T07:51:40.424563+0000","last_unstale":"2024-04-26T07:51:40.427384+0000","last_undegraded":"2024-04-26T07:51:40.427384+0000","last_fullsized":"2024-04-26T07:51:40.427384+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:45.363785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409995+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:40.409995+0000","last_peered":"2024-04-26T07:51:40.409995+0000","last_clean":"2024-04-26T07:51:40.409995+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:40.409995+0000","last_undegraded":"2024-04-26T07:51:40.409995+0000","last_fullsized":"2024-04-26T07:51:40.409995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415011+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:51:40.415011+0000","last_peered":"2024-04-26T07:51:40.415011+0000","last_clean":"2024-04-26T07:51:40.415011+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:51:40.415011+0000","last_undegraded":"2024-04-26T07:51:40.415011+0000","last_fullsized":"2024-04-26T07:51:40.415011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386993+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:40.386993+0000","last_peered":"2024-04-26T07:51:40.386993+0000","last_clean":"2024-04-26T07:51:40.386993+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:40.386993+0000","last_undegraded":"2024-04-26T07:51:40.386993+0000","last_fullsized":"2024-04-26T07:51:40.386993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393282+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:40.393282+0000","last_peered":"2024-04-26T07:51:40.393282+0000","last_clean":"2024-04-26T07:51:40.393282+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:40.393282+0000","last_undegraded":"2024-04-26T07:51:40.393282+0000","last_fullsized":"2024-04-26T07:51:40.393282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"53'7","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397138+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:51:40.397138+0000","last_peered":"2024-04-26T07:51:40.397138+0000","last_clean":"2024-04-26T07:51:40.397138+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:51:40.397138+0000","last_undegraded":"2024-04-26T07:51:40.397138+0000","last_fullsized":"2024-04-26T07:51:40.397138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396318+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:40.396318+0000","last_peered":"2024-04-26T07:51:40.396318+0000","last_clean":"2024-04-26T07:51:40.396318+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:40.396318+0000","last_undegraded":"2024-04-26T07:51:40.396318+0000","last_fullsized":"2024-04-26T07:51:40.396318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386651+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:51:40.386651+0000","last_peered":"2024-04-26T07:51:40.386651+0000","last_clean":"2024-04-26T07:51:40.386651+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:51:40.386651+0000","last_undegraded":"2024-04-26T07:51:40.386651+0000","last_fullsized":"2024-04-26T07:51:40.386651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388934+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:51:40.388934+0000","last_peered":"2024-04-26T07:51:40.388934+0000","last_clean":"2024-04-26T07:51:40.388934+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:51:40.388934+0000","last_undegraded":"2024-04-26T07:51:40.388934+0000","last_fullsized":"2024-04-26T07:51:40.388934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'22","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441938+0000","last_change":"2024-04-26T07:51:40.441938+0000","last_active":"2024-04-26T07:51:40.441938+0000","last_peered":"2024-04-26T07:51:40.441938+0000","last_clean":"2024-04-26T07:51:40.441938+0000","last_became_active":"2024-04-26T07:51:40.440255+0000","last_became_peered":"2024-04-26T07:51:40.440255+0000","last_unstale":"2024-04-26T07:51:40.441938+0000","last_undegraded":"2024-04-26T07:51:40.441938+0000","last_fullsized":"2024-04-26T07:51:40.441938+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:49.106793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394846+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:40.394846+0000","last_peered":"2024-04-26T07:51:40.394846+0000","last_clean":"2024-04-26T07:51:40.394846+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:40.394846+0000","last_undegraded":"2024-04-26T07:51:40.394846+0000","last_fullsized":"2024-04-26T07:51:40.394846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399562+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:51:40.399562+0000","last_peered":"2024-04-26T07:51:40.399562+0000","last_clean":"2024-04-26T07:51:40.399562+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:51:40.399562+0000","last_undegraded":"2024-04-26T07:51:40.399562+0000","last_fullsized":"2024-04-26T07:51:40.399562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"109'137","reported_seq":311,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807192+0000","last_change":"2024-04-26T07:51:40.446383+0000","last_active":"2024-04-26T07:51:45.807192+0000","last_peered":"2024-04-26T07:51:45.807192+0000","last_clean":"2024-04-26T07:51:45.807192+0000","last_became_active":"2024-04-26T07:51:40.439601+0000","last_became_peered":"2024-04-26T07:51:40.439601+0000","last_unstale":"2024-04-26T07:51:45.807192+0000","last_undegraded":"2024-04-26T07:51:45.807192+0000","last_fullsized":"2024-04-26T07:51:45.807192+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:32.966811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395932+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:40.395932+0000","last_peered":"2024-04-26T07:51:40.395932+0000","last_clean":"2024-04-26T07:51:40.395932+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:40.395932+0000","last_undegraded":"2024-04-26T07:51:40.395932+0000","last_fullsized":"2024-04-26T07:51:40.395932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394102+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:51:40.394102+0000","last_peered":"2024-04-26T07:51:40.394102+0000","last_clean":"2024-04-26T07:51:40.394102+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:51:40.394102+0000","last_undegraded":"2024-04-26T07:51:40.394102+0000","last_fullsized":"2024-04-26T07:51:40.394102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'17","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408341+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:51:40.408341+0000","last_peered":"2024-04-26T07:51:40.408341+0000","last_clean":"2024-04-26T07:51:40.408341+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:51:40.408341+0000","last_undegraded":"2024-04-26T07:51:40.408341+0000","last_fullsized":"2024-04-26T07:51:40.408341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414412+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:40.414412+0000","last_peered":"2024-04-26T07:51:40.414412+0000","last_clean":"2024-04-26T07:51:40.414412+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:40.414412+0000","last_undegraded":"2024-04-26T07:51:40.414412+0000","last_fullsized":"2024-04-26T07:51:40.414412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"90'17","reported_seq":159,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.447428+0000","last_change":"2024-04-26T07:51:40.447428+0000","last_active":"2024-04-26T07:51:40.447428+0000","last_peered":"2024-04-26T07:51:40.447428+0000","last_clean":"2024-04-26T07:51:40.447428+0000","last_became_active":"2024-04-26T07:51:40.441381+0000","last_became_peered":"2024-04-26T07:51:40.441381+0000","last_unstale":"2024-04-26T07:51:40.447428+0000","last_undegraded":"2024-04-26T07:51:40.447428+0000","last_fullsized":"2024-04-26T07:51:40.447428+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:19.309516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"109'135","reported_seq":352,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804804+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:51:45.804804+0000","last_peered":"2024-04-26T07:51:45.804804+0000","last_clean":"2024-04-26T07:51:45.804804+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:51:45.804804+0000","last_undegraded":"2024-04-26T07:51:45.804804+0000","last_fullsized":"2024-04-26T07:51:45.804804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410355+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:51:40.410355+0000","last_peered":"2024-04-26T07:51:40.410355+0000","last_clean":"2024-04-26T07:51:40.410355+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:51:40.410355+0000","last_undegraded":"2024-04-26T07:51:40.410355+0000","last_fullsized":"2024-04-26T07:51:40.410355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433314+0000","last_change":"2024-04-26T07:51:40.433314+0000","last_active":"2024-04-26T07:51:40.433314+0000","last_peered":"2024-04-26T07:51:40.433314+0000","last_clean":"2024-04-26T07:51:40.433314+0000","last_became_active":"2024-04-26T07:51:40.432352+0000","last_became_peered":"2024-04-26T07:51:40.432352+0000","last_unstale":"2024-04-26T07:51:40.433314+0000","last_undegraded":"2024-04-26T07:51:40.433314+0000","last_fullsized":"2024-04-26T07:51:40.433314+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:27.681250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436814+0000","last_change":"2024-04-26T07:51:40.436814+0000","last_active":"2024-04-26T07:51:40.436814+0000","last_peered":"2024-04-26T07:51:40.436814+0000","last_clean":"2024-04-26T07:51:40.436814+0000","last_became_active":"2024-04-26T07:51:40.432366+0000","last_became_peered":"2024-04-26T07:51:40.432366+0000","last_unstale":"2024-04-26T07:51:40.436814+0000","last_undegraded":"2024-04-26T07:51:40.436814+0000","last_fullsized":"2024-04-26T07:51:40.436814+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.091620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"90'27","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412936+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:51:40.412936+0000","last_peered":"2024-04-26T07:51:40.412936+0000","last_clean":"2024-04-26T07:51:40.412936+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:51:40.412936+0000","last_undegraded":"2024-04-26T07:51:40.412936+0000","last_fullsized":"2024-04-26T07:51:40.412936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409381+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:40.409381+0000","last_peered":"2024-04-26T07:51:40.409381+0000","last_clean":"2024-04-26T07:51:40.409381+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:40.409381+0000","last_undegraded":"2024-04-26T07:51:40.409381+0000","last_fullsized":"2024-04-26T07:51:40.409381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413984+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:40.413984+0000","last_peered":"2024-04-26T07:51:40.413984+0000","last_clean":"2024-04-26T07:51:40.413984+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:40.413984+0000","last_undegraded":"2024-04-26T07:51:40.413984+0000","last_fullsized":"2024-04-26T07:51:40.413984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395453+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:51:40.395453+0000","last_peered":"2024-04-26T07:51:40.395453+0000","last_clean":"2024-04-26T07:51:40.395453+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:51:40.395453+0000","last_undegraded":"2024-04-26T07:51:40.395453+0000","last_fullsized":"2024-04-26T07:51:40.395453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'24","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432790+0000","last_change":"2024-04-26T07:51:40.432790+0000","last_active":"2024-04-26T07:51:40.432790+0000","last_peered":"2024-04-26T07:51:40.432790+0000","last_clean":"2024-04-26T07:51:40.432790+0000","last_became_active":"2024-04-26T07:51:40.431661+0000","last_became_peered":"2024-04-26T07:51:40.431661+0000","last_unstale":"2024-04-26T07:51:40.432790+0000","last_undegraded":"2024-04-26T07:51:40.432790+0000","last_fullsized":"2024-04-26T07:51:40.432790+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:44.955807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399129+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:51:40.399129+0000","last_peered":"2024-04-26T07:51:40.399129+0000","last_clean":"2024-04-26T07:51:40.399129+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:51:40.399129+0000","last_undegraded":"2024-04-26T07:51:40.399129+0000","last_fullsized":"2024-04-26T07:51:40.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"90'17","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392602+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:51:40.392602+0000","last_peered":"2024-04-26T07:51:40.392602+0000","last_clean":"2024-04-26T07:51:40.392602+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:51:40.392602+0000","last_undegraded":"2024-04-26T07:51:40.392602+0000","last_fullsized":"2024-04-26T07:51:40.392602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391295+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:51:40.391295+0000","last_peered":"2024-04-26T07:51:40.391295+0000","last_clean":"2024-04-26T07:51:40.391295+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:51:40.391295+0000","last_undegraded":"2024-04-26T07:51:40.391295+0000","last_fullsized":"2024-04-26T07:51:40.391295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411466+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:40.411466+0000","last_peered":"2024-04-26T07:51:40.411466+0000","last_clean":"2024-04-26T07:51:40.411466+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:40.411466+0000","last_undegraded":"2024-04-26T07:51:40.411466+0000","last_fullsized":"2024-04-26T07:51:40.411466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409163+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:51:40.409163+0000","last_peered":"2024-04-26T07:51:40.409163+0000","last_clean":"2024-04-26T07:51:40.409163+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:51:40.409163+0000","last_undegraded":"2024-04-26T07:51:40.409163+0000","last_fullsized":"2024-04-26T07:51:40.409163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"89'25","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.448016+0000","last_change":"2024-04-26T07:51:40.448016+0000","last_active":"2024-04-26T07:51:40.448016+0000","last_peered":"2024-04-26T07:51:40.448016+0000","last_clean":"2024-04-26T07:51:40.448016+0000","last_became_active":"2024-04-26T07:51:40.444713+0000","last_became_peered":"2024-04-26T07:51:40.444713+0000","last_unstale":"2024-04-26T07:51:40.448016+0000","last_undegraded":"2024-04-26T07:51:40.448016+0000","last_fullsized":"2024-04-26T07:51:40.448016+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:01.400431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401762+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:51:40.401762+0000","last_peered":"2024-04-26T07:51:40.401762+0000","last_clean":"2024-04-26T07:51:40.401762+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:51:40.401762+0000","last_undegraded":"2024-04-26T07:51:40.401762+0000","last_fullsized":"2024-04-26T07:51:40.401762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"90'25","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444435+0000","last_change":"2024-04-26T07:51:40.444435+0000","last_active":"2024-04-26T07:51:40.444435+0000","last_peered":"2024-04-26T07:51:40.444435+0000","last_clean":"2024-04-26T07:51:40.444435+0000","last_became_active":"2024-04-26T07:51:40.438940+0000","last_became_peered":"2024-04-26T07:51:40.438940+0000","last_unstale":"2024-04-26T07:51:40.444435+0000","last_undegraded":"2024-04-26T07:51:40.444435+0000","last_fullsized":"2024-04-26T07:51:40.444435+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:00.682036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62803,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"109'135","reported_seq":350,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804641+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:51:45.804641+0000","last_peered":"2024-04-26T07:51:45.804641+0000","last_clean":"2024-04-26T07:51:45.804641+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:51:45.804641+0000","last_undegraded":"2024-04-26T07:51:45.804641+0000","last_fullsized":"2024-04-26T07:51:45.804641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387775+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:40.387775+0000","last_peered":"2024-04-26T07:51:40.387775+0000","last_clean":"2024-04-26T07:51:40.387775+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:40.387775+0000","last_undegraded":"2024-04-26T07:51:40.387775+0000","last_fullsized":"2024-04-26T07:51:40.387775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388194+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:40.388194+0000","last_peered":"2024-04-26T07:51:40.388194+0000","last_clean":"2024-04-26T07:51:40.388194+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:40.388194+0000","last_undegraded":"2024-04-26T07:51:40.388194+0000","last_fullsized":"2024-04-26T07:51:40.388194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414745+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:40.414745+0000","last_peered":"2024-04-26T07:51:40.414745+0000","last_clean":"2024-04-26T07:51:40.414745+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:40.414745+0000","last_undegraded":"2024-04-26T07:51:40.414745+0000","last_fullsized":"2024-04-26T07:51:40.414745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400425+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:51:40.400425+0000","last_peered":"2024-04-26T07:51:40.400425+0000","last_clean":"2024-04-26T07:51:40.400425+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:51:40.400425+0000","last_undegraded":"2024-04-26T07:51:40.400425+0000","last_fullsized":"2024-04-26T07:51:40.400425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'29","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387270+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:40.387270+0000","last_peered":"2024-04-26T07:51:40.387270+0000","last_clean":"2024-04-26T07:51:40.387270+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:40.387270+0000","last_undegraded":"2024-04-26T07:51:40.387270+0000","last_fullsized":"2024-04-26T07:51:40.387270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398515+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:51:40.398515+0000","last_peered":"2024-04-26T07:51:40.398515+0000","last_clean":"2024-04-26T07:51:40.398515+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:51:40.398515+0000","last_undegraded":"2024-04-26T07:51:40.398515+0000","last_fullsized":"2024-04-26T07:51:40.398515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410194+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:40.410194+0000","last_peered":"2024-04-26T07:51:40.410194+0000","last_clean":"2024-04-26T07:51:40.410194+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:40.410194+0000","last_undegraded":"2024-04-26T07:51:40.410194+0000","last_fullsized":"2024-04-26T07:51:40.410194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398461+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:40.398461+0000","last_peered":"2024-04-26T07:51:40.398461+0000","last_clean":"2024-04-26T07:51:40.398461+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:40.398461+0000","last_undegraded":"2024-04-26T07:51:40.398461+0000","last_fullsized":"2024-04-26T07:51:40.398461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391868+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:40.391868+0000","last_peered":"2024-04-26T07:51:40.391868+0000","last_clean":"2024-04-26T07:51:40.391868+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:40.391868+0000","last_undegraded":"2024-04-26T07:51:40.391868+0000","last_fullsized":"2024-04-26T07:51:40.391868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398811+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:51:40.398811+0000","last_peered":"2024-04-26T07:51:40.398811+0000","last_clean":"2024-04-26T07:51:40.398811+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:51:40.398811+0000","last_undegraded":"2024-04-26T07:51:40.398811+0000","last_fullsized":"2024-04-26T07:51:40.398811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"90'20","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396590+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:51:40.396590+0000","last_peered":"2024-04-26T07:51:40.396590+0000","last_clean":"2024-04-26T07:51:40.396590+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:51:40.396590+0000","last_undegraded":"2024-04-26T07:51:40.396590+0000","last_fullsized":"2024-04-26T07:51:40.396590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388406+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:51:40.388406+0000","last_peered":"2024-04-26T07:51:40.388406+0000","last_clean":"2024-04-26T07:51:40.388406+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:51:40.388406+0000","last_undegraded":"2024-04-26T07:51:40.388406+0000","last_fullsized":"2024-04-26T07:51:40.388406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390097+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:40.390097+0000","last_peered":"2024-04-26T07:51:40.390097+0000","last_clean":"2024-04-26T07:51:40.390097+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:40.390097+0000","last_undegraded":"2024-04-26T07:51:40.390097+0000","last_fullsized":"2024-04-26T07:51:40.390097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396856+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:40.396856+0000","last_peered":"2024-04-26T07:51:40.396856+0000","last_clean":"2024-04-26T07:51:40.396856+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:40.396856+0000","last_undegraded":"2024-04-26T07:51:40.396856+0000","last_fullsized":"2024-04-26T07:51:40.396856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'25","reported_seq":217,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409628+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:51:40.409628+0000","last_peered":"2024-04-26T07:51:40.409628+0000","last_clean":"2024-04-26T07:51:40.409628+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:51:40.409628+0000","last_undegraded":"2024-04-26T07:51:40.409628+0000","last_fullsized":"2024-04-26T07:51:40.409628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409449+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:51:40.409449+0000","last_peered":"2024-04-26T07:51:40.409449+0000","last_clean":"2024-04-26T07:51:40.409449+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:51:40.409449+0000","last_undegraded":"2024-04-26T07:51:40.409449+0000","last_fullsized":"2024-04-26T07:51:40.409449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"90'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399211+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:51:40.399211+0000","last_peered":"2024-04-26T07:51:40.399211+0000","last_clean":"2024-04-26T07:51:40.399211+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:51:40.399211+0000","last_undegraded":"2024-04-26T07:51:40.399211+0000","last_fullsized":"2024-04-26T07:51:40.399211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"109'135","reported_seq":367,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804709+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:51:45.804709+0000","last_peered":"2024-04-26T07:51:45.804709+0000","last_clean":"2024-04-26T07:51:45.804709+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:51:45.804709+0000","last_undegraded":"2024-04-26T07:51:45.804709+0000","last_fullsized":"2024-04-26T07:51:45.804709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409050+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:40.409050+0000","last_peered":"2024-04-26T07:51:40.409050+0000","last_clean":"2024-04-26T07:51:40.409050+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:40.409050+0000","last_undegraded":"2024-04-26T07:51:40.409050+0000","last_fullsized":"2024-04-26T07:51:40.409050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398129+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:51:40.398129+0000","last_peered":"2024-04-26T07:51:40.398129+0000","last_clean":"2024-04-26T07:51:40.398129+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:51:40.398129+0000","last_undegraded":"2024-04-26T07:51:40.398129+0000","last_fullsized":"2024-04-26T07:51:40.398129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"89'30","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396862+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:40.396862+0000","last_peered":"2024-04-26T07:51:40.396862+0000","last_clean":"2024-04-26T07:51:40.396862+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:40.396862+0000","last_undegraded":"2024-04-26T07:51:40.396862+0000","last_fullsized":"2024-04-26T07:51:40.396862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":363,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416681+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:51:40.416681+0000","last_peered":"2024-04-26T07:51:40.416681+0000","last_clean":"2024-04-26T07:51:40.416681+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:51:40.416681+0000","last_undegraded":"2024-04-26T07:51:40.416681+0000","last_fullsized":"2024-04-26T07:51:40.416681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393097+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:51:40.393097+0000","last_peered":"2024-04-26T07:51:40.393097+0000","last_clean":"2024-04-26T07:51:40.393097+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:51:40.393097+0000","last_undegraded":"2024-04-26T07:51:40.393097+0000","last_fullsized":"2024-04-26T07:51:40.393097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"109'135","reported_seq":402,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807119+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:45.807119+0000","last_peered":"2024-04-26T07:51:45.807119+0000","last_clean":"2024-04-26T07:51:45.807119+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:45.807119+0000","last_undegraded":"2024-04-26T07:51:45.807119+0000","last_fullsized":"2024-04-26T07:51:45.807119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400533+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:40.400533+0000","last_peered":"2024-04-26T07:51:40.400533+0000","last_clean":"2024-04-26T07:51:40.400533+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:40.400533+0000","last_undegraded":"2024-04-26T07:51:40.400533+0000","last_fullsized":"2024-04-26T07:51:40.400533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":165,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394484+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:40.394484+0000","last_peered":"2024-04-26T07:51:40.394484+0000","last_clean":"2024-04-26T07:51:40.394484+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:40.394484+0000","last_undegraded":"2024-04-26T07:51:40.394484+0000","last_fullsized":"2024-04-26T07:51:40.394484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390895+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:40.390895+0000","last_peered":"2024-04-26T07:51:40.390895+0000","last_clean":"2024-04-26T07:51:40.390895+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:40.390895+0000","last_undegraded":"2024-04-26T07:51:40.390895+0000","last_fullsized":"2024-04-26T07:51:40.390895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397629+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:51:40.397629+0000","last_peered":"2024-04-26T07:51:40.397629+0000","last_clean":"2024-04-26T07:51:40.397629+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:51:40.397629+0000","last_undegraded":"2024-04-26T07:51:40.397629+0000","last_fullsized":"2024-04-26T07:51:40.397629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"90'26","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414130+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:51:40.414130+0000","last_peered":"2024-04-26T07:51:40.414130+0000","last_clean":"2024-04-26T07:51:40.414130+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:51:40.414130+0000","last_undegraded":"2024-04-26T07:51:40.414130+0000","last_fullsized":"2024-04-26T07:51:40.414130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409728+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:40.409728+0000","last_peered":"2024-04-26T07:51:40.409728+0000","last_clean":"2024-04-26T07:51:40.409728+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:40.409728+0000","last_undegraded":"2024-04-26T07:51:40.409728+0000","last_fullsized":"2024-04-26T07:51:40.409728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409337+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:40.409337+0000","last_peered":"2024-04-26T07:51:40.409337+0000","last_clean":"2024-04-26T07:51:40.409337+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:40.409337+0000","last_undegraded":"2024-04-26T07:51:40.409337+0000","last_fullsized":"2024-04-26T07:51:40.409337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412130+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:51:40.412130+0000","last_peered":"2024-04-26T07:51:40.412130+0000","last_clean":"2024-04-26T07:51:40.412130+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:51:40.412130+0000","last_undegraded":"2024-04-26T07:51:40.412130+0000","last_fullsized":"2024-04-26T07:51:40.412130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435552+0000","last_change":"2024-04-26T07:51:40.435552+0000","last_active":"2024-04-26T07:51:40.435552+0000","last_peered":"2024-04-26T07:51:40.435552+0000","last_clean":"2024-04-26T07:51:40.435552+0000","last_became_active":"2024-04-26T07:51:40.429475+0000","last_became_peered":"2024-04-26T07:51:40.429475+0000","last_unstale":"2024-04-26T07:51:40.435552+0000","last_undegraded":"2024-04-26T07:51:40.435552+0000","last_fullsized":"2024-04-26T07:51:40.435552+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:19.379343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414577+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:40.414577+0000","last_peered":"2024-04-26T07:51:40.414577+0000","last_clean":"2024-04-26T07:51:40.414577+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:40.414577+0000","last_undegraded":"2024-04-26T07:51:40.414577+0000","last_fullsized":"2024-04-26T07:51:40.414577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391655+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:40.391655+0000","last_peered":"2024-04-26T07:51:40.391655+0000","last_clean":"2024-04-26T07:51:40.391655+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:40.391655+0000","last_undegraded":"2024-04-26T07:51:40.391655+0000","last_fullsized":"2024-04-26T07:51:40.391655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429427+0000","last_change":"2024-04-26T07:51:40.429427+0000","last_active":"2024-04-26T07:51:40.429427+0000","last_peered":"2024-04-26T07:51:40.429427+0000","last_clean":"2024-04-26T07:51:40.429427+0000","last_became_active":"2024-04-26T07:51:40.428641+0000","last_became_peered":"2024-04-26T07:51:40.428641+0000","last_unstale":"2024-04-26T07:51:40.429427+0000","last_undegraded":"2024-04-26T07:51:40.429427+0000","last_fullsized":"2024-04-26T07:51:40.429427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:31.406741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"90'39","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416828+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:51:40.416828+0000","last_peered":"2024-04-26T07:51:40.416828+0000","last_clean":"2024-04-26T07:51:40.416828+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:51:40.416828+0000","last_undegraded":"2024-04-26T07:51:40.416828+0000","last_fullsized":"2024-04-26T07:51:40.416828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388551+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:51:40.388551+0000","last_peered":"2024-04-26T07:51:40.388551+0000","last_clean":"2024-04-26T07:51:40.388551+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:51:40.388551+0000","last_undegraded":"2024-04-26T07:51:40.388551+0000","last_fullsized":"2024-04-26T07:51:40.388551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407507+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:40.407507+0000","last_peered":"2024-04-26T07:51:40.407507+0000","last_clean":"2024-04-26T07:51:40.407507+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:40.407507+0000","last_undegraded":"2024-04-26T07:51:40.407507+0000","last_fullsized":"2024-04-26T07:51:40.407507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388819+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:51:40.388819+0000","last_peered":"2024-04-26T07:51:40.388819+0000","last_clean":"2024-04-26T07:51:40.388819+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:51:40.388819+0000","last_undegraded":"2024-04-26T07:51:40.388819+0000","last_fullsized":"2024-04-26T07:51:40.388819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.440837+0000","last_change":"2024-04-26T07:51:40.440837+0000","last_active":"2024-04-26T07:51:40.440837+0000","last_peered":"2024-04-26T07:51:40.440837+0000","last_clean":"2024-04-26T07:51:40.440837+0000","last_became_active":"2024-04-26T07:51:40.437582+0000","last_became_peered":"2024-04-26T07:51:40.437582+0000","last_unstale":"2024-04-26T07:51:40.440837+0000","last_undegraded":"2024-04-26T07:51:40.440837+0000","last_fullsized":"2024-04-26T07:51:40.440837+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.908604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"89'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387392+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:40.387392+0000","last_peered":"2024-04-26T07:51:40.387392+0000","last_clean":"2024-04-26T07:51:40.387392+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:40.387392+0000","last_undegraded":"2024-04-26T07:51:40.387392+0000","last_fullsized":"2024-04-26T07:51:40.387392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417014+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:40.417014+0000","last_peered":"2024-04-26T07:51:40.417014+0000","last_clean":"2024-04-26T07:51:40.417014+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:40.417014+0000","last_undegraded":"2024-04-26T07:51:40.417014+0000","last_fullsized":"2024-04-26T07:51:40.417014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"109'138","reported_seq":420,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804711+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:51:45.804711+0000","last_peered":"2024-04-26T07:51:45.804711+0000","last_clean":"2024-04-26T07:51:45.804711+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:51:45.804711+0000","last_undegraded":"2024-04-26T07:51:45.804711+0000","last_fullsized":"2024-04-26T07:51:45.804711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121552,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444144+0000","last_change":"2024-04-26T07:51:40.444144+0000","last_active":"2024-04-26T07:51:40.444144+0000","last_peered":"2024-04-26T07:51:40.444144+0000","last_clean":"2024-04-26T07:51:40.444144+0000","last_became_active":"2024-04-26T07:51:40.439356+0000","last_became_peered":"2024-04-26T07:51:40.439356+0000","last_unstale":"2024-04-26T07:51:40.444144+0000","last_undegraded":"2024-04-26T07:51:40.444144+0000","last_fullsized":"2024-04-26T07:51:40.444144+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:37.987341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408252+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:40.408252+0000","last_peered":"2024-04-26T07:51:40.408252+0000","last_clean":"2024-04-26T07:51:40.408252+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:40.408252+0000","last_undegraded":"2024-04-26T07:51:40.408252+0000","last_fullsized":"2024-04-26T07:51:40.408252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410446+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:51:40.410446+0000","last_peered":"2024-04-26T07:51:40.410446+0000","last_clean":"2024-04-26T07:51:40.410446+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:51:40.410446+0000","last_undegraded":"2024-04-26T07:51:40.410446+0000","last_fullsized":"2024-04-26T07:51:40.410446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399025+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:51:40.399025+0000","last_peered":"2024-04-26T07:51:40.399025+0000","last_clean":"2024-04-26T07:51:40.399025+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:51:40.399025+0000","last_undegraded":"2024-04-26T07:51:40.399025+0000","last_fullsized":"2024-04-26T07:51:40.399025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'26","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408371+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:40.408371+0000","last_peered":"2024-04-26T07:51:40.408371+0000","last_clean":"2024-04-26T07:51:40.408371+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:40.408371+0000","last_undegraded":"2024-04-26T07:51:40.408371+0000","last_fullsized":"2024-04-26T07:51:40.408371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399455+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:51:40.399455+0000","last_peered":"2024-04-26T07:51:40.399455+0000","last_clean":"2024-04-26T07:51:40.399455+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:51:40.399455+0000","last_undegraded":"2024-04-26T07:51:40.399455+0000","last_fullsized":"2024-04-26T07:51:40.399455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"109'18","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807316+0000","last_change":"2024-04-26T07:51:40.448691+0000","last_active":"2024-04-26T07:51:45.807316+0000","last_peered":"2024-04-26T07:51:45.807316+0000","last_clean":"2024-04-26T07:51:45.807316+0000","last_became_active":"2024-04-26T07:51:40.445444+0000","last_became_peered":"2024-04-26T07:51:40.445444+0000","last_unstale":"2024-04-26T07:51:45.807316+0000","last_undegraded":"2024-04-26T07:51:45.807316+0000","last_fullsized":"2024-04-26T07:51:45.807316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:23.750359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387011+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:51:40.387011+0000","last_peered":"2024-04-26T07:51:40.387011+0000","last_clean":"2024-04-26T07:51:40.387011+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:51:40.387011+0000","last_undegraded":"2024-04-26T07:51:40.387011+0000","last_fullsized":"2024-04-26T07:51:40.387011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392361+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:40.392361+0000","last_peered":"2024-04-26T07:51:40.392361+0000","last_clean":"2024-04-26T07:51:40.392361+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:40.392361+0000","last_undegraded":"2024-04-26T07:51:40.392361+0000","last_fullsized":"2024-04-26T07:51:40.392361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409549+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:51:40.409549+0000","last_peered":"2024-04-26T07:51:40.409549+0000","last_clean":"2024-04-26T07:51:40.409549+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:51:40.409549+0000","last_undegraded":"2024-04-26T07:51:40.409549+0000","last_fullsized":"2024-04-26T07:51:40.409549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414326+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:40.414326+0000","last_peered":"2024-04-26T07:51:40.414326+0000","last_clean":"2024-04-26T07:51:40.414326+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:40.414326+0000","last_undegraded":"2024-04-26T07:51:40.414326+0000","last_fullsized":"2024-04-26T07:51:40.414326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'20","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397271+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:40.397271+0000","last_peered":"2024-04-26T07:51:40.397271+0000","last_clean":"2024-04-26T07:51:40.397271+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:40.397271+0000","last_undegraded":"2024-04-26T07:51:40.397271+0000","last_fullsized":"2024-04-26T07:51:40.397271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387118+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:51:40.387118+0000","last_peered":"2024-04-26T07:51:40.387118+0000","last_clean":"2024-04-26T07:51:40.387118+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:51:40.387118+0000","last_undegraded":"2024-04-26T07:51:40.387118+0000","last_fullsized":"2024-04-26T07:51:40.387118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393907+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:40.393907+0000","last_peered":"2024-04-26T07:51:40.393907+0000","last_clean":"2024-04-26T07:51:40.393907+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:40.393907+0000","last_undegraded":"2024-04-26T07:51:40.393907+0000","last_fullsized":"2024-04-26T07:51:40.393907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412184+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:40.412184+0000","last_peered":"2024-04-26T07:51:40.412184+0000","last_clean":"2024-04-26T07:51:40.412184+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:40.412184+0000","last_undegraded":"2024-04-26T07:51:40.412184+0000","last_fullsized":"2024-04-26T07:51:40.412184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409446+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:40.409446+0000","last_peered":"2024-04-26T07:51:40.409446+0000","last_clean":"2024-04-26T07:51:40.409446+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:40.409446+0000","last_undegraded":"2024-04-26T07:51:40.409446+0000","last_fullsized":"2024-04-26T07:51:40.409446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408654+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:51:40.408654+0000","last_peered":"2024-04-26T07:51:40.408654+0000","last_clean":"2024-04-26T07:51:40.408654+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:51:40.408654+0000","last_undegraded":"2024-04-26T07:51:40.408654+0000","last_fullsized":"2024-04-26T07:51:40.408654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"88'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415304+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:40.415304+0000","last_peered":"2024-04-26T07:51:40.415304+0000","last_clean":"2024-04-26T07:51:40.415304+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:40.415304+0000","last_undegraded":"2024-04-26T07:51:40.415304+0000","last_fullsized":"2024-04-26T07:51:40.415304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409916+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:51:40.409916+0000","last_peered":"2024-04-26T07:51:40.409916+0000","last_clean":"2024-04-26T07:51:40.409916+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:51:40.409916+0000","last_undegraded":"2024-04-26T07:51:40.409916+0000","last_fullsized":"2024-04-26T07:51:40.409916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387667+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:51:40.387667+0000","last_peered":"2024-04-26T07:51:40.387667+0000","last_clean":"2024-04-26T07:51:40.387667+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:51:40.387667+0000","last_undegraded":"2024-04-26T07:51:40.387667+0000","last_fullsized":"2024-04-26T07:51:40.387667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"90'35","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386306+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:51:40.386306+0000","last_peered":"2024-04-26T07:51:40.386306+0000","last_clean":"2024-04-26T07:51:40.386306+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:51:40.386306+0000","last_undegraded":"2024-04-26T07:51:40.386306+0000","last_fullsized":"2024-04-26T07:51:40.386306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4763,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394908+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:40.394908+0000","last_peered":"2024-04-26T07:51:40.394908+0000","last_clean":"2024-04-26T07:51:40.394908+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:40.394908+0000","last_undegraded":"2024-04-26T07:51:40.394908+0000","last_fullsized":"2024-04-26T07:51:40.394908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387516+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:40.387516+0000","last_peered":"2024-04-26T07:51:40.387516+0000","last_clean":"2024-04-26T07:51:40.387516+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:40.387516+0000","last_undegraded":"2024-04-26T07:51:40.387516+0000","last_fullsized":"2024-04-26T07:51:40.387516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388105+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:51:40.388105+0000","last_peered":"2024-04-26T07:51:40.388105+0000","last_clean":"2024-04-26T07:51:40.388105+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:51:40.388105+0000","last_undegraded":"2024-04-26T07:51:40.388105+0000","last_fullsized":"2024-04-26T07:51:40.388105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409722+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:51:40.409722+0000","last_peered":"2024-04-26T07:51:40.409722+0000","last_clean":"2024-04-26T07:51:40.409722+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:51:40.409722+0000","last_undegraded":"2024-04-26T07:51:40.409722+0000","last_fullsized":"2024-04-26T07:51:40.409722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441852+0000","last_change":"2024-04-26T07:51:40.441852+0000","last_active":"2024-04-26T07:51:40.441852+0000","last_peered":"2024-04-26T07:51:40.441852+0000","last_clean":"2024-04-26T07:51:40.441852+0000","last_became_active":"2024-04-26T07:51:40.433293+0000","last_became_peered":"2024-04-26T07:51:40.433293+0000","last_unstale":"2024-04-26T07:51:40.441852+0000","last_undegraded":"2024-04-26T07:51:40.441852+0000","last_fullsized":"2024-04-26T07:51:40.441852+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:25.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408513+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:51:40.408513+0000","last_peered":"2024-04-26T07:51:40.408513+0000","last_clean":"2024-04-26T07:51:40.408513+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:51:40.408513+0000","last_undegraded":"2024-04-26T07:51:40.408513+0000","last_fullsized":"2024-04-26T07:51:40.408513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408684+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:40.408684+0000","last_peered":"2024-04-26T07:51:40.408684+0000","last_clean":"2024-04-26T07:51:40.408684+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:40.408684+0000","last_undegraded":"2024-04-26T07:51:40.408684+0000","last_fullsized":"2024-04-26T07:51:40.408684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"109'135","reported_seq":380,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807170+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:51:45.807170+0000","last_peered":"2024-04-26T07:51:45.807170+0000","last_clean":"2024-04-26T07:51:45.807170+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:51:45.807170+0000","last_undegraded":"2024-04-26T07:51:45.807170+0000","last_fullsized":"2024-04-26T07:51:45.807170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394363+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:40.394363+0000","last_peered":"2024-04-26T07:51:40.394363+0000","last_clean":"2024-04-26T07:51:40.394363+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:40.394363+0000","last_undegraded":"2024-04-26T07:51:40.394363+0000","last_fullsized":"2024-04-26T07:51:40.394363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390662+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:51:40.390662+0000","last_peered":"2024-04-26T07:51:40.390662+0000","last_clean":"2024-04-26T07:51:40.390662+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:51:40.390662+0000","last_undegraded":"2024-04-26T07:51:40.390662+0000","last_fullsized":"2024-04-26T07:51:40.390662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'19","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393883+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:40.393883+0000","last_peered":"2024-04-26T07:51:40.393883+0000","last_clean":"2024-04-26T07:51:40.393883+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:40.393883+0000","last_undegraded":"2024-04-26T07:51:40.393883+0000","last_fullsized":"2024-04-26T07:51:40.393883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410909+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:51:40.410909+0000","last_peered":"2024-04-26T07:51:40.410909+0000","last_clean":"2024-04-26T07:51:40.410909+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:51:40.410909+0000","last_undegraded":"2024-04-26T07:51:40.410909+0000","last_fullsized":"2024-04-26T07:51:40.410909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395337+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:40.395337+0000","last_peered":"2024-04-26T07:51:40.395337+0000","last_clean":"2024-04-26T07:51:40.395337+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:40.395337+0000","last_undegraded":"2024-04-26T07:51:40.395337+0000","last_fullsized":"2024-04-26T07:51:40.395337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400935+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:51:40.400935+0000","last_peered":"2024-04-26T07:51:40.400935+0000","last_clean":"2024-04-26T07:51:40.400935+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:51:40.400935+0000","last_undegraded":"2024-04-26T07:51:40.400935+0000","last_fullsized":"2024-04-26T07:51:40.400935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"109'135","reported_seq":352,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.804722+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:51:45.804722+0000","last_peered":"2024-04-26T07:51:45.804722+0000","last_clean":"2024-04-26T07:51:45.804722+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:51:45.804722+0000","last_undegraded":"2024-04-26T07:51:45.804722+0000","last_fullsized":"2024-04-26T07:51:45.804722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387074+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:40.387074+0000","last_peered":"2024-04-26T07:51:40.387074+0000","last_clean":"2024-04-26T07:51:40.387074+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:40.387074+0000","last_undegraded":"2024-04-26T07:51:40.387074+0000","last_fullsized":"2024-04-26T07:51:40.387074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395762+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:40.395762+0000","last_peered":"2024-04-26T07:51:40.395762+0000","last_clean":"2024-04-26T07:51:40.395762+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:40.395762+0000","last_undegraded":"2024-04-26T07:51:40.395762+0000","last_fullsized":"2024-04-26T07:51:40.395762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.389005+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:40.389005+0000","last_peered":"2024-04-26T07:51:40.389005+0000","last_clean":"2024-04-26T07:51:40.389005+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:40.389005+0000","last_undegraded":"2024-04-26T07:51:40.389005+0000","last_fullsized":"2024-04-26T07:51:40.389005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412692+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:51:40.412692+0000","last_peered":"2024-04-26T07:51:40.412692+0000","last_clean":"2024-04-26T07:51:40.412692+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:51:40.412692+0000","last_undegraded":"2024-04-26T07:51:40.412692+0000","last_fullsized":"2024-04-26T07:51:40.412692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":275,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390337+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:40.390337+0000","last_peered":"2024-04-26T07:51:40.390337+0000","last_clean":"2024-04-26T07:51:40.390337+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:40.390337+0000","last_undegraded":"2024-04-26T07:51:40.390337+0000","last_fullsized":"2024-04-26T07:51:40.390337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"90'44","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.419562+0000","last_change":"2024-04-26T07:51:40.419562+0000","last_active":"2024-04-26T07:51:40.419562+0000","last_peered":"2024-04-26T07:51:40.419562+0000","last_clean":"2024-04-26T07:51:40.419562+0000","last_became_active":"2024-04-26T07:51:40.418680+0000","last_became_peered":"2024-04-26T07:51:40.418680+0000","last_unstale":"2024-04-26T07:51:40.419562+0000","last_undegraded":"2024-04-26T07:51:40.419562+0000","last_fullsized":"2024-04-26T07:51:40.419562+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:42.333538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":24,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391389+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:51:40.391389+0000","last_peered":"2024-04-26T07:51:40.391389+0000","last_clean":"2024-04-26T07:51:40.391389+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:51:40.391389+0000","last_undegraded":"2024-04-26T07:51:40.391389+0000","last_fullsized":"2024-04-26T07:51:40.391389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413846+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:40.413846+0000","last_peered":"2024-04-26T07:51:40.413846+0000","last_clean":"2024-04-26T07:51:40.413846+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:40.413846+0000","last_undegraded":"2024-04-26T07:51:40.413846+0000","last_fullsized":"2024-04-26T07:51:40.413846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387849+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:40.387849+0000","last_peered":"2024-04-26T07:51:40.387849+0000","last_clean":"2024-04-26T07:51:40.387849+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:40.387849+0000","last_undegraded":"2024-04-26T07:51:40.387849+0000","last_fullsized":"2024-04-26T07:51:40.387849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396489+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:51:40.396489+0000","last_peered":"2024-04-26T07:51:40.396489+0000","last_clean":"2024-04-26T07:51:40.396489+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:51:40.396489+0000","last_undegraded":"2024-04-26T07:51:40.396489+0000","last_fullsized":"2024-04-26T07:51:40.396489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"89'31","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397695+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:40.397695+0000","last_peered":"2024-04-26T07:51:40.397695+0000","last_clean":"2024-04-26T07:51:40.397695+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:40.397695+0000","last_undegraded":"2024-04-26T07:51:40.397695+0000","last_fullsized":"2024-04-26T07:51:40.397695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408744+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:51:40.408744+0000","last_peered":"2024-04-26T07:51:40.408744+0000","last_clean":"2024-04-26T07:51:40.408744+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:51:40.408744+0000","last_undegraded":"2024-04-26T07:51:40.408744+0000","last_fullsized":"2024-04-26T07:51:40.408744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"90'19","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.389984+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:51:40.389984+0000","last_peered":"2024-04-26T07:51:40.389984+0000","last_clean":"2024-04-26T07:51:40.389984+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:51:40.389984+0000","last_undegraded":"2024-04-26T07:51:40.389984+0000","last_fullsized":"2024-04-26T07:51:40.389984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390188+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:51:40.390188+0000","last_peered":"2024-04-26T07:51:40.390188+0000","last_clean":"2024-04-26T07:51:40.390188+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:51:40.390188+0000","last_undegraded":"2024-04-26T07:51:40.390188+0000","last_fullsized":"2024-04-26T07:51:40.390188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393594+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:40.393594+0000","last_peered":"2024-04-26T07:51:40.393594+0000","last_clean":"2024-04-26T07:51:40.393594+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:40.393594+0000","last_undegraded":"2024-04-26T07:51:40.393594+0000","last_fullsized":"2024-04-26T07:51:40.393594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408560+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:51:40.408560+0000","last_peered":"2024-04-26T07:51:40.408560+0000","last_clean":"2024-04-26T07:51:40.408560+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:51:40.408560+0000","last_undegraded":"2024-04-26T07:51:40.408560+0000","last_fullsized":"2024-04-26T07:51:40.408560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'18","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.447435+0000","last_change":"2024-04-26T07:51:40.447435+0000","last_active":"2024-04-26T07:51:40.447435+0000","last_peered":"2024-04-26T07:51:40.447435+0000","last_clean":"2024-04-26T07:51:40.447435+0000","last_became_active":"2024-04-26T07:51:40.444446+0000","last_became_peered":"2024-04-26T07:51:40.444446+0000","last_unstale":"2024-04-26T07:51:40.447435+0000","last_undegraded":"2024-04-26T07:51:40.447435+0000","last_fullsized":"2024-04-26T07:51:40.447435+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:01.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":275,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392275+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:40.392275+0000","last_peered":"2024-04-26T07:51:40.392275+0000","last_clean":"2024-04-26T07:51:40.392275+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:40.392275+0000","last_undegraded":"2024-04-26T07:51:40.392275+0000","last_fullsized":"2024-04-26T07:51:40.392275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"101'10","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386065+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:51:40.386065+0000","last_peered":"2024-04-26T07:51:40.386065+0000","last_clean":"2024-04-26T07:51:40.386065+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:51:40.386065+0000","last_undegraded":"2024-04-26T07:51:40.386065+0000","last_fullsized":"2024-04-26T07:51:40.386065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432738+0000","last_change":"2024-04-26T07:51:40.432738+0000","last_active":"2024-04-26T07:51:40.432738+0000","last_peered":"2024-04-26T07:51:40.432738+0000","last_clean":"2024-04-26T07:51:40.432738+0000","last_became_active":"2024-04-26T07:51:40.431762+0000","last_became_peered":"2024-04-26T07:51:40.431762+0000","last_unstale":"2024-04-26T07:51:40.432738+0000","last_undegraded":"2024-04-26T07:51:40.432738+0000","last_fullsized":"2024-04-26T07:51:40.432738+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:25.659741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386934+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:40.386934+0000","last_peered":"2024-04-26T07:51:40.386934+0000","last_clean":"2024-04-26T07:51:40.386934+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:40.386934+0000","last_undegraded":"2024-04-26T07:51:40.386934+0000","last_fullsized":"2024-04-26T07:51:40.386934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391261+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:51:40.391261+0000","last_peered":"2024-04-26T07:51:40.391261+0000","last_clean":"2024-04-26T07:51:40.391261+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:51:40.391261+0000","last_undegraded":"2024-04-26T07:51:40.391261+0000","last_fullsized":"2024-04-26T07:51:40.391261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.416629+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:40.416629+0000","last_peered":"2024-04-26T07:51:40.416629+0000","last_clean":"2024-04-26T07:51:40.416629+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:40.416629+0000","last_undegraded":"2024-04-26T07:51:40.416629+0000","last_fullsized":"2024-04-26T07:51:40.416629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444554+0000","last_change":"2024-04-26T07:51:40.444554+0000","last_active":"2024-04-26T07:51:40.444554+0000","last_peered":"2024-04-26T07:51:40.444554+0000","last_clean":"2024-04-26T07:51:40.444554+0000","last_became_active":"2024-04-26T07:51:40.439845+0000","last_became_peered":"2024-04-26T07:51:40.439845+0000","last_unstale":"2024-04-26T07:51:40.444554+0000","last_undegraded":"2024-04-26T07:51:40.444554+0000","last_fullsized":"2024-04-26T07:51:40.444554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:41.631699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"90'20","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392088+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:51:40.392088+0000","last_peered":"2024-04-26T07:51:40.392088+0000","last_clean":"2024-04-26T07:51:40.392088+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:51:40.392088+0000","last_undegraded":"2024-04-26T07:51:40.392088+0000","last_fullsized":"2024-04-26T07:51:40.392088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409988+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:40.409988+0000","last_peered":"2024-04-26T07:51:40.409988+0000","last_clean":"2024-04-26T07:51:40.409988+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:40.409988+0000","last_undegraded":"2024-04-26T07:51:40.409988+0000","last_fullsized":"2024-04-26T07:51:40.409988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413668+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:40.413668+0000","last_peered":"2024-04-26T07:51:40.413668+0000","last_clean":"2024-04-26T07:51:40.413668+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:40.413668+0000","last_undegraded":"2024-04-26T07:51:40.413668+0000","last_fullsized":"2024-04-26T07:51:40.413668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390764+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:51:40.390764+0000","last_peered":"2024-04-26T07:51:40.390764+0000","last_clean":"2024-04-26T07:51:40.390764+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:51:40.390764+0000","last_undegraded":"2024-04-26T07:51:40.390764+0000","last_fullsized":"2024-04-26T07:51:40.390764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'25","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388325+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:40.388325+0000","last_peered":"2024-04-26T07:51:40.388325+0000","last_clean":"2024-04-26T07:51:40.388325+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:40.388325+0000","last_undegraded":"2024-04-26T07:51:40.388325+0000","last_fullsized":"2024-04-26T07:51:40.388325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409141+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:51:40.409141+0000","last_peered":"2024-04-26T07:51:40.409141+0000","last_clean":"2024-04-26T07:51:40.409141+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:51:40.409141+0000","last_undegraded":"2024-04-26T07:51:40.409141+0000","last_fullsized":"2024-04-26T07:51:40.409141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"90'18","reported_seq":160,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.418821+0000","last_change":"2024-04-26T07:51:40.418821+0000","last_active":"2024-04-26T07:51:40.418821+0000","last_peered":"2024-04-26T07:51:40.418821+0000","last_clean":"2024-04-26T07:51:40.418821+0000","last_became_active":"2024-04-26T07:51:40.417916+0000","last_became_peered":"2024-04-26T07:51:40.417916+0000","last_unstale":"2024-04-26T07:51:40.418821+0000","last_undegraded":"2024-04-26T07:51:40.418821+0000","last_fullsized":"2024-04-26T07:51:40.418821+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:36.135343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387218+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:51:40.387218+0000","last_peered":"2024-04-26T07:51:40.387218+0000","last_clean":"2024-04-26T07:51:40.387218+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:51:40.387218+0000","last_undegraded":"2024-04-26T07:51:40.387218+0000","last_fullsized":"2024-04-26T07:51:40.387218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412561+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:51:40.412561+0000","last_peered":"2024-04-26T07:51:40.412561+0000","last_clean":"2024-04-26T07:51:40.412561+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:51:40.412561+0000","last_undegraded":"2024-04-26T07:51:40.412561+0000","last_fullsized":"2024-04-26T07:51:40.412561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390860+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:40.390860+0000","last_peered":"2024-04-26T07:51:40.390860+0000","last_clean":"2024-04-26T07:51:40.390860+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:40.390860+0000","last_undegraded":"2024-04-26T07:51:40.390860+0000","last_fullsized":"2024-04-26T07:51:40.390860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388623+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:51:40.388623+0000","last_peered":"2024-04-26T07:51:40.388623+0000","last_clean":"2024-04-26T07:51:40.388623+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:51:40.388623+0000","last_undegraded":"2024-04-26T07:51:40.388623+0000","last_fullsized":"2024-04-26T07:51:40.388623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"90'29","reported_seq":220,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409906+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:51:40.409906+0000","last_peered":"2024-04-26T07:51:40.409906+0000","last_clean":"2024-04-26T07:51:40.409906+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:51:40.409906+0000","last_undegraded":"2024-04-26T07:51:40.409906+0000","last_fullsized":"2024-04-26T07:51:40.409906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414293+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:40.414293+0000","last_peered":"2024-04-26T07:51:40.414293+0000","last_clean":"2024-04-26T07:51:40.414293+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:40.414293+0000","last_undegraded":"2024-04-26T07:51:40.414293+0000","last_fullsized":"2024-04-26T07:51:40.414293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391766+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:40.391766+0000","last_peered":"2024-04-26T07:51:40.391766+0000","last_clean":"2024-04-26T07:51:40.391766+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:40.391766+0000","last_undegraded":"2024-04-26T07:51:40.391766+0000","last_fullsized":"2024-04-26T07:51:40.391766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388746+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:51:40.388746+0000","last_peered":"2024-04-26T07:51:40.388746+0000","last_clean":"2024-04-26T07:51:40.388746+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:51:40.388746+0000","last_undegraded":"2024-04-26T07:51:40.388746+0000","last_fullsized":"2024-04-26T07:51:40.388746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'16","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409372+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:51:40.409372+0000","last_peered":"2024-04-26T07:51:40.409372+0000","last_clean":"2024-04-26T07:51:40.409372+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:51:40.409372+0000","last_undegraded":"2024-04-26T07:51:40.409372+0000","last_fullsized":"2024-04-26T07:51:40.409372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412316+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:51:40.412316+0000","last_peered":"2024-04-26T07:51:40.412316+0000","last_clean":"2024-04-26T07:51:40.412316+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:51:40.412316+0000","last_undegraded":"2024-04-26T07:51:40.412316+0000","last_fullsized":"2024-04-26T07:51:40.412316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"90'25","reported_seq":170,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427441+0000","last_change":"2024-04-26T07:51:40.427441+0000","last_active":"2024-04-26T07:51:40.427441+0000","last_peered":"2024-04-26T07:51:40.427441+0000","last_clean":"2024-04-26T07:51:40.427441+0000","last_became_active":"2024-04-26T07:51:40.424476+0000","last_became_peered":"2024-04-26T07:51:40.424476+0000","last_unstale":"2024-04-26T07:51:40.427441+0000","last_undegraded":"2024-04-26T07:51:40.427441+0000","last_fullsized":"2024-04-26T07:51:40.427441+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:35.964067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410009+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:40.410009+0000","last_peered":"2024-04-26T07:51:40.410009+0000","last_clean":"2024-04-26T07:51:40.410009+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:40.410009+0000","last_undegraded":"2024-04-26T07:51:40.410009+0000","last_fullsized":"2024-04-26T07:51:40.410009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408176+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:40.408176+0000","last_peered":"2024-04-26T07:51:40.408176+0000","last_clean":"2024-04-26T07:51:40.408176+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:40.408176+0000","last_undegraded":"2024-04-26T07:51:40.408176+0000","last_fullsized":"2024-04-26T07:51:40.408176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393585+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:51:40.393585+0000","last_peered":"2024-04-26T07:51:40.393585+0000","last_clean":"2024-04-26T07:51:40.393585+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:51:40.393585+0000","last_undegraded":"2024-04-26T07:51:40.393585+0000","last_fullsized":"2024-04-26T07:51:40.393585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'31","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401530+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:40.401530+0000","last_peered":"2024-04-26T07:51:40.401530+0000","last_clean":"2024-04-26T07:51:40.401530+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:40.401530+0000","last_undegraded":"2024-04-26T07:51:40.401530+0000","last_fullsized":"2024-04-26T07:51:40.401530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399362+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:51:40.399362+0000","last_peered":"2024-04-26T07:51:40.399362+0000","last_clean":"2024-04-26T07:51:40.399362+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:51:40.399362+0000","last_undegraded":"2024-04-26T07:51:40.399362+0000","last_fullsized":"2024-04-26T07:51:40.399362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"90'19","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394701+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:51:40.394701+0000","last_peered":"2024-04-26T07:51:40.394701+0000","last_clean":"2024-04-26T07:51:40.394701+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:51:40.394701+0000","last_undegraded":"2024-04-26T07:51:40.394701+0000","last_fullsized":"2024-04-26T07:51:40.394701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409809+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:40.409809+0000","last_peered":"2024-04-26T07:51:40.409809+0000","last_clean":"2024-04-26T07:51:40.409809+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:40.409809+0000","last_undegraded":"2024-04-26T07:51:40.409809+0000","last_fullsized":"2024-04-26T07:51:40.409809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410392+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:40.410392+0000","last_peered":"2024-04-26T07:51:40.410392+0000","last_clean":"2024-04-26T07:51:40.410392+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:40.410392+0000","last_undegraded":"2024-04-26T07:51:40.410392+0000","last_fullsized":"2024-04-26T07:51:40.410392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399847+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:51:40.399847+0000","last_peered":"2024-04-26T07:51:40.399847+0000","last_clean":"2024-04-26T07:51:40.399847+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:51:40.399847+0000","last_undegraded":"2024-04-26T07:51:40.399847+0000","last_fullsized":"2024-04-26T07:51:40.399847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"88'18","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387314+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:40.387314+0000","last_peered":"2024-04-26T07:51:40.387314+0000","last_clean":"2024-04-26T07:51:40.387314+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:40.387314+0000","last_undegraded":"2024-04-26T07:51:40.387314+0000","last_fullsized":"2024-04-26T07:51:40.387314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410199+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:51:40.410199+0000","last_peered":"2024-04-26T07:51:40.410199+0000","last_clean":"2024-04-26T07:51:40.410199+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:51:40.410199+0000","last_undegraded":"2024-04-26T07:51:40.410199+0000","last_fullsized":"2024-04-26T07:51:40.410199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396852+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:51:40.396852+0000","last_peered":"2024-04-26T07:51:40.396852+0000","last_clean":"2024-04-26T07:51:40.396852+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:51:40.396852+0000","last_undegraded":"2024-04-26T07:51:40.396852+0000","last_fullsized":"2024-04-26T07:51:40.396852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"109'135","reported_seq":429,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807087+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:51:45.807087+0000","last_peered":"2024-04-26T07:51:45.807087+0000","last_clean":"2024-04-26T07:51:45.807087+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:51:45.807087+0000","last_undegraded":"2024-04-26T07:51:45.807087+0000","last_fullsized":"2024-04-26T07:51:45.807087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":136,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437366+0000","last_change":"2024-04-26T07:51:40.437366+0000","last_active":"2024-04-26T07:51:40.437366+0000","last_peered":"2024-04-26T07:51:40.437366+0000","last_clean":"2024-04-26T07:51:40.437366+0000","last_became_active":"2024-04-26T07:51:40.436379+0000","last_became_peered":"2024-04-26T07:51:40.436379+0000","last_unstale":"2024-04-26T07:51:40.437366+0000","last_undegraded":"2024-04-26T07:51:40.437366+0000","last_fullsized":"2024-04-26T07:51:40.437366+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:48:37.824192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396217+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:40.396217+0000","last_peered":"2024-04-26T07:51:40.396217+0000","last_clean":"2024-04-26T07:51:40.396217+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:40.396217+0000","last_undegraded":"2024-04-26T07:51:40.396217+0000","last_fullsized":"2024-04-26T07:51:40.396217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"89'14","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399466+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:40.399466+0000","last_peered":"2024-04-26T07:51:40.399466+0000","last_clean":"2024-04-26T07:51:40.399466+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:40.399466+0000","last_undegraded":"2024-04-26T07:51:40.399466+0000","last_fullsized":"2024-04-26T07:51:40.399466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:16.352834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428700+0000","last_change":"2024-04-26T07:51:40.428700+0000","last_active":"2024-04-26T07:51:40.428700+0000","last_peered":"2024-04-26T07:51:40.428700+0000","last_clean":"2024-04-26T07:51:40.428700+0000","last_became_active":"2024-04-26T07:51:40.427906+0000","last_became_peered":"2024-04-26T07:51:40.427906+0000","last_unstale":"2024-04-26T07:51:40.428700+0000","last_undegraded":"2024-04-26T07:51:40.428700+0000","last_fullsized":"2024-04-26T07:51:40.428700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:31.624570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"90'23","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410799+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:51:40.410799+0000","last_peered":"2024-04-26T07:51:40.410799+0000","last_clean":"2024-04-26T07:51:40.410799+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:51:40.410799+0000","last_undegraded":"2024-04-26T07:51:40.410799+0000","last_fullsized":"2024-04-26T07:51:40.410799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385502+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:51:40.385502+0000","last_peered":"2024-04-26T07:51:40.385502+0000","last_clean":"2024-04-26T07:51:40.385502+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:51:40.385502+0000","last_undegraded":"2024-04-26T07:51:40.385502+0000","last_fullsized":"2024-04-26T07:51:40.385502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433368+0000","last_change":"2024-04-26T07:51:40.433368+0000","last_active":"2024-04-26T07:51:40.433368+0000","last_peered":"2024-04-26T07:51:40.433368+0000","last_clean":"2024-04-26T07:51:40.433368+0000","last_became_active":"2024-04-26T07:51:40.432230+0000","last_became_peered":"2024-04-26T07:51:40.432230+0000","last_unstale":"2024-04-26T07:51:40.433368+0000","last_undegraded":"2024-04-26T07:51:40.433368+0000","last_fullsized":"2024-04-26T07:51:40.433368+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:04.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401063+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:51:40.401063+0000","last_peered":"2024-04-26T07:51:40.401063+0000","last_clean":"2024-04-26T07:51:40.401063+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:51:40.401063+0000","last_undegraded":"2024-04-26T07:51:40.401063+0000","last_fullsized":"2024-04-26T07:51:40.401063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"90'28","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415147+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:51:40.415147+0000","last_peered":"2024-04-26T07:51:40.415147+0000","last_clean":"2024-04-26T07:51:40.415147+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:51:40.415147+0000","last_undegraded":"2024-04-26T07:51:40.415147+0000","last_fullsized":"2024-04-26T07:51:40.415147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115343360,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413866+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:51:40.413866+0000","last_peered":"2024-04-26T07:51:40.413866+0000","last_clean":"2024-04-26T07:51:40.413866+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:51:40.413866+0000","last_undegraded":"2024-04-26T07:51:40.413866+0000","last_fullsized":"2024-04-26T07:51:40.413866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"90'18","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385678+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:40.385678+0000","last_peered":"2024-04-26T07:51:40.385678+0000","last_clean":"2024-04-26T07:51:40.385678+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:40.385678+0000","last_undegraded":"2024-04-26T07:51:40.385678+0000","last_fullsized":"2024-04-26T07:51:40.385678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408447+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:40.408447+0000","last_peered":"2024-04-26T07:51:40.408447+0000","last_clean":"2024-04-26T07:51:40.408447+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:40.408447+0000","last_undegraded":"2024-04-26T07:51:40.408447+0000","last_fullsized":"2024-04-26T07:51:40.408447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393764+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:40.393764+0000","last_peered":"2024-04-26T07:51:40.393764+0000","last_clean":"2024-04-26T07:51:40.393764+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:40.393764+0000","last_undegraded":"2024-04-26T07:51:40.393764+0000","last_fullsized":"2024-04-26T07:51:40.393764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391427+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:40.391427+0000","last_peered":"2024-04-26T07:51:40.391427+0000","last_clean":"2024-04-26T07:51:40.391427+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:40.391427+0000","last_undegraded":"2024-04-26T07:51:40.391427+0000","last_fullsized":"2024-04-26T07:51:40.391427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'27","reported_seq":163,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399353+0000","last_change":"2024-04-26T07:49:08.971107+0000","last_active":"2024-04-26T07:51:40.399353+0000","last_peered":"2024-04-26T07:51:40.399353+0000","last_clean":"2024-04-26T07:51:40.399353+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:51:40.399353+0000","last_undegraded":"2024-04-26T07:51:40.399353+0000","last_fullsized":"2024-04-26T07:51:40.399353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:06.980641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394746+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:40.394746+0000","last_peered":"2024-04-26T07:51:40.394746+0000","last_clean":"2024-04-26T07:51:40.394746+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:40.394746+0000","last_undegraded":"2024-04-26T07:51:40.394746+0000","last_fullsized":"2024-04-26T07:51:40.394746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"90'13","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392754+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:51:40.392754+0000","last_peered":"2024-04-26T07:51:40.392754+0000","last_clean":"2024-04-26T07:51:40.392754+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:51:40.392754+0000","last_undegraded":"2024-04-26T07:51:40.392754+0000","last_fullsized":"2024-04-26T07:51:40.392754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395141+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:40.395141+0000","last_peered":"2024-04-26T07:51:40.395141+0000","last_clean":"2024-04-26T07:51:40.395141+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:40.395141+0000","last_undegraded":"2024-04-26T07:51:40.395141+0000","last_fullsized":"2024-04-26T07:51:40.395141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":128,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.446873+0000","last_change":"2024-04-26T07:51:40.446873+0000","last_active":"2024-04-26T07:51:40.446873+0000","last_peered":"2024-04-26T07:51:40.446873+0000","last_clean":"2024-04-26T07:51:40.446873+0000","last_became_active":"2024-04-26T07:51:40.440377+0000","last_became_peered":"2024-04-26T07:51:40.440377+0000","last_unstale":"2024-04-26T07:51:40.446873+0000","last_undegraded":"2024-04-26T07:51:40.446873+0000","last_fullsized":"2024-04-26T07:51:40.446873+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:01.888159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395378+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:40.395378+0000","last_peered":"2024-04-26T07:51:40.395378+0000","last_clean":"2024-04-26T07:51:40.395378+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:40.395378+0000","last_undegraded":"2024-04-26T07:51:40.395378+0000","last_fullsized":"2024-04-26T07:51:40.395378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'25","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388214+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:40.388214+0000","last_peered":"2024-04-26T07:51:40.388214+0000","last_clean":"2024-04-26T07:51:40.388214+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:40.388214+0000","last_undegraded":"2024-04-26T07:51:40.388214+0000","last_fullsized":"2024-04-26T07:51:40.388214+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:34.437375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408789+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:51:40.408789+0000","last_peered":"2024-04-26T07:51:40.408789+0000","last_clean":"2024-04-26T07:51:40.408789+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:51:40.408789+0000","last_undegraded":"2024-04-26T07:51:40.408789+0000","last_fullsized":"2024-04-26T07:51:40.408789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"90'17","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400133+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:51:40.400133+0000","last_peered":"2024-04-26T07:51:40.400133+0000","last_clean":"2024-04-26T07:51:40.400133+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:51:40.400133+0000","last_undegraded":"2024-04-26T07:51:40.400133+0000","last_fullsized":"2024-04-26T07:51:40.400133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387124+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:51:40.387124+0000","last_peered":"2024-04-26T07:51:40.387124+0000","last_clean":"2024-04-26T07:51:40.387124+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:40.387124+0000","last_undegraded":"2024-04-26T07:51:40.387124+0000","last_fullsized":"2024-04-26T07:51:40.387124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399528+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:40.399528+0000","last_peered":"2024-04-26T07:51:40.399528+0000","last_clean":"2024-04-26T07:51:40.399528+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:40.399528+0000","last_undegraded":"2024-04-26T07:51:40.399528+0000","last_fullsized":"2024-04-26T07:51:40.399528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410351+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:51:40.410351+0000","last_peered":"2024-04-26T07:51:40.410351+0000","last_clean":"2024-04-26T07:51:40.410351+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:51:40.410351+0000","last_undegraded":"2024-04-26T07:51:40.410351+0000","last_fullsized":"2024-04-26T07:51:40.410351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408072+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:51:40.408072+0000","last_peered":"2024-04-26T07:51:40.408072+0000","last_clean":"2024-04-26T07:51:40.408072+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:51:40.408072+0000","last_undegraded":"2024-04-26T07:51:40.408072+0000","last_fullsized":"2024-04-26T07:51:40.408072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410664+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:51:40.410664+0000","last_peered":"2024-04-26T07:51:40.410664+0000","last_clean":"2024-04-26T07:51:40.410664+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:51:40.410664+0000","last_undegraded":"2024-04-26T07:51:40.410664+0000","last_fullsized":"2024-04-26T07:51:40.410664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'26","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398857+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:51:40.398857+0000","last_peered":"2024-04-26T07:51:40.398857+0000","last_clean":"2024-04-26T07:51:40.398857+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:51:40.398857+0000","last_undegraded":"2024-04-26T07:51:40.398857+0000","last_fullsized":"2024-04-26T07:51:40.398857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414531+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:51:40.414531+0000","last_peered":"2024-04-26T07:51:40.414531+0000","last_clean":"2024-04-26T07:51:40.414531+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:51:40.414531+0000","last_undegraded":"2024-04-26T07:51:40.414531+0000","last_fullsized":"2024-04-26T07:51:40.414531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"89'18","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414182+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:40.414182+0000","last_peered":"2024-04-26T07:51:40.414182+0000","last_clean":"2024-04-26T07:51:40.414182+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:40.414182+0000","last_undegraded":"2024-04-26T07:51:40.414182+0000","last_fullsized":"2024-04-26T07:51:40.414182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409820+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:51:40.409820+0000","last_peered":"2024-04-26T07:51:40.409820+0000","last_clean":"2024-04-26T07:51:40.409820+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:51:40.409820+0000","last_undegraded":"2024-04-26T07:51:40.409820+0000","last_fullsized":"2024-04-26T07:51:40.409820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'23","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387539+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:40.387539+0000","last_peered":"2024-04-26T07:51:40.387539+0000","last_clean":"2024-04-26T07:51:40.387539+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:40.387539+0000","last_undegraded":"2024-04-26T07:51:40.387539+0000","last_fullsized":"2024-04-26T07:51:40.387539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392517+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:51:40.392517+0000","last_peered":"2024-04-26T07:51:40.392517+0000","last_clean":"2024-04-26T07:51:40.392517+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:51:40.392517+0000","last_undegraded":"2024-04-26T07:51:40.392517+0000","last_fullsized":"2024-04-26T07:51:40.392517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'32","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393638+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:40.393638+0000","last_peered":"2024-04-26T07:51:40.393638+0000","last_clean":"2024-04-26T07:51:40.393638+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:40.393638+0000","last_undegraded":"2024-04-26T07:51:40.393638+0000","last_fullsized":"2024-04-26T07:51:40.393638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401267+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:51:40.401267+0000","last_peered":"2024-04-26T07:51:40.401267+0000","last_clean":"2024-04-26T07:51:40.401267+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:51:40.401267+0000","last_undegraded":"2024-04-26T07:51:40.401267+0000","last_fullsized":"2024-04-26T07:51:40.401267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"89'35","reported_seq":227,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410520+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:40.410520+0000","last_peered":"2024-04-26T07:51:40.410520+0000","last_clean":"2024-04-26T07:51:40.410520+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:40.410520+0000","last_undegraded":"2024-04-26T07:51:40.410520+0000","last_fullsized":"2024-04-26T07:51:40.410520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391161+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:51:40.391161+0000","last_peered":"2024-04-26T07:51:40.391161+0000","last_clean":"2024-04-26T07:51:40.391161+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:51:40.391161+0000","last_undegraded":"2024-04-26T07:51:40.391161+0000","last_fullsized":"2024-04-26T07:51:40.391161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"89'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412598+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:51:40.412598+0000","last_peered":"2024-04-26T07:51:40.412598+0000","last_clean":"2024-04-26T07:51:40.412598+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:51:40.412598+0000","last_undegraded":"2024-04-26T07:51:40.412598+0000","last_fullsized":"2024-04-26T07:51:40.412598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407803+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:51:40.407803+0000","last_peered":"2024-04-26T07:51:40.407803+0000","last_clean":"2024-04-26T07:51:40.407803+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:51:40.407803+0000","last_undegraded":"2024-04-26T07:51:40.407803+0000","last_fullsized":"2024-04-26T07:51:40.407803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'29","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394239+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:40.394239+0000","last_peered":"2024-04-26T07:51:40.394239+0000","last_clean":"2024-04-26T07:51:40.394239+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:40.394239+0000","last_undegraded":"2024-04-26T07:51:40.394239+0000","last_fullsized":"2024-04-26T07:51:40.394239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388114+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:51:40.388114+0000","last_peered":"2024-04-26T07:51:40.388114+0000","last_clean":"2024-04-26T07:51:40.388114+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:51:40.388114+0000","last_undegraded":"2024-04-26T07:51:40.388114+0000","last_fullsized":"2024-04-26T07:51:40.388114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'24","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410876+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:40.410876+0000","last_peered":"2024-04-26T07:51:40.410876+0000","last_clean":"2024-04-26T07:51:40.410876+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:40.410876+0000","last_undegraded":"2024-04-26T07:51:40.410876+0000","last_fullsized":"2024-04-26T07:51:40.410876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397867+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:51:40.397867+0000","last_peered":"2024-04-26T07:51:40.397867+0000","last_clean":"2024-04-26T07:51:40.397867+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:51:40.397867+0000","last_undegraded":"2024-04-26T07:51:40.397867+0000","last_fullsized":"2024-04-26T07:51:40.397867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'21","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391523+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:40.391523+0000","last_peered":"2024-04-26T07:51:40.391523+0000","last_clean":"2024-04-26T07:51:40.391523+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:40.391523+0000","last_undegraded":"2024-04-26T07:51:40.391523+0000","last_fullsized":"2024-04-26T07:51:40.391523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399068+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:51:40.399068+0000","last_peered":"2024-04-26T07:51:40.399068+0000","last_clean":"2024-04-26T07:51:40.399068+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:51:40.399068+0000","last_undegraded":"2024-04-26T07:51:40.399068+0000","last_fullsized":"2024-04-26T07:51:40.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'14","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414006+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:51:40.414006+0000","last_peered":"2024-04-26T07:51:40.414006+0000","last_clean":"2024-04-26T07:51:40.414006+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:51:40.414006+0000","last_undegraded":"2024-04-26T07:51:40.414006+0000","last_fullsized":"2024-04-26T07:51:40.414006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398879+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:51:40.398879+0000","last_peered":"2024-04-26T07:51:40.398879+0000","last_clean":"2024-04-26T07:51:40.398879+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:51:40.398879+0000","last_undegraded":"2024-04-26T07:51:40.398879+0000","last_fullsized":"2024-04-26T07:51:40.398879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'27","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387769+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:40.387769+0000","last_peered":"2024-04-26T07:51:40.387769+0000","last_clean":"2024-04-26T07:51:40.387769+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:40.387769+0000","last_undegraded":"2024-04-26T07:51:40.387769+0000","last_fullsized":"2024-04-26T07:51:40.387769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":162,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428116+0000","last_change":"2024-04-26T07:51:40.428116+0000","last_active":"2024-04-26T07:51:40.428116+0000","last_peered":"2024-04-26T07:51:40.428116+0000","last_clean":"2024-04-26T07:51:40.428116+0000","last_became_active":"2024-04-26T07:51:40.427193+0000","last_became_peered":"2024-04-26T07:51:40.427193+0000","last_unstale":"2024-04-26T07:51:40.428116+0000","last_undegraded":"2024-04-26T07:51:40.428116+0000","last_fullsized":"2024-04-26T07:51:40.428116+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:06.591882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'21","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411819+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:40.411819+0000","last_peered":"2024-04-26T07:51:40.411819+0000","last_clean":"2024-04-26T07:51:40.411819+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:40.411819+0000","last_undegraded":"2024-04-26T07:51:40.411819+0000","last_fullsized":"2024-04-26T07:51:40.411819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386601+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:51:40.386601+0000","last_peered":"2024-04-26T07:51:40.386601+0000","last_clean":"2024-04-26T07:51:40.386601+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:51:40.386601+0000","last_undegraded":"2024-04-26T07:51:40.386601+0000","last_fullsized":"2024-04-26T07:51:40.386601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'27","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.449013+0000","last_change":"2024-04-26T07:51:40.449013+0000","last_active":"2024-04-26T07:51:40.449013+0000","last_peered":"2024-04-26T07:51:40.449013+0000","last_clean":"2024-04-26T07:51:40.449013+0000","last_became_active":"2024-04-26T07:51:40.445977+0000","last_became_peered":"2024-04-26T07:51:40.445977+0000","last_unstale":"2024-04-26T07:51:40.449013+0000","last_undegraded":"2024-04-26T07:51:40.449013+0000","last_fullsized":"2024-04-26T07:51:40.449013+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:19.331650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391050+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:51:40.391050+0000","last_peered":"2024-04-26T07:51:40.391050+0000","last_clean":"2024-04-26T07:51:40.391050+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:51:40.391050+0000","last_undegraded":"2024-04-26T07:51:40.391050+0000","last_fullsized":"2024-04-26T07:51:40.391050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"89'32","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399748+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:51:40.399748+0000","last_peered":"2024-04-26T07:51:40.399748+0000","last_clean":"2024-04-26T07:51:40.399748+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:51:40.399748+0000","last_undegraded":"2024-04-26T07:51:40.399748+0000","last_fullsized":"2024-04-26T07:51:40.399748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":169,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436803+0000","last_change":"2024-04-26T07:51:40.436803+0000","last_active":"2024-04-26T07:51:40.436803+0000","last_peered":"2024-04-26T07:51:40.436803+0000","last_clean":"2024-04-26T07:51:40.436803+0000","last_became_active":"2024-04-26T07:51:40.433471+0000","last_became_peered":"2024-04-26T07:51:40.433471+0000","last_unstale":"2024-04-26T07:51:40.436803+0000","last_undegraded":"2024-04-26T07:51:40.436803+0000","last_fullsized":"2024-04-26T07:51:40.436803+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:23.227977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'22","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417251+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:40.417251+0000","last_peered":"2024-04-26T07:51:40.417251+0000","last_clean":"2024-04-26T07:51:40.417251+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:40.417251+0000","last_undegraded":"2024-04-26T07:51:40.417251+0000","last_fullsized":"2024-04-26T07:51:40.417251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":32,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"89'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410612+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:40.410612+0000","last_peered":"2024-04-26T07:51:40.410612+0000","last_clean":"2024-04-26T07:51:40.410612+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:40.410612+0000","last_undegraded":"2024-04-26T07:51:40.410612+0000","last_fullsized":"2024-04-26T07:51:40.410612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388025+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:51:40.388025+0000","last_peered":"2024-04-26T07:51:40.388025+0000","last_clean":"2024-04-26T07:51:40.388025+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:51:40.388025+0000","last_undegraded":"2024-04-26T07:51:40.388025+0000","last_fullsized":"2024-04-26T07:51:40.388025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'29","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409213+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:51:40.409213+0000","last_peered":"2024-04-26T07:51:40.409213+0000","last_clean":"2024-04-26T07:51:40.409213+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:51:40.409213+0000","last_undegraded":"2024-04-26T07:51:40.409213+0000","last_fullsized":"2024-04-26T07:51:40.409213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415075+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:51:40.415075+0000","last_peered":"2024-04-26T07:51:40.415075+0000","last_clean":"2024-04-26T07:51:40.415075+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:51:40.415075+0000","last_undegraded":"2024-04-26T07:51:40.415075+0000","last_fullsized":"2024-04-26T07:51:40.415075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1082,"ondisk_log_size":1082,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":852,"num_read_kb":617,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":761,"ondisk_log_size":761,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1446,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1716656,"kb_used_data":1685480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92655184,"statfs":{"total":96636764160,"available":94878908416,"internally_reserved":0,"allocated":1725931520,"data_stored":1725333608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203988,"kb_used_data":1172812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93167852,"statfs":{"total":96636764160,"available":95403880448,"internally_reserved":0,"allocated":1200959488,"data_stored":1200395317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812528,"kb_used_data":1777192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92559312,"statfs":{"total":96636764160,"available":94780735488,"internally_reserved":0,"allocated":1819844608,"data_stored":1819232747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1935060,"kb_used_data":1903876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92436780,"statfs":{"total":96636764160,"available":94655262720,"internally_reserved":0,"allocated":1949569024,"data_stored":1949020427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1877936,"kb_used_data":1842600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92493904,"statfs":{"total":96636764160,"available":94713757696,"internally_reserved":0,"allocated":1886822400,"data_stored":1886225804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1122120,"kb_used_data":1086784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93249720,"statfs":{"total":96636764160,"available":95487713280,"internally_reserved":0,"allocated":1112866816,"data_stored":1112315550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185700,"kb_used_data":1150364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93186140,"statfs":{"total":96636764160,"available":95422607360,"internally_reserved":0,"allocated":1177972736,"data_stored":1177387279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1732984,"kb_used_data":1697636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92638856,"statfs":{"total":96636764160,"available":94862188544,"internally_reserved":0,"allocated":1738379264,"data_stored":1737800572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1736441856,"data_stored":1736441856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1176502272,"data_stored":1176502272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1885339648,"data_stored":1885339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1948254208,"data_stored":1948254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1199570944,"data_stored":1199570944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1723858944,"data_stored":1723858944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":118226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":235872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":118389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:51:57.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T07:51:58.004 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:51:58.004 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":109,"fsid":"49487ed9-d16e-45ed-bfa2-5a4b8da36b24","created":"2024-04-26T07:48:02.780799+0000","modified":"2024-04-26T07:51:40.376294+0000","last_up_change":"2024-04-26T07:48:13.428691+0000","last_in_change":"2024-04-26T07:48:05.145685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T07:48:13.824353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T07:48:13.909036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T07:48:20.264760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T07:48:21.834004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T07:48:23.784334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T07:48:25.689056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T07:48:27.593594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T07:48:29.723741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c19b301-d4c3-4075-aea7-ab2ee53aaf3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6818","nonce":3522703831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6822","nonce":3522703831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6831","nonce":3522703831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":3522703831},{"type":"v1","addr":"172.21.15.53:6827","nonce":3522703831}]},"public_addr":"172.21.15.53:6818/3522703831","cluster_addr":"172.21.15.53:6822/3522703831","heartbeat_back_addr":"172.21.15.53:6831/3522703831","heartbeat_front_addr":"172.21.15.53:6827/3522703831","state":["exists","up"]},{"osd":1,"uuid":"639db176-ee73-4aa3-aa4b-e1e713fb0026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6802","nonce":4143904497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6806","nonce":4143904497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6814","nonce":4143904497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":4143904497},{"type":"v1","addr":"172.21.15.53:6810","nonce":4143904497}]},"public_addr":"172.21.15.53:6802/4143904497","cluster_addr":"172.21.15.53:6806/4143904497","heartbeat_back_addr":"172.21.15.53:6814/4143904497","heartbeat_front_addr":"172.21.15.53:6810/4143904497","state":["exists","up"]},{"osd":2,"uuid":"f2832add-3da3-4a41-b7eb-80c0b58a6166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6819","nonce":2446521991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6823","nonce":2446521991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6829","nonce":2446521991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":2446521991},{"type":"v1","addr":"172.21.15.53:6826","nonce":2446521991}]},"public_addr":"172.21.15.53:6819/2446521991","cluster_addr":"172.21.15.53:6823/2446521991","heartbeat_back_addr":"172.21.15.53:6829/2446521991","heartbeat_front_addr":"172.21.15.53:6826/2446521991","state":["exists","up"]},{"osd":3,"uuid":"e532d54a-ed1f-4177-8289-2eea90fe5d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6803","nonce":3123753498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6807","nonce":3123753498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6813","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6815","nonce":3123753498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3123753498},{"type":"v1","addr":"172.21.15.53:6811","nonce":3123753498}]},"public_addr":"172.21.15.53:6803/3123753498","cluster_addr":"172.21.15.53:6807/3123753498","heartbeat_back_addr":"172.21.15.53:6815/3123753498","heartbeat_front_addr":"172.21.15.53:6811/3123753498","state":["exists","up"]},{"osd":4,"uuid":"17337c8b-3ed8-41fb-900b-e7068a4cc2e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6817","nonce":4225192245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6820","nonce":4225192245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6827","nonce":4225192245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":4225192245},{"type":"v1","addr":"172.21.15.191:6823","nonce":4225192245}]},"public_addr":"172.21.15.191:6817/4225192245","cluster_addr":"172.21.15.191:6820/4225192245","heartbeat_back_addr":"172.21.15.191:6827/4225192245","heartbeat_front_addr":"172.21.15.191:6823/4225192245","state":["exists","up"]},{"osd":5,"uuid":"99310d57-c1a3-4935-9bbf-908dd237036d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6801","nonce":1158804178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6803","nonce":1158804178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6808","nonce":1158804178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1158804178},{"type":"v1","addr":"172.21.15.191:6805","nonce":1158804178}]},"public_addr":"172.21.15.191:6801/1158804178","cluster_addr":"172.21.15.191:6803/1158804178","heartbeat_back_addr":"172.21.15.191:6808/1158804178","heartbeat_front_addr":"172.21.15.191:6805/1158804178","state":["exists","up"]},{"osd":6,"uuid":"2fef5c6a-e83d-4ab2-b571-794295b6fe31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6809","nonce":451207779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6811","nonce":451207779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6815","nonce":451207779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":451207779},{"type":"v1","addr":"172.21.15.191:6813","nonce":451207779}]},"public_addr":"172.21.15.191:6809/451207779","cluster_addr":"172.21.15.191:6811/451207779","heartbeat_back_addr":"172.21.15.191:6815/451207779","heartbeat_front_addr":"172.21.15.191:6813/451207779","state":["exists","up"]},{"osd":7,"uuid":"82fb2b9a-7a8d-4af8-ab0e-94da703625ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6819","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6821","nonce":2025100830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6826","nonce":2025100830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6831","nonce":2025100830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2025100830},{"type":"v1","addr":"172.21.15.191:6829","nonce":2025100830}]},"public_addr":"172.21.15.191:6821/2025100830","cluster_addr":"172.21.15.191:6826/2025100830","heartbeat_back_addr":"172.21.15.191:6831/2025100830","heartbeat_front_addr":"172.21.15.191:6829/2025100830","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.773775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.751251+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.671594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.697516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.606898+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.566440+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T07:48:10.783389+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.f","osds":[3,0]}],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T07:51:59.022 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T07:51:59.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:51:59.188 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:51:59.188 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:51:59.188 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:51:59.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T07:51:59.491 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T07:51:59.511 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T07:51:59.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:51:59.654 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:51:59.654 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:51:59.654 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:51:59.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T07:51:59.959 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T07:51:59.979 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T07:51:59.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:52:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:52:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:52:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:52:00.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T07:52:00.420 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T07:52:00.439 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T07:52:00.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:52:00.580 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:52:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:52:00.580 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:52:00.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T07:52:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T07:52:00.901 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T07:52:00.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:52:01.055 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:52:01.055 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:52:01.055 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:52:01.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T07:52:01.363 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T07:52:01.382 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T07:52:01.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:52:01.539 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:52:01.539 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:52:01.539 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:52:01.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T07:52:01.849 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T07:52:01.868 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T07:52:01.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:52:02.015 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:52:02.016 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:52:02.016 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:52:02.030 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T07:52:02.321 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T07:52:02.341 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T07:52:02.342 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T07:52:02.497 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-26T07:52:02.497 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T07:52:02.497 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-26T07:52:02.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T07:52:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T07:52:02.823 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:52:03.175 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:52:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:52:03.195 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-04-26T07:52:01.857544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620002,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5012,"num_read_kb":3913,"num_write":4425,"num_write_kb":6187918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5536,"ondisk_log_size":5536,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":303240,"kb_used_data":11640,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754671480,"statfs":{"total":773094113280,"available":772783595520,"internally_reserved":0,"allocated":11919360,"data_stored":7319428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195938,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1727,"num_read_kb":939,"num_write":1580,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005313"},"pg_stats":[{"pgid":"3.3f","version":"109'54","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.334534+0000","last_change":"2024-04-26T07:51:40.419563+0000","last_active":"2024-04-26T07:51:56.334534+0000","last_peered":"2024-04-26T07:51:56.334534+0000","last_clean":"2024-04-26T07:51:56.334534+0000","last_became_active":"2024-04-26T07:51:40.418691+0000","last_became_peered":"2024-04-26T07:51:40.418691+0000","last_unstale":"2024-04-26T07:51:56.334534+0000","last_undegraded":"2024-04-26T07:51:56.334534+0000","last_fullsized":"2024-04-26T07:51:56.334534+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:26.560585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410032+0000","last_change":"2024-04-26T07:48:23.532584+0000","last_active":"2024-04-26T07:51:40.410032+0000","last_peered":"2024-04-26T07:51:40.410032+0000","last_clean":"2024-04-26T07:51:40.410032+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:51:40.410032+0000","last_undegraded":"2024-04-26T07:51:40.410032+0000","last_fullsized":"2024-04-26T07:51:40.410032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"109'52","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.369559+0000","last_change":"2024-04-26T07:48:21.492761+0000","last_active":"2024-04-26T07:51:56.369559+0000","last_peered":"2024-04-26T07:51:56.369559+0000","last_clean":"2024-04-26T07:51:56.369559+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:51:56.369559+0000","last_undegraded":"2024-04-26T07:51:56.369559+0000","last_fullsized":"2024-04-26T07:51:56.369559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":144,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.439485+0000","last_change":"2024-04-26T07:51:40.439485+0000","last_active":"2024-04-26T07:51:40.439485+0000","last_peered":"2024-04-26T07:51:40.439485+0000","last_clean":"2024-04-26T07:51:40.439485+0000","last_became_active":"2024-04-26T07:51:40.437448+0000","last_became_peered":"2024-04-26T07:51:40.437448+0000","last_unstale":"2024-04-26T07:51:40.439485+0000","last_undegraded":"2024-04-26T07:51:40.439485+0000","last_fullsized":"2024-04-26T07:51:40.439485+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:31.108593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"109'42","reported_seq":233,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.358444+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:56.358444+0000","last_peered":"2024-04-26T07:51:56.358444+0000","last_clean":"2024-04-26T07:51:56.358444+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:56.358444+0000","last_undegraded":"2024-04-26T07:51:56.358444+0000","last_fullsized":"2024-04-26T07:51:56.358444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":226,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400767+0000","last_change":"2024-04-26T07:48:23.540610+0000","last_active":"2024-04-26T07:51:40.400767+0000","last_peered":"2024-04-26T07:51:40.400767+0000","last_clean":"2024-04-26T07:51:40.400767+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:51:40.400767+0000","last_undegraded":"2024-04-26T07:51:40.400767+0000","last_fullsized":"2024-04-26T07:51:40.400767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"109'44","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.344354+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:56.344354+0000","last_peered":"2024-04-26T07:51:56.344354+0000","last_clean":"2024-04-26T07:51:56.344354+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:56.344354+0000","last_undegraded":"2024-04-26T07:51:56.344354+0000","last_fullsized":"2024-04-26T07:51:56.344354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:00.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387443+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:40.387443+0000","last_peered":"2024-04-26T07:51:40.387443+0000","last_clean":"2024-04-26T07:51:40.387443+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:40.387443+0000","last_undegraded":"2024-04-26T07:51:40.387443+0000","last_fullsized":"2024-04-26T07:51:40.387443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'46","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.411959+0000","last_change":"2024-04-26T07:51:40.435742+0000","last_active":"2024-04-26T07:51:56.411959+0000","last_peered":"2024-04-26T07:51:56.411959+0000","last_clean":"2024-04-26T07:51:56.411959+0000","last_became_active":"2024-04-26T07:51:40.433215+0000","last_became_peered":"2024-04-26T07:51:40.433215+0000","last_unstale":"2024-04-26T07:51:56.411959+0000","last_undegraded":"2024-04-26T07:51:56.411959+0000","last_fullsized":"2024-04-26T07:51:56.411959+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:42.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411494+0000","last_change":"2024-04-26T07:48:23.543763+0000","last_active":"2024-04-26T07:51:40.411494+0000","last_peered":"2024-04-26T07:51:40.411494+0000","last_clean":"2024-04-26T07:51:40.411494+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:51:40.411494+0000","last_undegraded":"2024-04-26T07:51:40.411494+0000","last_fullsized":"2024-04-26T07:51:40.411494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:31.589860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"109'44","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.181739+0000","last_change":"2024-04-26T07:48:21.524293+0000","last_active":"2024-04-26T07:51:56.181739+0000","last_peered":"2024-04-26T07:51:56.181739+0000","last_clean":"2024-04-26T07:51:56.181739+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:51:56.181739+0000","last_undegraded":"2024-04-26T07:51:56.181739+0000","last_fullsized":"2024-04-26T07:51:56.181739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396370+0000","last_change":"2024-04-26T07:48:23.544381+0000","last_active":"2024-04-26T07:51:40.396370+0000","last_peered":"2024-04-26T07:51:40.396370+0000","last_clean":"2024-04-26T07:51:40.396370+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:51:40.396370+0000","last_undegraded":"2024-04-26T07:51:40.396370+0000","last_fullsized":"2024-04-26T07:51:40.396370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"109'36","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.352764+0000","last_change":"2024-04-26T07:51:40.429122+0000","last_active":"2024-04-26T07:51:56.352764+0000","last_peered":"2024-04-26T07:51:56.352764+0000","last_clean":"2024-04-26T07:51:56.352764+0000","last_became_active":"2024-04-26T07:51:40.428267+0000","last_became_peered":"2024-04-26T07:51:40.428267+0000","last_unstale":"2024-04-26T07:51:56.352764+0000","last_undegraded":"2024-04-26T07:51:56.352764+0000","last_fullsized":"2024-04-26T07:51:56.352764+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.892584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":46,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414674+0000","last_change":"2024-04-26T07:48:23.529357+0000","last_active":"2024-04-26T07:51:40.414674+0000","last_peered":"2024-04-26T07:51:40.414674+0000","last_clean":"2024-04-26T07:51:40.414674+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:51:40.414674+0000","last_undegraded":"2024-04-26T07:51:40.414674+0000","last_fullsized":"2024-04-26T07:51:40.414674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'46","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.415835+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:56.415835+0000","last_peered":"2024-04-26T07:51:56.415835+0000","last_clean":"2024-04-26T07:51:56.415835+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:56.415835+0000","last_undegraded":"2024-04-26T07:51:56.415835+0000","last_fullsized":"2024-04-26T07:51:56.415835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399387+0000","last_change":"2024-04-26T07:48:23.524403+0000","last_active":"2024-04-26T07:51:40.399387+0000","last_peered":"2024-04-26T07:51:40.399387+0000","last_clean":"2024-04-26T07:51:40.399387+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:51:40.399387+0000","last_undegraded":"2024-04-26T07:51:40.399387+0000","last_fullsized":"2024-04-26T07:51:40.399387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:52.412992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395530+0000","last_change":"2024-04-26T07:48:23.540862+0000","last_active":"2024-04-26T07:51:40.395530+0000","last_peered":"2024-04-26T07:51:40.395530+0000","last_clean":"2024-04-26T07:51:40.395530+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:51:40.395530+0000","last_undegraded":"2024-04-26T07:51:40.395530+0000","last_fullsized":"2024-04-26T07:51:40.395530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'50","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.364538+0000","last_change":"2024-04-26T07:51:40.429380+0000","last_active":"2024-04-26T07:51:56.364538+0000","last_peered":"2024-04-26T07:51:56.364538+0000","last_clean":"2024-04-26T07:51:56.364538+0000","last_became_active":"2024-04-26T07:51:40.428461+0000","last_became_peered":"2024-04-26T07:51:40.428461+0000","last_unstale":"2024-04-26T07:51:56.364538+0000","last_undegraded":"2024-04-26T07:51:56.364538+0000","last_fullsized":"2024-04-26T07:51:56.364538+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.386208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437638+0000","last_change":"2024-04-26T07:51:40.437638+0000","last_active":"2024-04-26T07:51:40.437638+0000","last_peered":"2024-04-26T07:51:40.437638+0000","last_clean":"2024-04-26T07:51:40.437638+0000","last_became_active":"2024-04-26T07:51:40.435585+0000","last_became_peered":"2024-04-26T07:51:40.435585+0000","last_unstale":"2024-04-26T07:51:40.437638+0000","last_undegraded":"2024-04-26T07:51:40.437638+0000","last_fullsized":"2024-04-26T07:51:40.437638+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:03.283810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"109'60","reported_seq":253,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.392983+0000","last_change":"2024-04-26T07:48:21.506166+0000","last_active":"2024-04-26T07:51:56.392983+0000","last_peered":"2024-04-26T07:51:56.392983+0000","last_clean":"2024-04-26T07:51:56.392983+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:51:56.392983+0000","last_undegraded":"2024-04-26T07:51:56.392983+0000","last_fullsized":"2024-04-26T07:51:56.392983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":70,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413895+0000","last_change":"2024-04-26T07:48:23.524289+0000","last_active":"2024-04-26T07:51:40.413895+0000","last_peered":"2024-04-26T07:51:40.413895+0000","last_clean":"2024-04-26T07:51:40.413895+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:51:40.413895+0000","last_undegraded":"2024-04-26T07:51:40.413895+0000","last_fullsized":"2024-04-26T07:51:40.413895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"109'42","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.406343+0000","last_change":"2024-04-26T07:48:21.504457+0000","last_active":"2024-04-26T07:51:56.406343+0000","last_peered":"2024-04-26T07:51:56.406343+0000","last_clean":"2024-04-26T07:51:56.406343+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:51:56.406343+0000","last_undegraded":"2024-04-26T07:51:56.406343+0000","last_fullsized":"2024-04-26T07:51:56.406343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401519+0000","last_change":"2024-04-26T07:48:23.524172+0000","last_active":"2024-04-26T07:51:40.401519+0000","last_peered":"2024-04-26T07:51:40.401519+0000","last_clean":"2024-04-26T07:51:40.401519+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:51:40.401519+0000","last_undegraded":"2024-04-26T07:51:40.401519+0000","last_fullsized":"2024-04-26T07:51:40.401519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:06.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'48","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.337034+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:56.337034+0000","last_peered":"2024-04-26T07:51:56.337034+0000","last_clean":"2024-04-26T07:51:56.337034+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:56.337034+0000","last_undegraded":"2024-04-26T07:51:56.337034+0000","last_fullsized":"2024-04-26T07:51:56.337034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:26.703041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399756+0000","last_change":"2024-04-26T07:48:23.544551+0000","last_active":"2024-04-26T07:51:40.399756+0000","last_peered":"2024-04-26T07:51:40.399756+0000","last_clean":"2024-04-26T07:51:40.399756+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:51:40.399756+0000","last_undegraded":"2024-04-26T07:51:40.399756+0000","last_fullsized":"2024-04-26T07:51:40.399756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:40.137784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'42","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.185252+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:56.185252+0000","last_peered":"2024-04-26T07:51:56.185252+0000","last_clean":"2024-04-26T07:51:56.185252+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:56.185252+0000","last_undegraded":"2024-04-26T07:51:56.185252+0000","last_fullsized":"2024-04-26T07:51:56.185252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396627+0000","last_change":"2024-04-26T07:48:23.542650+0000","last_active":"2024-04-26T07:51:40.396627+0000","last_peered":"2024-04-26T07:51:40.396627+0000","last_clean":"2024-04-26T07:51:40.396627+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:51:40.396627+0000","last_undegraded":"2024-04-26T07:51:40.396627+0000","last_fullsized":"2024-04-26T07:51:40.396627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'46","reported_seq":238,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.238626+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:56.238626+0000","last_peered":"2024-04-26T07:51:56.238626+0000","last_clean":"2024-04-26T07:51:56.238626+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:56.238626+0000","last_undegraded":"2024-04-26T07:51:56.238626+0000","last_fullsized":"2024-04-26T07:51:56.238626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394620+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:40.394620+0000","last_peered":"2024-04-26T07:51:40.394620+0000","last_clean":"2024-04-26T07:51:40.394620+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:40.394620+0000","last_undegraded":"2024-04-26T07:51:40.394620+0000","last_fullsized":"2024-04-26T07:51:40.394620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393414+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:40.393414+0000","last_peered":"2024-04-26T07:51:40.393414+0000","last_clean":"2024-04-26T07:51:40.393414+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:40.393414+0000","last_undegraded":"2024-04-26T07:51:40.393414+0000","last_fullsized":"2024-04-26T07:51:40.393414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'38","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.050568+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:56.050568+0000","last_peered":"2024-04-26T07:51:56.050568+0000","last_clean":"2024-04-26T07:51:56.050568+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:56.050568+0000","last_undegraded":"2024-04-26T07:51:56.050568+0000","last_fullsized":"2024-04-26T07:51:56.050568+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:08.704021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414398+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:40.414398+0000","last_peered":"2024-04-26T07:51:40.414398+0000","last_clean":"2024-04-26T07:51:40.414398+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:40.414398+0000","last_undegraded":"2024-04-26T07:51:40.414398+0000","last_fullsized":"2024-04-26T07:51:40.414398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"109'20","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.463173+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:55.463173+0000","last_peered":"2024-04-26T07:51:55.463173+0000","last_clean":"2024-04-26T07:51:55.463173+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:55.463173+0000","last_undegraded":"2024-04-26T07:51:55.463173+0000","last_fullsized":"2024-04-26T07:51:55.463173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:03.475771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.427384+0000","last_change":"2024-04-26T07:51:40.427384+0000","last_active":"2024-04-26T07:51:40.427384+0000","last_peered":"2024-04-26T07:51:40.427384+0000","last_clean":"2024-04-26T07:51:40.427384+0000","last_became_active":"2024-04-26T07:51:40.424563+0000","last_became_peered":"2024-04-26T07:51:40.424563+0000","last_unstale":"2024-04-26T07:51:40.427384+0000","last_undegraded":"2024-04-26T07:51:40.427384+0000","last_fullsized":"2024-04-26T07:51:40.427384+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:45.363785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409995+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:40.409995+0000","last_peered":"2024-04-26T07:51:40.409995+0000","last_clean":"2024-04-26T07:51:40.409995+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:40.409995+0000","last_undegraded":"2024-04-26T07:51:40.409995+0000","last_fullsized":"2024-04-26T07:51:40.409995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:12.044500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415011+0000","last_change":"2024-04-26T07:48:23.558051+0000","last_active":"2024-04-26T07:51:40.415011+0000","last_peered":"2024-04-26T07:51:40.415011+0000","last_clean":"2024-04-26T07:51:40.415011+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:51:40.415011+0000","last_undegraded":"2024-04-26T07:51:40.415011+0000","last_fullsized":"2024-04-26T07:51:40.415011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"109'40","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.306746+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:56.306746+0000","last_peered":"2024-04-26T07:51:56.306746+0000","last_clean":"2024-04-26T07:51:56.306746+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:56.306746+0000","last_undegraded":"2024-04-26T07:51:56.306746+0000","last_fullsized":"2024-04-26T07:51:56.306746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393282+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:40.393282+0000","last_peered":"2024-04-26T07:51:40.393282+0000","last_clean":"2024-04-26T07:51:40.393282+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:40.393282+0000","last_undegraded":"2024-04-26T07:51:40.393282+0000","last_fullsized":"2024-04-26T07:51:40.393282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:05.749051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"53'7","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397138+0000","last_change":"2024-04-26T07:48:27.563924+0000","last_active":"2024-04-26T07:51:40.397138+0000","last_peered":"2024-04-26T07:51:40.397138+0000","last_clean":"2024-04-26T07:51:40.397138+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:51:40.397138+0000","last_undegraded":"2024-04-26T07:51:40.397138+0000","last_fullsized":"2024-04-26T07:51:40.397138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396318+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:40.396318+0000","last_peered":"2024-04-26T07:51:40.396318+0000","last_clean":"2024-04-26T07:51:40.396318+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:40.396318+0000","last_undegraded":"2024-04-26T07:51:40.396318+0000","last_fullsized":"2024-04-26T07:51:40.396318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386651+0000","last_change":"2024-04-26T07:48:31.594151+0000","last_active":"2024-04-26T07:51:40.386651+0000","last_peered":"2024-04-26T07:51:40.386651+0000","last_clean":"2024-04-26T07:51:40.386651+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:51:40.386651+0000","last_undegraded":"2024-04-26T07:51:40.386651+0000","last_fullsized":"2024-04-26T07:51:40.386651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.369958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388934+0000","last_change":"2024-04-26T07:48:23.552505+0000","last_active":"2024-04-26T07:51:40.388934+0000","last_peered":"2024-04-26T07:51:40.388934+0000","last_clean":"2024-04-26T07:51:40.388934+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:51:40.388934+0000","last_undegraded":"2024-04-26T07:51:40.388934+0000","last_fullsized":"2024-04-26T07:51:40.388934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"109'44","reported_seq":201,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.376969+0000","last_change":"2024-04-26T07:51:40.441938+0000","last_active":"2024-04-26T07:51:56.376969+0000","last_peered":"2024-04-26T07:51:56.376969+0000","last_clean":"2024-04-26T07:51:56.376969+0000","last_became_active":"2024-04-26T07:51:40.440255+0000","last_became_peered":"2024-04-26T07:51:40.440255+0000","last_unstale":"2024-04-26T07:51:56.376969+0000","last_undegraded":"2024-04-26T07:51:56.376969+0000","last_fullsized":"2024-04-26T07:51:56.376969+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:49.106793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394846+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:40.394846+0000","last_peered":"2024-04-26T07:51:40.394846+0000","last_clean":"2024-04-26T07:51:40.394846+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:40.394846+0000","last_undegraded":"2024-04-26T07:51:40.394846+0000","last_fullsized":"2024-04-26T07:51:40.394846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399562+0000","last_change":"2024-04-26T07:48:27.558204+0000","last_active":"2024-04-26T07:51:40.399562+0000","last_peered":"2024-04-26T07:51:40.399562+0000","last_clean":"2024-04-26T07:51:40.399562+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:51:40.399562+0000","last_undegraded":"2024-04-26T07:51:40.399562+0000","last_fullsized":"2024-04-26T07:51:40.399562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:48.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"109'140","reported_seq":314,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.351181+0000","last_change":"2024-04-26T07:51:40.446383+0000","last_active":"2024-04-26T07:51:55.351181+0000","last_peered":"2024-04-26T07:51:55.351181+0000","last_clean":"2024-04-26T07:51:55.351181+0000","last_became_active":"2024-04-26T07:51:40.439601+0000","last_became_peered":"2024-04-26T07:51:40.439601+0000","last_unstale":"2024-04-26T07:51:55.351181+0000","last_undegraded":"2024-04-26T07:51:55.351181+0000","last_fullsized":"2024-04-26T07:51:55.351181+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:32.966811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395932+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:40.395932+0000","last_peered":"2024-04-26T07:51:40.395932+0000","last_clean":"2024-04-26T07:51:40.395932+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:40.395932+0000","last_undegraded":"2024-04-26T07:51:40.395932+0000","last_fullsized":"2024-04-26T07:51:40.395932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394102+0000","last_change":"2024-04-26T07:48:23.551425+0000","last_active":"2024-04-26T07:51:40.394102+0000","last_peered":"2024-04-26T07:51:40.394102+0000","last_clean":"2024-04-26T07:51:40.394102+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:51:40.394102+0000","last_undegraded":"2024-04-26T07:51:40.394102+0000","last_fullsized":"2024-04-26T07:51:40.394102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:15.428479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"109'34","reported_seq":226,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.283407+0000","last_change":"2024-04-26T07:48:21.507004+0000","last_active":"2024-04-26T07:51:56.283407+0000","last_peered":"2024-04-26T07:51:56.283407+0000","last_clean":"2024-04-26T07:51:56.283407+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:51:56.283407+0000","last_undegraded":"2024-04-26T07:51:56.283407+0000","last_fullsized":"2024-04-26T07:51:56.283407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414412+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:40.414412+0000","last_peered":"2024-04-26T07:51:40.414412+0000","last_clean":"2024-04-26T07:51:40.414412+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:40.414412+0000","last_undegraded":"2024-04-26T07:51:40.414412+0000","last_fullsized":"2024-04-26T07:51:40.414412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"109'20","reported_seq":166,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.464321+0000","last_change":"2024-04-26T07:51:40.447428+0000","last_active":"2024-04-26T07:51:56.464321+0000","last_peered":"2024-04-26T07:51:56.464321+0000","last_clean":"2024-04-26T07:51:56.464321+0000","last_became_active":"2024-04-26T07:51:40.441381+0000","last_became_peered":"2024-04-26T07:51:40.441381+0000","last_unstale":"2024-04-26T07:51:56.464321+0000","last_undegraded":"2024-04-26T07:51:56.464321+0000","last_fullsized":"2024-04-26T07:51:56.464321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:19.309516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"109'138","reported_seq":355,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.355283+0000","last_change":"2024-04-26T07:48:29.582249+0000","last_active":"2024-04-26T07:51:55.355283+0000","last_peered":"2024-04-26T07:51:55.355283+0000","last_clean":"2024-04-26T07:51:55.355283+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:51:55.355283+0000","last_undegraded":"2024-04-26T07:51:55.355283+0000","last_fullsized":"2024-04-26T07:51:55.355283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:06.772421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410355+0000","last_change":"2024-04-26T07:48:23.557740+0000","last_active":"2024-04-26T07:51:40.410355+0000","last_peered":"2024-04-26T07:51:40.410355+0000","last_clean":"2024-04-26T07:51:40.410355+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:51:40.410355+0000","last_undegraded":"2024-04-26T07:51:40.410355+0000","last_fullsized":"2024-04-26T07:51:40.410355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"109'54","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.368400+0000","last_change":"2024-04-26T07:51:40.433314+0000","last_active":"2024-04-26T07:51:56.368400+0000","last_peered":"2024-04-26T07:51:56.368400+0000","last_clean":"2024-04-26T07:51:56.368400+0000","last_became_active":"2024-04-26T07:51:40.432352+0000","last_became_peered":"2024-04-26T07:51:40.432352+0000","last_unstale":"2024-04-26T07:51:56.368400+0000","last_undegraded":"2024-04-26T07:51:56.368400+0000","last_fullsized":"2024-04-26T07:51:56.368400+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:27.681250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436814+0000","last_change":"2024-04-26T07:51:40.436814+0000","last_active":"2024-04-26T07:51:40.436814+0000","last_peered":"2024-04-26T07:51:40.436814+0000","last_clean":"2024-04-26T07:51:40.436814+0000","last_became_active":"2024-04-26T07:51:40.432366+0000","last_became_peered":"2024-04-26T07:51:40.432366+0000","last_unstale":"2024-04-26T07:51:40.436814+0000","last_undegraded":"2024-04-26T07:51:40.436814+0000","last_fullsized":"2024-04-26T07:51:40.436814+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.091620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"109'30","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.070311+0000","last_change":"2024-04-26T07:48:27.652046+0000","last_active":"2024-04-26T07:51:56.070311+0000","last_peered":"2024-04-26T07:51:56.070311+0000","last_clean":"2024-04-26T07:51:56.070311+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:51:56.070311+0000","last_undegraded":"2024-04-26T07:51:56.070311+0000","last_fullsized":"2024-04-26T07:51:56.070311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409381+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:40.409381+0000","last_peered":"2024-04-26T07:51:40.409381+0000","last_clean":"2024-04-26T07:51:40.409381+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:40.409381+0000","last_undegraded":"2024-04-26T07:51:40.409381+0000","last_fullsized":"2024-04-26T07:51:40.409381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:09.766232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413984+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:40.413984+0000","last_peered":"2024-04-26T07:51:40.413984+0000","last_clean":"2024-04-26T07:51:40.413984+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:40.413984+0000","last_undegraded":"2024-04-26T07:51:40.413984+0000","last_fullsized":"2024-04-26T07:51:40.413984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395453+0000","last_change":"2024-04-26T07:48:23.534734+0000","last_active":"2024-04-26T07:51:40.395453+0000","last_peered":"2024-04-26T07:51:40.395453+0000","last_clean":"2024-04-26T07:51:40.395453+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:51:40.395453+0000","last_undegraded":"2024-04-26T07:51:40.395453+0000","last_fullsized":"2024-04-26T07:51:40.395453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"109'48","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.393852+0000","last_change":"2024-04-26T07:51:40.432790+0000","last_active":"2024-04-26T07:51:56.393852+0000","last_peered":"2024-04-26T07:51:56.393852+0000","last_clean":"2024-04-26T07:51:56.393852+0000","last_became_active":"2024-04-26T07:51:40.431661+0000","last_became_peered":"2024-04-26T07:51:40.431661+0000","last_unstale":"2024-04-26T07:51:56.393852+0000","last_undegraded":"2024-04-26T07:51:56.393852+0000","last_fullsized":"2024-04-26T07:51:56.393852+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:28:44.955807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399129+0000","last_change":"2024-04-26T07:48:25.564973+0000","last_active":"2024-04-26T07:51:40.399129+0000","last_peered":"2024-04-26T07:51:40.399129+0000","last_clean":"2024-04-26T07:51:40.399129+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:51:40.399129+0000","last_undegraded":"2024-04-26T07:51:40.399129+0000","last_fullsized":"2024-04-26T07:51:40.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:04.192971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"109'20","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.254102+0000","last_change":"2024-04-26T07:48:27.582587+0000","last_active":"2024-04-26T07:51:56.254102+0000","last_peered":"2024-04-26T07:51:56.254102+0000","last_clean":"2024-04-26T07:51:56.254102+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:51:56.254102+0000","last_undegraded":"2024-04-26T07:51:56.254102+0000","last_fullsized":"2024-04-26T07:51:56.254102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:43.900100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391295+0000","last_change":"2024-04-26T07:48:29.581887+0000","last_active":"2024-04-26T07:51:40.391295+0000","last_peered":"2024-04-26T07:51:40.391295+0000","last_clean":"2024-04-26T07:51:40.391295+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:51:40.391295+0000","last_undegraded":"2024-04-26T07:51:40.391295+0000","last_fullsized":"2024-04-26T07:51:40.391295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:10.037714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411466+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:40.411466+0000","last_peered":"2024-04-26T07:51:40.411466+0000","last_clean":"2024-04-26T07:51:40.411466+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:40.411466+0000","last_undegraded":"2024-04-26T07:51:40.411466+0000","last_fullsized":"2024-04-26T07:51:40.411466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:06.102949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409163+0000","last_change":"2024-04-26T07:48:23.533613+0000","last_active":"2024-04-26T07:51:40.409163+0000","last_peered":"2024-04-26T07:51:40.409163+0000","last_clean":"2024-04-26T07:51:40.409163+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:51:40.409163+0000","last_undegraded":"2024-04-26T07:51:40.409163+0000","last_fullsized":"2024-04-26T07:51:40.409163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"109'50","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.411798+0000","last_change":"2024-04-26T07:51:40.448016+0000","last_active":"2024-04-26T07:51:56.411798+0000","last_peered":"2024-04-26T07:51:56.411798+0000","last_clean":"2024-04-26T07:51:56.411798+0000","last_became_active":"2024-04-26T07:51:40.444713+0000","last_became_peered":"2024-04-26T07:51:40.444713+0000","last_unstale":"2024-04-26T07:51:56.411798+0000","last_undegraded":"2024-04-26T07:51:56.411798+0000","last_fullsized":"2024-04-26T07:51:56.411798+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:01.400431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401762+0000","last_change":"2024-04-26T07:48:25.560892+0000","last_active":"2024-04-26T07:51:40.401762+0000","last_peered":"2024-04-26T07:51:40.401762+0000","last_clean":"2024-04-26T07:51:40.401762+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:51:40.401762+0000","last_undegraded":"2024-04-26T07:51:40.401762+0000","last_fullsized":"2024-04-26T07:51:40.401762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:02.738712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"109'29","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.207989+0000","last_change":"2024-04-26T07:51:40.444435+0000","last_active":"2024-04-26T07:51:56.207989+0000","last_peered":"2024-04-26T07:51:56.207989+0000","last_clean":"2024-04-26T07:51:56.207989+0000","last_became_active":"2024-04-26T07:51:40.438940+0000","last_became_peered":"2024-04-26T07:51:40.438940+0000","last_unstale":"2024-04-26T07:51:56.207989+0000","last_undegraded":"2024-04-26T07:51:56.207989+0000","last_fullsized":"2024-04-26T07:51:56.207989+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:00.682036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":153,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"109'138","reported_seq":353,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.356679+0000","last_change":"2024-04-26T07:48:29.602116+0000","last_active":"2024-04-26T07:51:55.356679+0000","last_peered":"2024-04-26T07:51:55.356679+0000","last_clean":"2024-04-26T07:51:55.356679+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:51:55.356679+0000","last_undegraded":"2024-04-26T07:51:55.356679+0000","last_fullsized":"2024-04-26T07:51:55.356679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387775+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:40.387775+0000","last_peered":"2024-04-26T07:51:40.387775+0000","last_clean":"2024-04-26T07:51:40.387775+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:40.387775+0000","last_undegraded":"2024-04-26T07:51:40.387775+0000","last_fullsized":"2024-04-26T07:51:40.387775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:13.921039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388194+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:40.388194+0000","last_peered":"2024-04-26T07:51:40.388194+0000","last_clean":"2024-04-26T07:51:40.388194+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:40.388194+0000","last_undegraded":"2024-04-26T07:51:40.388194+0000","last_fullsized":"2024-04-26T07:51:40.388194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:55.066040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"109'48","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.402112+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:56.402112+0000","last_peered":"2024-04-26T07:51:56.402112+0000","last_clean":"2024-04-26T07:51:56.402112+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:56.402112+0000","last_undegraded":"2024-04-26T07:51:56.402112+0000","last_fullsized":"2024-04-26T07:51:56.402112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:21.852638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400425+0000","last_change":"2024-04-26T07:48:25.551923+0000","last_active":"2024-04-26T07:51:40.400425+0000","last_peered":"2024-04-26T07:51:40.400425+0000","last_clean":"2024-04-26T07:51:40.400425+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:51:40.400425+0000","last_undegraded":"2024-04-26T07:51:40.400425+0000","last_fullsized":"2024-04-26T07:51:40.400425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:33.625505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'35","reported_seq":233,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.427948+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:56.427948+0000","last_peered":"2024-04-26T07:51:56.427948+0000","last_clean":"2024-04-26T07:51:56.427948+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:56.427948+0000","last_undegraded":"2024-04-26T07:51:56.427948+0000","last_fullsized":"2024-04-26T07:51:56.427948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:52.986924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398515+0000","last_change":"2024-04-26T07:48:29.586958+0000","last_active":"2024-04-26T07:51:40.398515+0000","last_peered":"2024-04-26T07:51:40.398515+0000","last_clean":"2024-04-26T07:51:40.398515+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:51:40.398515+0000","last_undegraded":"2024-04-26T07:51:40.398515+0000","last_fullsized":"2024-04-26T07:51:40.398515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:36.560377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410194+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:40.410194+0000","last_peered":"2024-04-26T07:51:40.410194+0000","last_clean":"2024-04-26T07:51:40.410194+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:40.410194+0000","last_undegraded":"2024-04-26T07:51:40.410194+0000","last_fullsized":"2024-04-26T07:51:40.410194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:47.913073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398461+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:40.398461+0000","last_peered":"2024-04-26T07:51:40.398461+0000","last_clean":"2024-04-26T07:51:40.398461+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:40.398461+0000","last_undegraded":"2024-04-26T07:51:40.398461+0000","last_fullsized":"2024-04-26T07:51:40.398461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"109'58","reported_seq":251,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.328972+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:56.328972+0000","last_peered":"2024-04-26T07:51:56.328972+0000","last_clean":"2024-04-26T07:51:56.328972+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:56.328972+0000","last_undegraded":"2024-04-26T07:51:56.328972+0000","last_fullsized":"2024-04-26T07:51:56.328972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398811+0000","last_change":"2024-04-26T07:48:25.576859+0000","last_active":"2024-04-26T07:51:40.398811+0000","last_peered":"2024-04-26T07:51:40.398811+0000","last_clean":"2024-04-26T07:51:40.398811+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:51:40.398811+0000","last_undegraded":"2024-04-26T07:51:40.398811+0000","last_fullsized":"2024-04-26T07:51:40.398811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:25.913271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"109'23","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.434214+0000","last_change":"2024-04-26T07:48:27.573556+0000","last_active":"2024-04-26T07:51:56.434214+0000","last_peered":"2024-04-26T07:51:56.434214+0000","last_clean":"2024-04-26T07:51:56.434214+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:51:56.434214+0000","last_undegraded":"2024-04-26T07:51:56.434214+0000","last_fullsized":"2024-04-26T07:51:56.434214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388406+0000","last_change":"2024-04-26T07:48:29.597028+0000","last_active":"2024-04-26T07:51:40.388406+0000","last_peered":"2024-04-26T07:51:40.388406+0000","last_clean":"2024-04-26T07:51:40.388406+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:51:40.388406+0000","last_undegraded":"2024-04-26T07:51:40.388406+0000","last_fullsized":"2024-04-26T07:51:40.388406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:43.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390097+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:40.390097+0000","last_peered":"2024-04-26T07:51:40.390097+0000","last_clean":"2024-04-26T07:51:40.390097+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:40.390097+0000","last_undegraded":"2024-04-26T07:51:40.390097+0000","last_fullsized":"2024-04-26T07:51:40.390097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:43:03.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396856+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:40.396856+0000","last_peered":"2024-04-26T07:51:40.396856+0000","last_clean":"2024-04-26T07:51:40.396856+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:40.396856+0000","last_undegraded":"2024-04-26T07:51:40.396856+0000","last_fullsized":"2024-04-26T07:51:40.396856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"109'50","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.315070+0000","last_change":"2024-04-26T07:48:21.513893+0000","last_active":"2024-04-26T07:51:56.315070+0000","last_peered":"2024-04-26T07:51:56.315070+0000","last_clean":"2024-04-26T07:51:56.315070+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:51:56.315070+0000","last_undegraded":"2024-04-26T07:51:56.315070+0000","last_fullsized":"2024-04-26T07:51:56.315070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409449+0000","last_change":"2024-04-26T07:48:25.573271+0000","last_active":"2024-04-26T07:51:40.409449+0000","last_peered":"2024-04-26T07:51:40.409449+0000","last_clean":"2024-04-26T07:51:40.409449+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:51:40.409449+0000","last_undegraded":"2024-04-26T07:51:40.409449+0000","last_fullsized":"2024-04-26T07:51:40.409449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:49.616730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"109'27","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.243619+0000","last_change":"2024-04-26T07:48:27.574923+0000","last_active":"2024-04-26T07:51:56.243619+0000","last_peered":"2024-04-26T07:51:56.243619+0000","last_clean":"2024-04-26T07:51:56.243619+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:51:56.243619+0000","last_undegraded":"2024-04-26T07:51:56.243619+0000","last_fullsized":"2024-04-26T07:51:56.243619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:59.112680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"109'138","reported_seq":370,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.351145+0000","last_change":"2024-04-26T07:48:29.571717+0000","last_active":"2024-04-26T07:51:55.351145+0000","last_peered":"2024-04-26T07:51:55.351145+0000","last_clean":"2024-04-26T07:51:55.351145+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:51:55.351145+0000","last_undegraded":"2024-04-26T07:51:55.351145+0000","last_fullsized":"2024-04-26T07:51:55.351145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:09.303336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409050+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:40.409050+0000","last_peered":"2024-04-26T07:51:40.409050+0000","last_clean":"2024-04-26T07:51:40.409050+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:40.409050+0000","last_undegraded":"2024-04-26T07:51:40.409050+0000","last_fullsized":"2024-04-26T07:51:40.409050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:55.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398129+0000","last_change":"2024-04-26T07:48:23.539431+0000","last_active":"2024-04-26T07:51:40.398129+0000","last_peered":"2024-04-26T07:51:40.398129+0000","last_clean":"2024-04-26T07:51:40.398129+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:51:40.398129+0000","last_undegraded":"2024-04-26T07:51:40.398129+0000","last_fullsized":"2024-04-26T07:51:40.398129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"109'60","reported_seq":252,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.385023+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:56.385023+0000","last_peered":"2024-04-26T07:51:56.385023+0000","last_clean":"2024-04-26T07:51:56.385023+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:56.385023+0000","last_undegraded":"2024-04-26T07:51:56.385023+0000","last_fullsized":"2024-04-26T07:51:56.385023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":367,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.317432+0000","last_change":"2024-04-26T07:48:25.553131+0000","last_active":"2024-04-26T07:51:55.317432+0000","last_peered":"2024-04-26T07:51:55.317432+0000","last_clean":"2024-04-26T07:51:55.317432+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:51:55.317432+0000","last_undegraded":"2024-04-26T07:51:55.317432+0000","last_fullsized":"2024-04-26T07:51:55.317432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393097+0000","last_change":"2024-04-26T07:48:27.654488+0000","last_active":"2024-04-26T07:51:40.393097+0000","last_peered":"2024-04-26T07:51:40.393097+0000","last_clean":"2024-04-26T07:51:40.393097+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:51:40.393097+0000","last_undegraded":"2024-04-26T07:51:40.393097+0000","last_fullsized":"2024-04-26T07:51:40.393097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:09.804128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"109'138","reported_seq":405,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.355257+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:55.355257+0000","last_peered":"2024-04-26T07:51:55.355257+0000","last_clean":"2024-04-26T07:51:55.355257+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:55.355257+0000","last_undegraded":"2024-04-26T07:51:55.355257+0000","last_fullsized":"2024-04-26T07:51:55.355257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:37.644196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400533+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:40.400533+0000","last_peered":"2024-04-26T07:51:40.400533+0000","last_clean":"2024-04-26T07:51:40.400533+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:40.400533+0000","last_undegraded":"2024-04-26T07:51:40.400533+0000","last_fullsized":"2024-04-26T07:51:40.400533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":165,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394484+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:40.394484+0000","last_peered":"2024-04-26T07:51:40.394484+0000","last_clean":"2024-04-26T07:51:40.394484+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:40.394484+0000","last_undegraded":"2024-04-26T07:51:40.394484+0000","last_fullsized":"2024-04-26T07:51:40.394484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:51.982618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"109'58","reported_seq":251,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.360995+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:56.360995+0000","last_peered":"2024-04-26T07:51:56.360995+0000","last_clean":"2024-04-26T07:51:56.360995+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:56.360995+0000","last_undegraded":"2024-04-26T07:51:56.360995+0000","last_fullsized":"2024-04-26T07:51:56.360995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397629+0000","last_change":"2024-04-26T07:48:25.552844+0000","last_active":"2024-04-26T07:51:40.397629+0000","last_peered":"2024-04-26T07:51:40.397629+0000","last_clean":"2024-04-26T07:51:40.397629+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:51:40.397629+0000","last_undegraded":"2024-04-26T07:51:40.397629+0000","last_fullsized":"2024-04-26T07:51:40.397629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"109'29","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.473256+0000","last_change":"2024-04-26T07:48:27.576321+0000","last_active":"2024-04-26T07:51:55.473256+0000","last_peered":"2024-04-26T07:51:55.473256+0000","last_clean":"2024-04-26T07:51:55.473256+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:51:55.473256+0000","last_undegraded":"2024-04-26T07:51:55.473256+0000","last_fullsized":"2024-04-26T07:51:55.473256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409728+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:40.409728+0000","last_peered":"2024-04-26T07:51:40.409728+0000","last_clean":"2024-04-26T07:51:40.409728+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:40.409728+0000","last_undegraded":"2024-04-26T07:51:40.409728+0000","last_fullsized":"2024-04-26T07:51:40.409728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:07.633392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409337+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:40.409337+0000","last_peered":"2024-04-26T07:51:40.409337+0000","last_clean":"2024-04-26T07:51:40.409337+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:40.409337+0000","last_undegraded":"2024-04-26T07:51:40.409337+0000","last_fullsized":"2024-04-26T07:51:40.409337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:17:13.817101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412130+0000","last_change":"2024-04-26T07:48:23.548293+0000","last_active":"2024-04-26T07:51:40.412130+0000","last_peered":"2024-04-26T07:51:40.412130+0000","last_clean":"2024-04-26T07:51:40.412130+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:51:40.412130+0000","last_undegraded":"2024-04-26T07:51:40.412130+0000","last_fullsized":"2024-04-26T07:51:40.412130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.435552+0000","last_change":"2024-04-26T07:51:40.435552+0000","last_active":"2024-04-26T07:51:40.435552+0000","last_peered":"2024-04-26T07:51:40.435552+0000","last_clean":"2024-04-26T07:51:40.435552+0000","last_became_active":"2024-04-26T07:51:40.429475+0000","last_became_peered":"2024-04-26T07:51:40.429475+0000","last_unstale":"2024-04-26T07:51:40.435552+0000","last_undegraded":"2024-04-26T07:51:40.435552+0000","last_fullsized":"2024-04-26T07:51:40.435552+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:19.379343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414577+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:40.414577+0000","last_peered":"2024-04-26T07:51:40.414577+0000","last_clean":"2024-04-26T07:51:40.414577+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:40.414577+0000","last_undegraded":"2024-04-26T07:51:40.414577+0000","last_fullsized":"2024-04-26T07:51:40.414577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"109'42","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.358229+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:56.358229+0000","last_peered":"2024-04-26T07:51:56.358229+0000","last_clean":"2024-04-26T07:51:56.358229+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:56.358229+0000","last_undegraded":"2024-04-26T07:51:56.358229+0000","last_fullsized":"2024-04-26T07:51:56.358229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.429427+0000","last_change":"2024-04-26T07:51:40.429427+0000","last_active":"2024-04-26T07:51:40.429427+0000","last_peered":"2024-04-26T07:51:40.429427+0000","last_clean":"2024-04-26T07:51:40.429427+0000","last_became_active":"2024-04-26T07:51:40.428641+0000","last_became_peered":"2024-04-26T07:51:40.428641+0000","last_unstale":"2024-04-26T07:51:40.429427+0000","last_undegraded":"2024-04-26T07:51:40.429427+0000","last_fullsized":"2024-04-26T07:51:40.429427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:31.406741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"109'49","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.235656+0000","last_change":"2024-04-26T07:48:27.574058+0000","last_active":"2024-04-26T07:51:56.235656+0000","last_peered":"2024-04-26T07:51:56.235656+0000","last_clean":"2024-04-26T07:51:56.235656+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:51:56.235656+0000","last_undegraded":"2024-04-26T07:51:56.235656+0000","last_fullsized":"2024-04-26T07:51:56.235656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:27.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":274,"num_write":26,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388551+0000","last_change":"2024-04-26T07:48:29.600143+0000","last_active":"2024-04-26T07:51:40.388551+0000","last_peered":"2024-04-26T07:51:40.388551+0000","last_clean":"2024-04-26T07:51:40.388551+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:51:40.388551+0000","last_undegraded":"2024-04-26T07:51:40.388551+0000","last_fullsized":"2024-04-26T07:51:40.388551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:30.948980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407507+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:40.407507+0000","last_peered":"2024-04-26T07:51:40.407507+0000","last_clean":"2024-04-26T07:51:40.407507+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:40.407507+0000","last_undegraded":"2024-04-26T07:51:40.407507+0000","last_fullsized":"2024-04-26T07:51:40.407507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:18.788621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388819+0000","last_change":"2024-04-26T07:48:23.546790+0000","last_active":"2024-04-26T07:51:40.388819+0000","last_peered":"2024-04-26T07:51:40.388819+0000","last_clean":"2024-04-26T07:51:40.388819+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:51:40.388819+0000","last_undegraded":"2024-04-26T07:51:40.388819+0000","last_fullsized":"2024-04-26T07:51:40.388819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.440837+0000","last_change":"2024-04-26T07:51:40.440837+0000","last_active":"2024-04-26T07:51:40.440837+0000","last_peered":"2024-04-26T07:51:40.440837+0000","last_clean":"2024-04-26T07:51:40.440837+0000","last_became_active":"2024-04-26T07:51:40.437582+0000","last_became_peered":"2024-04-26T07:51:40.437582+0000","last_unstale":"2024-04-26T07:51:40.440837+0000","last_undegraded":"2024-04-26T07:51:40.440837+0000","last_fullsized":"2024-04-26T07:51:40.440837+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.908604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"109'40","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.413188+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:56.413188+0000","last_peered":"2024-04-26T07:51:56.413188+0000","last_clean":"2024-04-26T07:51:56.413188+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:56.413188+0000","last_undegraded":"2024-04-26T07:51:56.413188+0000","last_fullsized":"2024-04-26T07:51:56.413188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417014+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:40.417014+0000","last_peered":"2024-04-26T07:51:40.417014+0000","last_clean":"2024-04-26T07:51:40.417014+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:40.417014+0000","last_undegraded":"2024-04-26T07:51:40.417014+0000","last_fullsized":"2024-04-26T07:51:40.417014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:12.764654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"109'150","reported_seq":445,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.471477+0000","last_change":"2024-04-26T07:48:27.578388+0000","last_active":"2024-04-26T07:51:56.471477+0000","last_peered":"2024-04-26T07:51:56.471477+0000","last_clean":"2024-04-26T07:51:56.471477+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:51:56.471477+0000","last_undegraded":"2024-04-26T07:51:56.471477+0000","last_fullsized":"2024-04-26T07:51:56.471477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:34.765474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444144+0000","last_change":"2024-04-26T07:51:40.444144+0000","last_active":"2024-04-26T07:51:40.444144+0000","last_peered":"2024-04-26T07:51:40.444144+0000","last_clean":"2024-04-26T07:51:40.444144+0000","last_became_active":"2024-04-26T07:51:40.439356+0000","last_became_peered":"2024-04-26T07:51:40.439356+0000","last_unstale":"2024-04-26T07:51:40.444144+0000","last_undegraded":"2024-04-26T07:51:40.444144+0000","last_fullsized":"2024-04-26T07:51:40.444144+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:37.987341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408252+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:40.408252+0000","last_peered":"2024-04-26T07:51:40.408252+0000","last_clean":"2024-04-26T07:51:40.408252+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:40.408252+0000","last_undegraded":"2024-04-26T07:51:40.408252+0000","last_fullsized":"2024-04-26T07:51:40.408252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:44.007242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410446+0000","last_change":"2024-04-26T07:48:23.540450+0000","last_active":"2024-04-26T07:51:40.410446+0000","last_peered":"2024-04-26T07:51:40.410446+0000","last_clean":"2024-04-26T07:51:40.410446+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:51:40.410446+0000","last_undegraded":"2024-04-26T07:51:40.410446+0000","last_fullsized":"2024-04-26T07:51:40.410446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399025+0000","last_change":"2024-04-26T07:48:15.447946+0000","last_active":"2024-04-26T07:51:40.399025+0000","last_peered":"2024-04-26T07:51:40.399025+0000","last_clean":"2024-04-26T07:51:40.399025+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:51:40.399025+0000","last_undegraded":"2024-04-26T07:51:40.399025+0000","last_fullsized":"2024-04-26T07:51:40.399025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:09:32.354061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"109'52","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.358837+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:56.358837+0000","last_peered":"2024-04-26T07:51:56.358837+0000","last_clean":"2024-04-26T07:51:56.358837+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:56.358837+0000","last_undegraded":"2024-04-26T07:51:56.358837+0000","last_fullsized":"2024-04-26T07:51:56.358837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399455+0000","last_change":"2024-04-26T07:48:25.556489+0000","last_active":"2024-04-26T07:51:40.399455+0000","last_peered":"2024-04-26T07:51:40.399455+0000","last_clean":"2024-04-26T07:51:40.399455+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:51:40.399455+0000","last_undegraded":"2024-04-26T07:51:40.399455+0000","last_fullsized":"2024-04-26T07:51:40.399455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:49.127790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"109'18","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:45.807316+0000","last_change":"2024-04-26T07:51:40.448691+0000","last_active":"2024-04-26T07:51:45.807316+0000","last_peered":"2024-04-26T07:51:45.807316+0000","last_clean":"2024-04-26T07:51:45.807316+0000","last_became_active":"2024-04-26T07:51:40.445444+0000","last_became_peered":"2024-04-26T07:51:40.445444+0000","last_unstale":"2024-04-26T07:51:45.807316+0000","last_undegraded":"2024-04-26T07:51:45.807316+0000","last_fullsized":"2024-04-26T07:51:45.807316+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:23.750359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387011+0000","last_change":"2024-04-26T07:48:29.597287+0000","last_active":"2024-04-26T07:51:40.387011+0000","last_peered":"2024-04-26T07:51:40.387011+0000","last_clean":"2024-04-26T07:51:40.387011+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:51:40.387011+0000","last_undegraded":"2024-04-26T07:51:40.387011+0000","last_fullsized":"2024-04-26T07:51:40.387011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392361+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:40.392361+0000","last_peered":"2024-04-26T07:51:40.392361+0000","last_clean":"2024-04-26T07:51:40.392361+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:40.392361+0000","last_undegraded":"2024-04-26T07:51:40.392361+0000","last_fullsized":"2024-04-26T07:51:40.392361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:04.240663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409549+0000","last_change":"2024-04-26T07:48:23.534305+0000","last_active":"2024-04-26T07:51:40.409549+0000","last_peered":"2024-04-26T07:51:40.409549+0000","last_clean":"2024-04-26T07:51:40.409549+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:51:40.409549+0000","last_undegraded":"2024-04-26T07:51:40.409549+0000","last_fullsized":"2024-04-26T07:51:40.409549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:23.877626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414326+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:40.414326+0000","last_peered":"2024-04-26T07:51:40.414326+0000","last_clean":"2024-04-26T07:51:40.414326+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:40.414326+0000","last_undegraded":"2024-04-26T07:51:40.414326+0000","last_fullsized":"2024-04-26T07:51:40.414326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"109'40","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.391084+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:56.391084+0000","last_peered":"2024-04-26T07:51:56.391084+0000","last_clean":"2024-04-26T07:51:56.391084+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:56.391084+0000","last_undegraded":"2024-04-26T07:51:56.391084+0000","last_fullsized":"2024-04-26T07:51:56.391084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:30.640838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387118+0000","last_change":"2024-04-26T07:48:25.562829+0000","last_active":"2024-04-26T07:51:40.387118+0000","last_peered":"2024-04-26T07:51:40.387118+0000","last_clean":"2024-04-26T07:51:40.387118+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:51:40.387118+0000","last_undegraded":"2024-04-26T07:51:40.387118+0000","last_fullsized":"2024-04-26T07:51:40.387118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:21.262183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393907+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:40.393907+0000","last_peered":"2024-04-26T07:51:40.393907+0000","last_clean":"2024-04-26T07:51:40.393907+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:40.393907+0000","last_undegraded":"2024-04-26T07:51:40.393907+0000","last_fullsized":"2024-04-26T07:51:40.393907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:17.819868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412184+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:40.412184+0000","last_peered":"2024-04-26T07:51:40.412184+0000","last_clean":"2024-04-26T07:51:40.412184+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:40.412184+0000","last_undegraded":"2024-04-26T07:51:40.412184+0000","last_fullsized":"2024-04-26T07:51:40.412184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:36.771660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409446+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:40.409446+0000","last_peered":"2024-04-26T07:51:40.409446+0000","last_clean":"2024-04-26T07:51:40.409446+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:40.409446+0000","last_undegraded":"2024-04-26T07:51:40.409446+0000","last_fullsized":"2024-04-26T07:51:40.409446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:06.806595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408654+0000","last_change":"2024-04-26T07:48:23.536166+0000","last_active":"2024-04-26T07:51:40.408654+0000","last_peered":"2024-04-26T07:51:40.408654+0000","last_clean":"2024-04-26T07:51:40.408654+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:51:40.408654+0000","last_undegraded":"2024-04-26T07:51:40.408654+0000","last_fullsized":"2024-04-26T07:51:40.408654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"109'48","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.326696+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:56.326696+0000","last_peered":"2024-04-26T07:51:56.326696+0000","last_clean":"2024-04-26T07:51:56.326696+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:56.326696+0000","last_undegraded":"2024-04-26T07:51:56.326696+0000","last_fullsized":"2024-04-26T07:51:56.326696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:45.067157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409916+0000","last_change":"2024-04-26T07:48:15.519408+0000","last_active":"2024-04-26T07:51:40.409916+0000","last_peered":"2024-04-26T07:51:40.409916+0000","last_clean":"2024-04-26T07:51:40.409916+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:51:40.409916+0000","last_undegraded":"2024-04-26T07:51:40.409916+0000","last_fullsized":"2024-04-26T07:51:40.409916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387667+0000","last_change":"2024-04-26T07:48:25.582103+0000","last_active":"2024-04-26T07:51:40.387667+0000","last_peered":"2024-04-26T07:51:40.387667+0000","last_clean":"2024-04-26T07:51:40.387667+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:51:40.387667+0000","last_undegraded":"2024-04-26T07:51:40.387667+0000","last_fullsized":"2024-04-26T07:51:40.387667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:32.754479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.465552+0000","last_change":"2024-04-26T07:48:27.575552+0000","last_active":"2024-04-26T07:51:56.465552+0000","last_peered":"2024-04-26T07:51:56.465552+0000","last_clean":"2024-04-26T07:51:56.465552+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:51:56.465552+0000","last_undegraded":"2024-04-26T07:51:56.465552+0000","last_fullsized":"2024-04-26T07:51:56.465552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:16.858095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":45,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394908+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:40.394908+0000","last_peered":"2024-04-26T07:51:40.394908+0000","last_clean":"2024-04-26T07:51:40.394908+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:40.394908+0000","last_undegraded":"2024-04-26T07:51:40.394908+0000","last_fullsized":"2024-04-26T07:51:40.394908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:26.665006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387516+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:40.387516+0000","last_peered":"2024-04-26T07:51:40.387516+0000","last_clean":"2024-04-26T07:51:40.387516+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:40.387516+0000","last_undegraded":"2024-04-26T07:51:40.387516+0000","last_fullsized":"2024-04-26T07:51:40.387516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:50.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388105+0000","last_change":"2024-04-26T07:48:23.540539+0000","last_active":"2024-04-26T07:51:40.388105+0000","last_peered":"2024-04-26T07:51:40.388105+0000","last_clean":"2024-04-26T07:51:40.388105+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:51:40.388105+0000","last_undegraded":"2024-04-26T07:51:40.388105+0000","last_fullsized":"2024-04-26T07:51:40.388105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'44","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.339625+0000","last_change":"2024-04-26T07:48:21.498032+0000","last_active":"2024-04-26T07:51:56.339625+0000","last_peered":"2024-04-26T07:51:56.339625+0000","last_clean":"2024-04-26T07:51:56.339625+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:51:56.339625+0000","last_undegraded":"2024-04-26T07:51:56.339625+0000","last_fullsized":"2024-04-26T07:51:56.339625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:04.466314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.441852+0000","last_change":"2024-04-26T07:51:40.441852+0000","last_active":"2024-04-26T07:51:40.441852+0000","last_peered":"2024-04-26T07:51:40.441852+0000","last_clean":"2024-04-26T07:51:40.441852+0000","last_became_active":"2024-04-26T07:51:40.433293+0000","last_became_peered":"2024-04-26T07:51:40.433293+0000","last_unstale":"2024-04-26T07:51:40.441852+0000","last_undegraded":"2024-04-26T07:51:40.441852+0000","last_fullsized":"2024-04-26T07:51:40.441852+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:25.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408513+0000","last_change":"2024-04-26T07:48:25.569602+0000","last_active":"2024-04-26T07:51:40.408513+0000","last_peered":"2024-04-26T07:51:40.408513+0000","last_clean":"2024-04-26T07:51:40.408513+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:51:40.408513+0000","last_undegraded":"2024-04-26T07:51:40.408513+0000","last_fullsized":"2024-04-26T07:51:40.408513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:22.202919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408684+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:40.408684+0000","last_peered":"2024-04-26T07:51:40.408684+0000","last_clean":"2024-04-26T07:51:40.408684+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:40.408684+0000","last_undegraded":"2024-04-26T07:51:40.408684+0000","last_fullsized":"2024-04-26T07:51:40.408684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:23.273178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"109'138","reported_seq":383,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.349001+0000","last_change":"2024-04-26T07:48:29.574796+0000","last_active":"2024-04-26T07:51:55.349001+0000","last_peered":"2024-04-26T07:51:55.349001+0000","last_clean":"2024-04-26T07:51:55.349001+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:51:55.349001+0000","last_undegraded":"2024-04-26T07:51:55.349001+0000","last_fullsized":"2024-04-26T07:51:55.349001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:45.906287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394363+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:40.394363+0000","last_peered":"2024-04-26T07:51:40.394363+0000","last_clean":"2024-04-26T07:51:40.394363+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:40.394363+0000","last_undegraded":"2024-04-26T07:51:40.394363+0000","last_fullsized":"2024-04-26T07:51:40.394363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:04.441506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390662+0000","last_change":"2024-04-26T07:48:23.558897+0000","last_active":"2024-04-26T07:51:40.390662+0000","last_peered":"2024-04-26T07:51:40.390662+0000","last_clean":"2024-04-26T07:51:40.390662+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:51:40.390662+0000","last_undegraded":"2024-04-26T07:51:40.390662+0000","last_fullsized":"2024-04-26T07:51:40.390662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:47.581085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'38","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.199928+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:56.199928+0000","last_peered":"2024-04-26T07:51:56.199928+0000","last_clean":"2024-04-26T07:51:56.199928+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:56.199928+0000","last_undegraded":"2024-04-26T07:51:56.199928+0000","last_fullsized":"2024-04-26T07:51:56.199928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:58.678079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410909+0000","last_change":"2024-04-26T07:48:15.454117+0000","last_active":"2024-04-26T07:51:40.410909+0000","last_peered":"2024-04-26T07:51:40.410909+0000","last_clean":"2024-04-26T07:51:40.410909+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:51:40.410909+0000","last_undegraded":"2024-04-26T07:51:40.410909+0000","last_fullsized":"2024-04-26T07:51:40.410909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:55.929418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395337+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:40.395337+0000","last_peered":"2024-04-26T07:51:40.395337+0000","last_clean":"2024-04-26T07:51:40.395337+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:40.395337+0000","last_undegraded":"2024-04-26T07:51:40.395337+0000","last_fullsized":"2024-04-26T07:51:40.395337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400935+0000","last_change":"2024-04-26T07:48:27.555236+0000","last_active":"2024-04-26T07:51:40.400935+0000","last_peered":"2024-04-26T07:51:40.400935+0000","last_clean":"2024-04-26T07:51:40.400935+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:51:40.400935+0000","last_undegraded":"2024-04-26T07:51:40.400935+0000","last_fullsized":"2024-04-26T07:51:40.400935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:18.688569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"109'138","reported_seq":355,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.353753+0000","last_change":"2024-04-26T07:48:29.585112+0000","last_active":"2024-04-26T07:51:55.353753+0000","last_peered":"2024-04-26T07:51:55.353753+0000","last_clean":"2024-04-26T07:51:55.353753+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:51:55.353753+0000","last_undegraded":"2024-04-26T07:51:55.353753+0000","last_fullsized":"2024-04-26T07:51:55.353753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:44.178861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387074+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:40.387074+0000","last_peered":"2024-04-26T07:51:40.387074+0000","last_clean":"2024-04-26T07:51:40.387074+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:40.387074+0000","last_undegraded":"2024-04-26T07:51:40.387074+0000","last_fullsized":"2024-04-26T07:51:40.387074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:13.607155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395762+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:40.395762+0000","last_peered":"2024-04-26T07:51:40.395762+0000","last_clean":"2024-04-26T07:51:40.395762+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:40.395762+0000","last_undegraded":"2024-04-26T07:51:40.395762+0000","last_fullsized":"2024-04-26T07:51:40.395762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"109'42","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.298598+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:56.298598+0000","last_peered":"2024-04-26T07:51:56.298598+0000","last_clean":"2024-04-26T07:51:56.298598+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:56.298598+0000","last_undegraded":"2024-04-26T07:51:56.298598+0000","last_fullsized":"2024-04-26T07:51:56.298598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412692+0000","last_change":"2024-04-26T07:48:15.455389+0000","last_active":"2024-04-26T07:51:40.412692+0000","last_peered":"2024-04-26T07:51:40.412692+0000","last_clean":"2024-04-26T07:51:40.412692+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:51:40.412692+0000","last_undegraded":"2024-04-26T07:51:40.412692+0000","last_fullsized":"2024-04-26T07:51:40.412692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:39.531873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":277,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.302471+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:55.302471+0000","last_peered":"2024-04-26T07:51:55.302471+0000","last_clean":"2024-04-26T07:51:55.302471+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:55.302471+0000","last_undegraded":"2024-04-26T07:51:55.302471+0000","last_fullsized":"2024-04-26T07:51:55.302471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"109'54","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.456962+0000","last_change":"2024-04-26T07:51:40.419562+0000","last_active":"2024-04-26T07:51:56.456962+0000","last_peered":"2024-04-26T07:51:56.456962+0000","last_clean":"2024-04-26T07:51:56.456962+0000","last_became_active":"2024-04-26T07:51:40.418680+0000","last_became_peered":"2024-04-26T07:51:40.418680+0000","last_unstale":"2024-04-26T07:51:56.456962+0000","last_undegraded":"2024-04-26T07:51:56.456962+0000","last_fullsized":"2024-04-26T07:51:56.456962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:42.333538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":166,"num_write":32,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391389+0000","last_change":"2024-04-26T07:48:29.577062+0000","last_active":"2024-04-26T07:51:40.391389+0000","last_peered":"2024-04-26T07:51:40.391389+0000","last_clean":"2024-04-26T07:51:40.391389+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:51:40.391389+0000","last_undegraded":"2024-04-26T07:51:40.391389+0000","last_fullsized":"2024-04-26T07:51:40.391389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:13.899347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413846+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:40.413846+0000","last_peered":"2024-04-26T07:51:40.413846+0000","last_clean":"2024-04-26T07:51:40.413846+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:40.413846+0000","last_undegraded":"2024-04-26T07:51:40.413846+0000","last_fullsized":"2024-04-26T07:51:40.413846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:15.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387849+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:40.387849+0000","last_peered":"2024-04-26T07:51:40.387849+0000","last_clean":"2024-04-26T07:51:40.387849+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:40.387849+0000","last_undegraded":"2024-04-26T07:51:40.387849+0000","last_fullsized":"2024-04-26T07:51:40.387849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:26.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396489+0000","last_change":"2024-04-26T07:48:23.539689+0000","last_active":"2024-04-26T07:51:40.396489+0000","last_peered":"2024-04-26T07:51:40.396489+0000","last_clean":"2024-04-26T07:51:40.396489+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:51:40.396489+0000","last_undegraded":"2024-04-26T07:51:40.396489+0000","last_fullsized":"2024-04-26T07:51:40.396489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"109'62","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.364705+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:56.364705+0000","last_peered":"2024-04-26T07:51:56.364705+0000","last_clean":"2024-04-26T07:51:56.364705+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:56.364705+0000","last_undegraded":"2024-04-26T07:51:56.364705+0000","last_fullsized":"2024-04-26T07:51:56.364705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:43.856531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408744+0000","last_change":"2024-04-26T07:48:25.568122+0000","last_active":"2024-04-26T07:51:40.408744+0000","last_peered":"2024-04-26T07:51:40.408744+0000","last_clean":"2024-04-26T07:51:40.408744+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:51:40.408744+0000","last_undegraded":"2024-04-26T07:51:40.408744+0000","last_fullsized":"2024-04-26T07:51:40.408744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:33.464634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"109'22","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.071795+0000","last_change":"2024-04-26T07:48:27.573453+0000","last_active":"2024-04-26T07:51:56.071795+0000","last_peered":"2024-04-26T07:51:56.071795+0000","last_clean":"2024-04-26T07:51:56.071795+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:51:56.071795+0000","last_undegraded":"2024-04-26T07:51:56.071795+0000","last_fullsized":"2024-04-26T07:51:56.071795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390188+0000","last_change":"2024-04-26T07:48:29.585123+0000","last_active":"2024-04-26T07:51:40.390188+0000","last_peered":"2024-04-26T07:51:40.390188+0000","last_clean":"2024-04-26T07:51:40.390188+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:51:40.390188+0000","last_undegraded":"2024-04-26T07:51:40.390188+0000","last_fullsized":"2024-04-26T07:51:40.390188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:35.951858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393594+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:40.393594+0000","last_peered":"2024-04-26T07:51:40.393594+0000","last_clean":"2024-04-26T07:51:40.393594+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:40.393594+0000","last_undegraded":"2024-04-26T07:51:40.393594+0000","last_fullsized":"2024-04-26T07:51:40.393594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:31.104415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408560+0000","last_change":"2024-04-26T07:48:23.552412+0000","last_active":"2024-04-26T07:51:40.408560+0000","last_peered":"2024-04-26T07:51:40.408560+0000","last_clean":"2024-04-26T07:51:40.408560+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:51:40.408560+0000","last_undegraded":"2024-04-26T07:51:40.408560+0000","last_fullsized":"2024-04-26T07:51:40.408560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:47.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"109'36","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.360066+0000","last_change":"2024-04-26T07:51:40.447435+0000","last_active":"2024-04-26T07:51:56.360066+0000","last_peered":"2024-04-26T07:51:56.360066+0000","last_clean":"2024-04-26T07:51:56.360066+0000","last_became_active":"2024-04-26T07:51:40.444446+0000","last_became_peered":"2024-04-26T07:51:40.444446+0000","last_unstale":"2024-04-26T07:51:56.360066+0000","last_undegraded":"2024-04-26T07:51:56.360066+0000","last_fullsized":"2024-04-26T07:51:56.360066+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:01.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":277,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.301246+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:55.301246+0000","last_peered":"2024-04-26T07:51:55.301246+0000","last_clean":"2024-04-26T07:51:55.301246+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:55.301246+0000","last_undegraded":"2024-04-26T07:51:55.301246+0000","last_fullsized":"2024-04-26T07:51:55.301246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:11.041274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"101'10","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386065+0000","last_change":"2024-04-26T07:48:27.571153+0000","last_active":"2024-04-26T07:51:40.386065+0000","last_peered":"2024-04-26T07:51:40.386065+0000","last_clean":"2024-04-26T07:51:40.386065+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:51:40.386065+0000","last_undegraded":"2024-04-26T07:51:40.386065+0000","last_fullsized":"2024-04-26T07:51:40.386065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:02.089977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.432738+0000","last_change":"2024-04-26T07:51:40.432738+0000","last_active":"2024-04-26T07:51:40.432738+0000","last_peered":"2024-04-26T07:51:40.432738+0000","last_clean":"2024-04-26T07:51:40.432738+0000","last_became_active":"2024-04-26T07:51:40.431762+0000","last_became_peered":"2024-04-26T07:51:40.431762+0000","last_unstale":"2024-04-26T07:51:40.432738+0000","last_undegraded":"2024-04-26T07:51:40.432738+0000","last_fullsized":"2024-04-26T07:51:40.432738+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:25.659741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386934+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:40.386934+0000","last_peered":"2024-04-26T07:51:40.386934+0000","last_clean":"2024-04-26T07:51:40.386934+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:40.386934+0000","last_undegraded":"2024-04-26T07:51:40.386934+0000","last_fullsized":"2024-04-26T07:51:40.386934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:32.699445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391261+0000","last_change":"2024-04-26T07:48:23.547174+0000","last_active":"2024-04-26T07:51:40.391261+0000","last_peered":"2024-04-26T07:51:40.391261+0000","last_clean":"2024-04-26T07:51:40.391261+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:51:40.391261+0000","last_undegraded":"2024-04-26T07:51:40.391261+0000","last_fullsized":"2024-04-26T07:51:40.391261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"109'48","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.334310+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:56.334310+0000","last_peered":"2024-04-26T07:51:56.334310+0000","last_clean":"2024-04-26T07:51:56.334310+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:56.334310+0000","last_undegraded":"2024-04-26T07:51:56.334310+0000","last_fullsized":"2024-04-26T07:51:56.334310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:22.297318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.444554+0000","last_change":"2024-04-26T07:51:40.444554+0000","last_active":"2024-04-26T07:51:40.444554+0000","last_peered":"2024-04-26T07:51:40.444554+0000","last_clean":"2024-04-26T07:51:40.444554+0000","last_became_active":"2024-04-26T07:51:40.439845+0000","last_became_peered":"2024-04-26T07:51:40.439845+0000","last_unstale":"2024-04-26T07:51:40.444554+0000","last_undegraded":"2024-04-26T07:51:40.444554+0000","last_fullsized":"2024-04-26T07:51:40.444554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:41.631699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"109'23","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.458440+0000","last_change":"2024-04-26T07:48:27.572866+0000","last_active":"2024-04-26T07:51:56.458440+0000","last_peered":"2024-04-26T07:51:56.458440+0000","last_clean":"2024-04-26T07:51:56.458440+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:51:56.458440+0000","last_undegraded":"2024-04-26T07:51:56.458440+0000","last_fullsized":"2024-04-26T07:51:56.458440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:24.658819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409988+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:40.409988+0000","last_peered":"2024-04-26T07:51:40.409988+0000","last_clean":"2024-04-26T07:51:40.409988+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:40.409988+0000","last_undegraded":"2024-04-26T07:51:40.409988+0000","last_fullsized":"2024-04-26T07:51:40.409988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:21.481305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413668+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:40.413668+0000","last_peered":"2024-04-26T07:51:40.413668+0000","last_clean":"2024-04-26T07:51:40.413668+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:40.413668+0000","last_undegraded":"2024-04-26T07:51:40.413668+0000","last_fullsized":"2024-04-26T07:51:40.413668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:08.779207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390764+0000","last_change":"2024-04-26T07:48:23.542150+0000","last_active":"2024-04-26T07:51:40.390764+0000","last_peered":"2024-04-26T07:51:40.390764+0000","last_clean":"2024-04-26T07:51:40.390764+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:51:40.390764+0000","last_undegraded":"2024-04-26T07:51:40.390764+0000","last_fullsized":"2024-04-26T07:51:40.390764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:31.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'50","reported_seq":241,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.380285+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:56.380285+0000","last_peered":"2024-04-26T07:51:56.380285+0000","last_clean":"2024-04-26T07:51:56.380285+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:56.380285+0000","last_undegraded":"2024-04-26T07:51:56.380285+0000","last_fullsized":"2024-04-26T07:51:56.380285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409141+0000","last_change":"2024-04-26T07:48:25.573401+0000","last_active":"2024-04-26T07:51:40.409141+0000","last_peered":"2024-04-26T07:51:40.409141+0000","last_clean":"2024-04-26T07:51:40.409141+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:51:40.409141+0000","last_undegraded":"2024-04-26T07:51:40.409141+0000","last_fullsized":"2024-04-26T07:51:40.409141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:28.433287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"109'21","reported_seq":167,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.441990+0000","last_change":"2024-04-26T07:51:40.418821+0000","last_active":"2024-04-26T07:51:56.441990+0000","last_peered":"2024-04-26T07:51:56.441990+0000","last_clean":"2024-04-26T07:51:56.441990+0000","last_became_active":"2024-04-26T07:51:40.417916+0000","last_became_peered":"2024-04-26T07:51:40.417916+0000","last_unstale":"2024-04-26T07:51:56.441990+0000","last_undegraded":"2024-04-26T07:51:56.441990+0000","last_fullsized":"2024-04-26T07:51:56.441990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:36.135343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387218+0000","last_change":"2024-04-26T07:48:29.605066+0000","last_active":"2024-04-26T07:51:40.387218+0000","last_peered":"2024-04-26T07:51:40.387218+0000","last_clean":"2024-04-26T07:51:40.387218+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:51:40.387218+0000","last_undegraded":"2024-04-26T07:51:40.387218+0000","last_fullsized":"2024-04-26T07:51:40.387218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:30.813392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412561+0000","last_change":"2024-04-26T07:48:23.546511+0000","last_active":"2024-04-26T07:51:40.412561+0000","last_peered":"2024-04-26T07:51:40.412561+0000","last_clean":"2024-04-26T07:51:40.412561+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:51:40.412561+0000","last_undegraded":"2024-04-26T07:51:40.412561+0000","last_fullsized":"2024-04-26T07:51:40.412561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:24.322305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"109'46","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.128362+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:56.128362+0000","last_peered":"2024-04-26T07:51:56.128362+0000","last_clean":"2024-04-26T07:51:56.128362+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:56.128362+0000","last_undegraded":"2024-04-26T07:51:56.128362+0000","last_fullsized":"2024-04-26T07:51:56.128362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388623+0000","last_change":"2024-04-26T07:48:25.575074+0000","last_active":"2024-04-26T07:51:40.388623+0000","last_peered":"2024-04-26T07:51:40.388623+0000","last_clean":"2024-04-26T07:51:40.388623+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:51:40.388623+0000","last_undegraded":"2024-04-26T07:51:40.388623+0000","last_fullsized":"2024-04-26T07:51:40.388623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:33.627015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"109'35","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.435732+0000","last_change":"2024-04-26T07:48:27.582371+0000","last_active":"2024-04-26T07:51:56.435732+0000","last_peered":"2024-04-26T07:51:56.435732+0000","last_clean":"2024-04-26T07:51:56.435732+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:51:56.435732+0000","last_undegraded":"2024-04-26T07:51:56.435732+0000","last_fullsized":"2024-04-26T07:51:56.435732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:05.559190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414293+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:40.414293+0000","last_peered":"2024-04-26T07:51:40.414293+0000","last_clean":"2024-04-26T07:51:40.414293+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:40.414293+0000","last_undegraded":"2024-04-26T07:51:40.414293+0000","last_fullsized":"2024-04-26T07:51:40.414293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:50.944426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391766+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:40.391766+0000","last_peered":"2024-04-26T07:51:40.391766+0000","last_clean":"2024-04-26T07:51:40.391766+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:40.391766+0000","last_undegraded":"2024-04-26T07:51:40.391766+0000","last_fullsized":"2024-04-26T07:51:40.391766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:40.055628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388746+0000","last_change":"2024-04-26T07:48:23.558139+0000","last_active":"2024-04-26T07:51:40.388746+0000","last_peered":"2024-04-26T07:51:40.388746+0000","last_clean":"2024-04-26T07:51:40.388746+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:51:40.388746+0000","last_undegraded":"2024-04-26T07:51:40.388746+0000","last_fullsized":"2024-04-26T07:51:40.388746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"109'32","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.269452+0000","last_change":"2024-04-26T07:48:21.497331+0000","last_active":"2024-04-26T07:51:56.269452+0000","last_peered":"2024-04-26T07:51:56.269452+0000","last_clean":"2024-04-26T07:51:56.269452+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:51:56.269452+0000","last_undegraded":"2024-04-26T07:51:56.269452+0000","last_fullsized":"2024-04-26T07:51:56.269452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412316+0000","last_change":"2024-04-26T07:48:25.573275+0000","last_active":"2024-04-26T07:51:40.412316+0000","last_peered":"2024-04-26T07:51:40.412316+0000","last_clean":"2024-04-26T07:51:40.412316+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:51:40.412316+0000","last_undegraded":"2024-04-26T07:51:40.412316+0000","last_fullsized":"2024-04-26T07:51:40.412316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:32.543196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"109'29","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.452877+0000","last_change":"2024-04-26T07:51:40.427441+0000","last_active":"2024-04-26T07:51:56.452877+0000","last_peered":"2024-04-26T07:51:56.452877+0000","last_clean":"2024-04-26T07:51:56.452877+0000","last_became_active":"2024-04-26T07:51:40.424476+0000","last_became_peered":"2024-04-26T07:51:40.424476+0000","last_unstale":"2024-04-26T07:51:56.452877+0000","last_undegraded":"2024-04-26T07:51:56.452877+0000","last_fullsized":"2024-04-26T07:51:56.452877+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:35.964067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410009+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:40.410009+0000","last_peered":"2024-04-26T07:51:40.410009+0000","last_clean":"2024-04-26T07:51:40.410009+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:40.410009+0000","last_undegraded":"2024-04-26T07:51:40.410009+0000","last_fullsized":"2024-04-26T07:51:40.410009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:54.993111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408176+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:40.408176+0000","last_peered":"2024-04-26T07:51:40.408176+0000","last_clean":"2024-04-26T07:51:40.408176+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:40.408176+0000","last_undegraded":"2024-04-26T07:51:40.408176+0000","last_fullsized":"2024-04-26T07:51:40.408176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:11.773018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393585+0000","last_change":"2024-04-26T07:48:23.534647+0000","last_active":"2024-04-26T07:51:40.393585+0000","last_peered":"2024-04-26T07:51:40.393585+0000","last_clean":"2024-04-26T07:51:40.393585+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:51:40.393585+0000","last_undegraded":"2024-04-26T07:51:40.393585+0000","last_fullsized":"2024-04-26T07:51:40.393585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'62","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.393370+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:56.393370+0000","last_peered":"2024-04-26T07:51:56.393370+0000","last_clean":"2024-04-26T07:51:56.393370+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:56.393370+0000","last_undegraded":"2024-04-26T07:51:56.393370+0000","last_fullsized":"2024-04-26T07:51:56.393370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:15.152043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399362+0000","last_change":"2024-04-26T07:48:25.553770+0000","last_active":"2024-04-26T07:51:40.399362+0000","last_peered":"2024-04-26T07:51:40.399362+0000","last_clean":"2024-04-26T07:51:40.399362+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:51:40.399362+0000","last_undegraded":"2024-04-26T07:51:40.399362+0000","last_fullsized":"2024-04-26T07:51:40.399362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:20.413467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"109'22","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.217458+0000","last_change":"2024-04-26T07:48:27.656740+0000","last_active":"2024-04-26T07:51:56.217458+0000","last_peered":"2024-04-26T07:51:56.217458+0000","last_clean":"2024-04-26T07:51:56.217458+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:51:56.217458+0000","last_undegraded":"2024-04-26T07:51:56.217458+0000","last_fullsized":"2024-04-26T07:51:56.217458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:48.938240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409809+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:40.409809+0000","last_peered":"2024-04-26T07:51:40.409809+0000","last_clean":"2024-04-26T07:51:40.409809+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:40.409809+0000","last_undegraded":"2024-04-26T07:51:40.409809+0000","last_fullsized":"2024-04-26T07:51:40.409809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:04.096163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410392+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:40.410392+0000","last_peered":"2024-04-26T07:51:40.410392+0000","last_clean":"2024-04-26T07:51:40.410392+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:40.410392+0000","last_undegraded":"2024-04-26T07:51:40.410392+0000","last_fullsized":"2024-04-26T07:51:40.410392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:37.958644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399847+0000","last_change":"2024-04-26T07:48:23.535639+0000","last_active":"2024-04-26T07:51:40.399847+0000","last_peered":"2024-04-26T07:51:40.399847+0000","last_clean":"2024-04-26T07:51:40.399847+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:51:40.399847+0000","last_undegraded":"2024-04-26T07:51:40.399847+0000","last_fullsized":"2024-04-26T07:51:40.399847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:57.604973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"109'36","reported_seq":227,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.350614+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:56.350614+0000","last_peered":"2024-04-26T07:51:56.350614+0000","last_clean":"2024-04-26T07:51:56.350614+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:56.350614+0000","last_undegraded":"2024-04-26T07:51:56.350614+0000","last_fullsized":"2024-04-26T07:51:56.350614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410199+0000","last_change":"2024-04-26T07:48:25.572908+0000","last_active":"2024-04-26T07:51:40.410199+0000","last_peered":"2024-04-26T07:51:40.410199+0000","last_clean":"2024-04-26T07:51:40.410199+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:51:40.410199+0000","last_undegraded":"2024-04-26T07:51:40.410199+0000","last_fullsized":"2024-04-26T07:51:40.410199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:58.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396852+0000","last_change":"2024-04-26T07:48:27.651899+0000","last_active":"2024-04-26T07:51:40.396852+0000","last_peered":"2024-04-26T07:51:40.396852+0000","last_clean":"2024-04-26T07:51:40.396852+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:51:40.396852+0000","last_undegraded":"2024-04-26T07:51:40.396852+0000","last_fullsized":"2024-04-26T07:51:40.396852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:28:39.994270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"109'138","reported_seq":432,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.347586+0000","last_change":"2024-04-26T07:48:29.571562+0000","last_active":"2024-04-26T07:51:55.347586+0000","last_peered":"2024-04-26T07:51:55.347586+0000","last_clean":"2024-04-26T07:51:55.347586+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:51:55.347586+0000","last_undegraded":"2024-04-26T07:51:55.347586+0000","last_fullsized":"2024-04-26T07:51:55.347586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:25.279365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":136,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.437366+0000","last_change":"2024-04-26T07:51:40.437366+0000","last_active":"2024-04-26T07:51:40.437366+0000","last_peered":"2024-04-26T07:51:40.437366+0000","last_clean":"2024-04-26T07:51:40.437366+0000","last_became_active":"2024-04-26T07:51:40.436379+0000","last_became_peered":"2024-04-26T07:51:40.436379+0000","last_unstale":"2024-04-26T07:51:40.437366+0000","last_undegraded":"2024-04-26T07:51:40.437366+0000","last_fullsized":"2024-04-26T07:51:40.437366+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:48:37.824192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396217+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:40.396217+0000","last_peered":"2024-04-26T07:51:40.396217+0000","last_clean":"2024-04-26T07:51:40.396217+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:40.396217+0000","last_undegraded":"2024-04-26T07:51:40.396217+0000","last_fullsized":"2024-04-26T07:51:40.396217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"109'28","reported_seq":163,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.394095+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:56.394095+0000","last_peered":"2024-04-26T07:51:56.394095+0000","last_clean":"2024-04-26T07:51:56.394095+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:56.394095+0000","last_undegraded":"2024-04-26T07:51:56.394095+0000","last_fullsized":"2024-04-26T07:51:56.394095+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:42:16.352834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":140,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428700+0000","last_change":"2024-04-26T07:51:40.428700+0000","last_active":"2024-04-26T07:51:40.428700+0000","last_peered":"2024-04-26T07:51:40.428700+0000","last_clean":"2024-04-26T07:51:40.428700+0000","last_became_active":"2024-04-26T07:51:40.427906+0000","last_became_peered":"2024-04-26T07:51:40.427906+0000","last_unstale":"2024-04-26T07:51:40.428700+0000","last_undegraded":"2024-04-26T07:51:40.428700+0000","last_fullsized":"2024-04-26T07:51:40.428700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:31.624570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"109'26","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.249552+0000","last_change":"2024-04-26T07:48:27.576348+0000","last_active":"2024-04-26T07:51:56.249552+0000","last_peered":"2024-04-26T07:51:56.249552+0000","last_clean":"2024-04-26T07:51:56.249552+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:51:56.249552+0000","last_undegraded":"2024-04-26T07:51:56.249552+0000","last_fullsized":"2024-04-26T07:51:56.249552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.385502+0000","last_change":"2024-04-26T07:48:29.596652+0000","last_active":"2024-04-26T07:51:40.385502+0000","last_peered":"2024-04-26T07:51:40.385502+0000","last_clean":"2024-04-26T07:51:40.385502+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:51:40.385502+0000","last_undegraded":"2024-04-26T07:51:40.385502+0000","last_fullsized":"2024-04-26T07:51:40.385502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:50:19.826055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":132,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.433368+0000","last_change":"2024-04-26T07:51:40.433368+0000","last_active":"2024-04-26T07:51:40.433368+0000","last_peered":"2024-04-26T07:51:40.433368+0000","last_clean":"2024-04-26T07:51:40.433368+0000","last_became_active":"2024-04-26T07:51:40.432230+0000","last_became_peered":"2024-04-26T07:51:40.432230+0000","last_unstale":"2024-04-26T07:51:40.433368+0000","last_undegraded":"2024-04-26T07:51:40.433368+0000","last_fullsized":"2024-04-26T07:51:40.433368+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:04.195207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401063+0000","last_change":"2024-04-26T07:48:23.545605+0000","last_active":"2024-04-26T07:51:40.401063+0000","last_peered":"2024-04-26T07:51:40.401063+0000","last_clean":"2024-04-26T07:51:40.401063+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:51:40.401063+0000","last_undegraded":"2024-04-26T07:51:40.401063+0000","last_fullsized":"2024-04-26T07:51:40.401063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"109'56","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.424302+0000","last_change":"2024-04-26T07:48:21.518388+0000","last_active":"2024-04-26T07:51:56.424302+0000","last_peered":"2024-04-26T07:51:56.424302+0000","last_clean":"2024-04-26T07:51:56.424302+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:51:56.424302+0000","last_undegraded":"2024-04-26T07:51:56.424302+0000","last_fullsized":"2024-04-26T07:51:56.424302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413866+0000","last_change":"2024-04-26T07:48:25.558111+0000","last_active":"2024-04-26T07:51:40.413866+0000","last_peered":"2024-04-26T07:51:40.413866+0000","last_clean":"2024-04-26T07:51:40.413866+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:51:40.413866+0000","last_undegraded":"2024-04-26T07:51:40.413866+0000","last_fullsized":"2024-04-26T07:51:40.413866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:03.548195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"109'21","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.250679+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:56.250679+0000","last_peered":"2024-04-26T07:51:56.250679+0000","last_clean":"2024-04-26T07:51:56.250679+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:56.250679+0000","last_undegraded":"2024-04-26T07:51:56.250679+0000","last_fullsized":"2024-04-26T07:51:56.250679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:07.760046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408447+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:40.408447+0000","last_peered":"2024-04-26T07:51:40.408447+0000","last_clean":"2024-04-26T07:51:40.408447+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:40.408447+0000","last_undegraded":"2024-04-26T07:51:40.408447+0000","last_fullsized":"2024-04-26T07:51:40.408447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:02.531034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393764+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:40.393764+0000","last_peered":"2024-04-26T07:51:40.393764+0000","last_clean":"2024-04-26T07:51:40.393764+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:40.393764+0000","last_undegraded":"2024-04-26T07:51:40.393764+0000","last_fullsized":"2024-04-26T07:51:40.393764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:56.390760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391427+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:40.391427+0000","last_peered":"2024-04-26T07:51:40.391427+0000","last_clean":"2024-04-26T07:51:40.391427+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:40.391427+0000","last_undegraded":"2024-04-26T07:51:40.391427+0000","last_fullsized":"2024-04-26T07:51:40.391427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:36.743769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"109'52","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.350306+0000","last_change":"2024-04-26T07:49:08.971107+0000","last_active":"2024-04-26T07:51:56.350306+0000","last_peered":"2024-04-26T07:51:56.350306+0000","last_clean":"2024-04-26T07:51:56.350306+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:51:56.350306+0000","last_undegraded":"2024-04-26T07:51:56.350306+0000","last_fullsized":"2024-04-26T07:51:56.350306+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:06.980641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394746+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:40.394746+0000","last_peered":"2024-04-26T07:51:40.394746+0000","last_clean":"2024-04-26T07:51:40.394746+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:40.394746+0000","last_undegraded":"2024-04-26T07:51:40.394746+0000","last_fullsized":"2024-04-26T07:51:40.394746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:41.118207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"109'16","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.209726+0000","last_change":"2024-04-26T07:48:27.580815+0000","last_active":"2024-04-26T07:51:56.209726+0000","last_peered":"2024-04-26T07:51:56.209726+0000","last_clean":"2024-04-26T07:51:56.209726+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:51:56.209726+0000","last_undegraded":"2024-04-26T07:51:56.209726+0000","last_fullsized":"2024-04-26T07:51:56.209726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:51.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395141+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:40.395141+0000","last_peered":"2024-04-26T07:51:40.395141+0000","last_clean":"2024-04-26T07:51:40.395141+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:40.395141+0000","last_undegraded":"2024-04-26T07:51:40.395141+0000","last_fullsized":"2024-04-26T07:51:40.395141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:05.859706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":128,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.446873+0000","last_change":"2024-04-26T07:51:40.446873+0000","last_active":"2024-04-26T07:51:40.446873+0000","last_peered":"2024-04-26T07:51:40.446873+0000","last_clean":"2024-04-26T07:51:40.446873+0000","last_became_active":"2024-04-26T07:51:40.440377+0000","last_became_peered":"2024-04-26T07:51:40.440377+0000","last_unstale":"2024-04-26T07:51:40.446873+0000","last_undegraded":"2024-04-26T07:51:40.446873+0000","last_fullsized":"2024-04-26T07:51:40.446873+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:01.888159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395378+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:40.395378+0000","last_peered":"2024-04-26T07:51:40.395378+0000","last_clean":"2024-04-26T07:51:40.395378+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:40.395378+0000","last_undegraded":"2024-04-26T07:51:40.395378+0000","last_fullsized":"2024-04-26T07:51:40.395378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"109'50","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.402568+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:56.402568+0000","last_peered":"2024-04-26T07:51:56.402568+0000","last_clean":"2024-04-26T07:51:56.402568+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:56.402568+0000","last_undegraded":"2024-04-26T07:51:56.402568+0000","last_fullsized":"2024-04-26T07:51:56.402568+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:34.437375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'1","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408789+0000","last_change":"2024-04-26T07:48:25.568644+0000","last_active":"2024-04-26T07:51:40.408789+0000","last_peered":"2024-04-26T07:51:40.408789+0000","last_clean":"2024-04-26T07:51:40.408789+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:51:40.408789+0000","last_undegraded":"2024-04-26T07:51:40.408789+0000","last_fullsized":"2024-04-26T07:51:40.408789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:28.675862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"109'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.223190+0000","last_change":"2024-04-26T07:48:27.568742+0000","last_active":"2024-04-26T07:51:56.223190+0000","last_peered":"2024-04-26T07:51:56.223190+0000","last_clean":"2024-04-26T07:51:56.223190+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:51:56.223190+0000","last_undegraded":"2024-04-26T07:51:56.223190+0000","last_fullsized":"2024-04-26T07:51:56.223190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:17.587238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387124+0000","last_change":"2024-04-26T07:48:29.602886+0000","last_active":"2024-04-26T07:51:40.387124+0000","last_peered":"2024-04-26T07:51:40.387124+0000","last_clean":"2024-04-26T07:51:40.387124+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:40.387124+0000","last_undegraded":"2024-04-26T07:51:40.387124+0000","last_fullsized":"2024-04-26T07:51:40.387124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:34.078013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399528+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:40.399528+0000","last_peered":"2024-04-26T07:51:40.399528+0000","last_clean":"2024-04-26T07:51:40.399528+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:40.399528+0000","last_undegraded":"2024-04-26T07:51:40.399528+0000","last_fullsized":"2024-04-26T07:51:40.399528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:46.185647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410351+0000","last_change":"2024-04-26T07:48:23.552752+0000","last_active":"2024-04-26T07:51:40.410351+0000","last_peered":"2024-04-26T07:51:40.410351+0000","last_clean":"2024-04-26T07:51:40.410351+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:51:40.410351+0000","last_undegraded":"2024-04-26T07:51:40.410351+0000","last_fullsized":"2024-04-26T07:51:40.410351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"109'42","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.145296+0000","last_change":"2024-04-26T07:48:21.505500+0000","last_active":"2024-04-26T07:51:56.145296+0000","last_peered":"2024-04-26T07:51:56.145296+0000","last_clean":"2024-04-26T07:51:56.145296+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:51:56.145296+0000","last_undegraded":"2024-04-26T07:51:56.145296+0000","last_fullsized":"2024-04-26T07:51:56.145296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.466284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410664+0000","last_change":"2024-04-26T07:48:23.534791+0000","last_active":"2024-04-26T07:51:40.410664+0000","last_peered":"2024-04-26T07:51:40.410664+0000","last_clean":"2024-04-26T07:51:40.410664+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:51:40.410664+0000","last_undegraded":"2024-04-26T07:51:40.410664+0000","last_fullsized":"2024-04-26T07:51:40.410664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:44.898863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"109'52","reported_seq":245,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.300891+0000","last_change":"2024-04-26T07:48:21.524509+0000","last_active":"2024-04-26T07:51:56.300891+0000","last_peered":"2024-04-26T07:51:56.300891+0000","last_clean":"2024-04-26T07:51:56.300891+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:51:56.300891+0000","last_undegraded":"2024-04-26T07:51:56.300891+0000","last_fullsized":"2024-04-26T07:51:56.300891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:57.319692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414531+0000","last_change":"2024-04-26T07:48:23.550300+0000","last_active":"2024-04-26T07:51:40.414531+0000","last_peered":"2024-04-26T07:51:40.414531+0000","last_clean":"2024-04-26T07:51:40.414531+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:51:40.414531+0000","last_undegraded":"2024-04-26T07:51:40.414531+0000","last_fullsized":"2024-04-26T07:51:40.414531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:26.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"109'36","reported_seq":227,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.383855+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:56.383855+0000","last_peered":"2024-04-26T07:51:56.383855+0000","last_clean":"2024-04-26T07:51:56.383855+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:56.383855+0000","last_undegraded":"2024-04-26T07:51:56.383855+0000","last_fullsized":"2024-04-26T07:51:56.383855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:52:52.113290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409820+0000","last_change":"2024-04-26T07:48:23.558189+0000","last_active":"2024-04-26T07:51:40.409820+0000","last_peered":"2024-04-26T07:51:40.409820+0000","last_clean":"2024-04-26T07:51:40.409820+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:51:40.409820+0000","last_undegraded":"2024-04-26T07:51:40.409820+0000","last_fullsized":"2024-04-26T07:51:40.409820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:46.694289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"109'46","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.314518+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:56.314518+0000","last_peered":"2024-04-26T07:51:56.314518+0000","last_clean":"2024-04-26T07:51:56.314518+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:56.314518+0000","last_undegraded":"2024-04-26T07:51:56.314518+0000","last_fullsized":"2024-04-26T07:51:56.314518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392517+0000","last_change":"2024-04-26T07:48:23.547726+0000","last_active":"2024-04-26T07:51:40.392517+0000","last_peered":"2024-04-26T07:51:40.392517+0000","last_clean":"2024-04-26T07:51:40.392517+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:51:40.392517+0000","last_undegraded":"2024-04-26T07:51:40.392517+0000","last_fullsized":"2024-04-26T07:51:40.392517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:01.580566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"109'64","reported_seq":257,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.371949+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:56.371949+0000","last_peered":"2024-04-26T07:51:56.371949+0000","last_clean":"2024-04-26T07:51:56.371949+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:56.371949+0000","last_undegraded":"2024-04-26T07:51:56.371949+0000","last_fullsized":"2024-04-26T07:51:56.371949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:58.753598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.401267+0000","last_change":"2024-04-26T07:48:23.538913+0000","last_active":"2024-04-26T07:51:40.401267+0000","last_peered":"2024-04-26T07:51:40.401267+0000","last_clean":"2024-04-26T07:51:40.401267+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:51:40.401267+0000","last_undegraded":"2024-04-26T07:51:40.401267+0000","last_fullsized":"2024-04-26T07:51:40.401267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"109'70","reported_seq":262,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.390714+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:56.390714+0000","last_peered":"2024-04-26T07:51:56.390714+0000","last_clean":"2024-04-26T07:51:56.390714+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:56.390714+0000","last_undegraded":"2024-04-26T07:51:56.390714+0000","last_fullsized":"2024-04-26T07:51:56.390714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:38.112796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391161+0000","last_change":"2024-04-26T07:48:23.541662+0000","last_active":"2024-04-26T07:51:40.391161+0000","last_peered":"2024-04-26T07:51:40.391161+0000","last_clean":"2024-04-26T07:51:40.391161+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:51:40.391161+0000","last_undegraded":"2024-04-26T07:51:40.391161+0000","last_fullsized":"2024-04-26T07:51:40.391161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.507551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"109'46","reported_seq":238,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.340808+0000","last_change":"2024-04-26T07:48:21.517641+0000","last_active":"2024-04-26T07:51:56.340808+0000","last_peered":"2024-04-26T07:51:56.340808+0000","last_clean":"2024-04-26T07:51:56.340808+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:51:56.340808+0000","last_undegraded":"2024-04-26T07:51:56.340808+0000","last_fullsized":"2024-04-26T07:51:56.340808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407803+0000","last_change":"2024-04-26T07:48:23.530297+0000","last_active":"2024-04-26T07:51:40.407803+0000","last_peered":"2024-04-26T07:51:40.407803+0000","last_clean":"2024-04-26T07:51:40.407803+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:51:40.407803+0000","last_undegraded":"2024-04-26T07:51:40.407803+0000","last_fullsized":"2024-04-26T07:51:40.407803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:58:00.703067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"109'58","reported_seq":251,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.394104+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:56.394104+0000","last_peered":"2024-04-26T07:51:56.394104+0000","last_clean":"2024-04-26T07:51:56.394104+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:56.394104+0000","last_undegraded":"2024-04-26T07:51:56.394104+0000","last_fullsized":"2024-04-26T07:51:56.394104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:15.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388114+0000","last_change":"2024-04-26T07:48:23.553344+0000","last_active":"2024-04-26T07:51:40.388114+0000","last_peered":"2024-04-26T07:51:40.388114+0000","last_clean":"2024-04-26T07:51:40.388114+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:51:40.388114+0000","last_undegraded":"2024-04-26T07:51:40.388114+0000","last_fullsized":"2024-04-26T07:51:40.388114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.397642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"109'48","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.385568+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:56.385568+0000","last_peered":"2024-04-26T07:51:56.385568+0000","last_clean":"2024-04-26T07:51:56.385568+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:56.385568+0000","last_undegraded":"2024-04-26T07:51:56.385568+0000","last_fullsized":"2024-04-26T07:51:56.385568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.397867+0000","last_change":"2024-04-26T07:48:23.528229+0000","last_active":"2024-04-26T07:51:40.397867+0000","last_peered":"2024-04-26T07:51:40.397867+0000","last_clean":"2024-04-26T07:51:40.397867+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:51:40.397867+0000","last_undegraded":"2024-04-26T07:51:40.397867+0000","last_fullsized":"2024-04-26T07:51:40.397867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"109'42","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.182638+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:56.182638+0000","last_peered":"2024-04-26T07:51:56.182638+0000","last_clean":"2024-04-26T07:51:56.182638+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:56.182638+0000","last_undegraded":"2024-04-26T07:51:56.182638+0000","last_fullsized":"2024-04-26T07:51:56.182638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:35.757179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399068+0000","last_change":"2024-04-26T07:48:23.549889+0000","last_active":"2024-04-26T07:51:40.399068+0000","last_peered":"2024-04-26T07:51:40.399068+0000","last_clean":"2024-04-26T07:51:40.399068+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:51:40.399068+0000","last_undegraded":"2024-04-26T07:51:40.399068+0000","last_fullsized":"2024-04-26T07:51:40.399068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:37.782166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"109'28","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.140288+0000","last_change":"2024-04-26T07:48:21.525441+0000","last_active":"2024-04-26T07:51:56.140288+0000","last_peered":"2024-04-26T07:51:56.140288+0000","last_clean":"2024-04-26T07:51:56.140288+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:51:56.140288+0000","last_undegraded":"2024-04-26T07:51:56.140288+0000","last_fullsized":"2024-04-26T07:51:56.140288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:37.332115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398879+0000","last_change":"2024-04-26T07:48:23.539864+0000","last_active":"2024-04-26T07:51:40.398879+0000","last_peered":"2024-04-26T07:51:40.398879+0000","last_clean":"2024-04-26T07:51:40.398879+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:51:40.398879+0000","last_undegraded":"2024-04-26T07:51:40.398879+0000","last_fullsized":"2024-04-26T07:51:40.398879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:37.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"109'52","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.405870+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:56.405870+0000","last_peered":"2024-04-26T07:51:56.405870+0000","last_clean":"2024-04-26T07:51:56.405870+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:56.405870+0000","last_undegraded":"2024-04-26T07:51:56.405870+0000","last_fullsized":"2024-04-26T07:51:56.405870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:40.322827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":162,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.428116+0000","last_change":"2024-04-26T07:51:40.428116+0000","last_active":"2024-04-26T07:51:40.428116+0000","last_peered":"2024-04-26T07:51:40.428116+0000","last_clean":"2024-04-26T07:51:40.428116+0000","last_became_active":"2024-04-26T07:51:40.427193+0000","last_became_peered":"2024-04-26T07:51:40.427193+0000","last_unstale":"2024-04-26T07:51:40.428116+0000","last_undegraded":"2024-04-26T07:51:40.428116+0000","last_fullsized":"2024-04-26T07:51:40.428116+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:06.591882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"109'42","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.387925+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:56.387925+0000","last_peered":"2024-04-26T07:51:56.387925+0000","last_clean":"2024-04-26T07:51:56.387925+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:56.387925+0000","last_undegraded":"2024-04-26T07:51:56.387925+0000","last_fullsized":"2024-04-26T07:51:56.387925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:55.579985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.386601+0000","last_change":"2024-04-26T07:48:23.540620+0000","last_active":"2024-04-26T07:51:40.386601+0000","last_peered":"2024-04-26T07:51:40.386601+0000","last_clean":"2024-04-26T07:51:40.386601+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:51:40.386601+0000","last_undegraded":"2024-04-26T07:51:40.386601+0000","last_fullsized":"2024-04-26T07:51:40.386601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:04.617711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'54","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.391031+0000","last_change":"2024-04-26T07:51:40.449013+0000","last_active":"2024-04-26T07:51:56.391031+0000","last_peered":"2024-04-26T07:51:56.391031+0000","last_clean":"2024-04-26T07:51:56.391031+0000","last_became_active":"2024-04-26T07:51:40.445977+0000","last_became_peered":"2024-04-26T07:51:40.445977+0000","last_unstale":"2024-04-26T07:51:56.391031+0000","last_undegraded":"2024-04-26T07:51:56.391031+0000","last_fullsized":"2024-04-26T07:51:56.391031+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:19.331650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391050+0000","last_change":"2024-04-26T07:48:23.542287+0000","last_active":"2024-04-26T07:51:40.391050+0000","last_peered":"2024-04-26T07:51:40.391050+0000","last_clean":"2024-04-26T07:51:40.391050+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:51:40.391050+0000","last_undegraded":"2024-04-26T07:51:40.391050+0000","last_fullsized":"2024-04-26T07:51:40.391050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:03.250510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"109'64","reported_seq":257,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.377500+0000","last_change":"2024-04-26T07:48:21.508448+0000","last_active":"2024-04-26T07:51:56.377500+0000","last_peered":"2024-04-26T07:51:56.377500+0000","last_clean":"2024-04-26T07:51:56.377500+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:51:56.377500+0000","last_undegraded":"2024-04-26T07:51:56.377500+0000","last_fullsized":"2024-04-26T07:51:56.377500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:37.706641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":169,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.436803+0000","last_change":"2024-04-26T07:51:40.436803+0000","last_active":"2024-04-26T07:51:40.436803+0000","last_peered":"2024-04-26T07:51:40.436803+0000","last_clean":"2024-04-26T07:51:40.436803+0000","last_became_active":"2024-04-26T07:51:40.433471+0000","last_became_peered":"2024-04-26T07:51:40.433471+0000","last_unstale":"2024-04-26T07:51:40.436803+0000","last_undegraded":"2024-04-26T07:51:40.436803+0000","last_fullsized":"2024-04-26T07:51:40.436803+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:23.227977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"109'42","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.310187+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:56.310187+0000","last_peered":"2024-04-26T07:51:56.310187+0000","last_clean":"2024-04-26T07:51:56.310187+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:56.310187+0000","last_undegraded":"2024-04-26T07:51:56.310187+0000","last_fullsized":"2024-04-26T07:51:56.310187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:29.564873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"109'42","reported_seq":233,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.383309+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:56.383309+0000","last_peered":"2024-04-26T07:51:56.383309+0000","last_clean":"2024-04-26T07:51:56.383309+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:56.383309+0000","last_undegraded":"2024-04-26T07:51:56.383309+0000","last_fullsized":"2024-04-26T07:51:56.383309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:50.388004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388025+0000","last_change":"2024-04-26T07:48:23.552852+0000","last_active":"2024-04-26T07:51:40.388025+0000","last_peered":"2024-04-26T07:51:40.388025+0000","last_clean":"2024-04-26T07:51:40.388025+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:51:40.388025+0000","last_undegraded":"2024-04-26T07:51:40.388025+0000","last_fullsized":"2024-04-26T07:51:40.388025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:20.167274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"109'58","reported_seq":250,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.347582+0000","last_change":"2024-04-26T07:48:21.492313+0000","last_active":"2024-04-26T07:51:56.347582+0000","last_peered":"2024-04-26T07:51:56.347582+0000","last_clean":"2024-04-26T07:51:56.347582+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:51:56.347582+0000","last_undegraded":"2024-04-26T07:51:56.347582+0000","last_fullsized":"2024-04-26T07:51:56.347582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:50.304835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.415075+0000","last_change":"2024-04-26T07:48:23.544089+0000","last_active":"2024-04-26T07:51:40.415075+0000","last_peered":"2024-04-26T07:51:40.415075+0000","last_clean":"2024-04-26T07:51:40.415075+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:51:40.415075+0000","last_undegraded":"2024-04-26T07:51:40.415075+0000","last_fullsized":"2024-04-26T07:51:40.415075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:56.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1065,"num_read_kb":1546,"num_write":541,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1446,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":1945600,"data_stored":1357749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1327104,"data_stored":766721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1372160,"data_stored":767549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335220,"statfs":{"total":96636764160,"available":96599265280,"internally_reserved":0,"allocated":1314816,"data_stored":766219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40944,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1359872,"data_stored":768949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1314816,"data_stored":766283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40932,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330908,"statfs":{"total":96636764160,"available":96594849792,"internally_reserved":0,"allocated":1351680,"data_stored":767799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41384,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330456,"statfs":{"total":96636764160,"available":96594386944,"internally_reserved":0,"allocated":1933312,"data_stored":1358159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:52:03.210 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.210 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.210 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.211 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.212 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.212 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.212 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.212 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.212 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.212 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.212 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.212 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.213 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.214 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.214 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.214 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.214 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.214 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.214 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.214 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.214 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.215 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.215 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.215 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.215 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.215 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.215 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.216 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.216 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.216 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.216 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.216 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.217 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.217 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.217 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.217 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.217 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.218 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.218 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.218 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.218 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.219 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.219 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.219 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.219 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.219 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.220 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.220 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.220 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.220 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.220 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.221 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.221 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.221 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.221 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.221 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.222 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.222 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.222 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.222 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.223 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.223 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.223 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.223 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.223 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.224 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.224 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.224 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.224 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.225 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.225 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.225 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.225 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.225 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.225 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.226 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.226 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.226 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.226 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.226 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.226 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.226 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.226 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.227 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.228 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.228 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.228 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.228 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.228 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.228 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.228 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.229 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.230 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.231 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.232 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.233 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.234 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.234 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.234 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.234 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.234 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.234 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.234 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.235 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.235 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.235 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.235 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.235 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.235 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.236 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.236 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.236 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.236 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.236 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.237 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.237 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.237 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.237 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.237 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.237 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.238 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.238 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.238 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.238 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.238 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.239 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.239 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.239 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.239 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.239 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.240 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.240 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.240 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.240 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.240 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.240 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.241 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.241 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.241 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.241 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.241 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.242 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.242 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.242 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.242 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.242 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.242 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.243 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.243 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.243 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.243 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.243 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.244 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.244 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.244 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.244 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.244 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.244 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.245 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.245 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.245 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.245 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.245 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.245 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.246 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.246 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.246 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.246 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.246 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.247 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.247 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.247 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.247 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.247 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.247 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.248 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.248 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.248 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.248 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.248 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.248 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.249 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.250 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.251 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:03.251 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:52:23.252 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:52:23.591 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:52:23.598 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:52:23.612 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-26T07:52:21.868213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620002,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5012,"num_read_kb":3913,"num_write":4425,"num_write_kb":6187918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5641,"ondisk_log_size":5641,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302648,"kb_used_data":11640,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754672072,"statfs":{"total":773094113280,"available":772784201728,"internally_reserved":0,"allocated":11919360,"data_stored":7319428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007182"},"pg_stats":[{"pgid":"3.3f","version":"109'54","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.363052+0000","last_change":"2024-04-26T07:51:40.419563+0000","last_active":"2024-04-26T07:51:56.363052+0000","last_peered":"2024-04-26T07:51:56.363052+0000","last_clean":"2024-04-26T07:51:56.363052+0000","last_became_active":"2024-04-26T07:51:40.418691+0000","last_became_peered":"2024-04-26T07:51:40.418691+0000","last_unstale":"2024-04-26T07:51:56.363052+0000","last_undegraded":"2024-04-26T07:51:56.363052+0000","last_fullsized":"2024-04-26T07:51:56.363052+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.213429+0000","last_change":"2024-04-26T07:52:08.213487+0000","last_active":"2024-04-26T07:52:08.213429+0000","last_peered":"2024-04-26T07:52:08.213429+0000","last_clean":"2024-04-26T07:52:08.213429+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:52:08.213429+0000","last_undegraded":"2024-04-26T07:52:08.213429+0000","last_fullsized":"2024-04-26T07:52:08.213429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'10","last_scrub_stamp":"2024-04-26T07:52:08.213207+0000","last_deep_scrub":"72'10","last_deep_scrub_stamp":"2024-04-26T07:52:08.213207+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.213207+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:25.317450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"109'52","reported_seq":253,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.522078+0000","last_change":"2024-04-26T07:52:16.522139+0000","last_active":"2024-04-26T07:52:16.522078+0000","last_peered":"2024-04-26T07:52:16.522078+0000","last_clean":"2024-04-26T07:52:16.522078+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:52:16.522078+0000","last_undegraded":"2024-04-26T07:52:16.522078+0000","last_fullsized":"2024-04-26T07:52:16.522078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:16.521885+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:16.521885+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.521885+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:14.274620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":153,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.163478+0000","last_change":"2024-04-26T07:52:13.163536+0000","last_active":"2024-04-26T07:52:13.163478+0000","last_peered":"2024-04-26T07:52:13.163478+0000","last_clean":"2024-04-26T07:52:13.163478+0000","last_became_active":"2024-04-26T07:51:40.437448+0000","last_became_peered":"2024-04-26T07:51:40.437448+0000","last_unstale":"2024-04-26T07:52:13.163478+0000","last_undegraded":"2024-04-26T07:52:13.163478+0000","last_fullsized":"2024-04-26T07:52:13.163478+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.163252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.163252+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.163252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:16.053824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"109'42","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.412842+0000","last_change":"2024-04-26T07:48:21.497773+0000","last_active":"2024-04-26T07:51:56.412842+0000","last_peered":"2024-04-26T07:51:56.412842+0000","last_clean":"2024-04-26T07:51:56.412842+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:51:56.412842+0000","last_undegraded":"2024-04-26T07:51:56.412842+0000","last_fullsized":"2024-04-26T07:51:56.412842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.454006+0000","last_change":"2024-04-26T07:52:06.454066+0000","last_active":"2024-04-26T07:52:06.454006+0000","last_peered":"2024-04-26T07:52:06.454006+0000","last_clean":"2024-04-26T07:52:06.454006+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:52:06.454006+0000","last_undegraded":"2024-04-26T07:52:06.454006+0000","last_fullsized":"2024-04-26T07:52:06.454006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-04-26T07:52:06.453798+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-04-26T07:52:06.453798+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.453798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:15.896501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"109'44","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.384469+0000","last_change":"2024-04-26T07:48:21.506366+0000","last_active":"2024-04-26T07:51:56.384469+0000","last_peered":"2024-04-26T07:51:56.384469+0000","last_clean":"2024-04-26T07:51:56.384469+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:51:56.384469+0000","last_undegraded":"2024-04-26T07:51:56.384469+0000","last_fullsized":"2024-04-26T07:51:56.384469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387484+0000","last_change":"2024-04-26T07:49:08.939923+0000","last_active":"2024-04-26T07:51:40.387484+0000","last_peered":"2024-04-26T07:51:40.387484+0000","last_clean":"2024-04-26T07:51:40.387484+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:51:40.387484+0000","last_undegraded":"2024-04-26T07:51:40.387484+0000","last_fullsized":"2024-04-26T07:51:40.387484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'46","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.064569+0000","last_change":"2024-04-26T07:52:06.064633+0000","last_active":"2024-04-26T07:52:06.064569+0000","last_peered":"2024-04-26T07:52:06.064569+0000","last_clean":"2024-04-26T07:52:06.064569+0000","last_became_active":"2024-04-26T07:51:40.433215+0000","last_became_peered":"2024-04-26T07:51:40.433215+0000","last_unstale":"2024-04-26T07:52:06.064569+0000","last_undegraded":"2024-04-26T07:52:06.064569+0000","last_fullsized":"2024-04-26T07:52:06.064569+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:06.064366+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:06.064366+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.064366+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:30.622681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.748761+0000","last_change":"2024-04-26T07:52:06.748822+0000","last_active":"2024-04-26T07:52:06.748761+0000","last_peered":"2024-04-26T07:52:06.748761+0000","last_clean":"2024-04-26T07:52:06.748761+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:52:06.748761+0000","last_undegraded":"2024-04-26T07:52:06.748761+0000","last_fullsized":"2024-04-26T07:52:06.748761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-26T07:52:06.748541+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-26T07:52:06.748541+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.748541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:31.061119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"109'44","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.164476+0000","last_change":"2024-04-26T07:52:16.164636+0000","last_active":"2024-04-26T07:52:16.164476+0000","last_peered":"2024-04-26T07:52:16.164476+0000","last_clean":"2024-04-26T07:52:16.164476+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:52:16.164476+0000","last_undegraded":"2024-04-26T07:52:16.164476+0000","last_fullsized":"2024-04-26T07:52:16.164476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:16.164249+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:16.164249+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.164249+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:39.986378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.499946+0000","last_change":"2024-04-26T07:52:12.500006+0000","last_active":"2024-04-26T07:52:12.499946+0000","last_peered":"2024-04-26T07:52:12.499946+0000","last_clean":"2024-04-26T07:52:12.499946+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:52:12.499946+0000","last_undegraded":"2024-04-26T07:52:12.499946+0000","last_fullsized":"2024-04-26T07:52:12.499946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-26T07:52:12.499701+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.499701+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.499701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:13.383983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"109'36","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.399216+0000","last_change":"2024-04-26T07:51:40.429122+0000","last_active":"2024-04-26T07:51:56.399216+0000","last_peered":"2024-04-26T07:51:56.399216+0000","last_clean":"2024-04-26T07:51:56.399216+0000","last_became_active":"2024-04-26T07:51:40.428267+0000","last_became_peered":"2024-04-26T07:51:40.428267+0000","last_unstale":"2024-04-26T07:51:56.399216+0000","last_undegraded":"2024-04-26T07:51:56.399216+0000","last_fullsized":"2024-04-26T07:51:56.399216+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":46,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.240649+0000","last_change":"2024-04-26T07:52:10.240714+0000","last_active":"2024-04-26T07:52:10.240649+0000","last_peered":"2024-04-26T07:52:10.240649+0000","last_clean":"2024-04-26T07:52:10.240649+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:52:10.240649+0000","last_undegraded":"2024-04-26T07:52:10.240649+0000","last_fullsized":"2024-04-26T07:52:10.240649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:10.240434+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:10.240434+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.240434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:51.174041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'46","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.416748+0000","last_change":"2024-04-26T07:48:21.506077+0000","last_active":"2024-04-26T07:51:56.416748+0000","last_peered":"2024-04-26T07:51:56.416748+0000","last_clean":"2024-04-26T07:51:56.416748+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:51:56.416748+0000","last_undegraded":"2024-04-26T07:51:56.416748+0000","last_fullsized":"2024-04-26T07:51:56.416748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.261260+0000","last_change":"2024-04-26T07:52:09.261323+0000","last_active":"2024-04-26T07:52:09.261260+0000","last_peered":"2024-04-26T07:52:09.261260+0000","last_clean":"2024-04-26T07:52:09.261260+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:52:09.261260+0000","last_undegraded":"2024-04-26T07:52:09.261260+0000","last_fullsized":"2024-04-26T07:52:09.261260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-26T07:52:09.261030+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-26T07:52:09.261030+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.261030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.240500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.451283+0000","last_change":"2024-04-26T07:52:08.451346+0000","last_active":"2024-04-26T07:52:08.451283+0000","last_peered":"2024-04-26T07:52:08.451283+0000","last_clean":"2024-04-26T07:52:08.451283+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:52:08.451283+0000","last_undegraded":"2024-04-26T07:52:08.451283+0000","last_fullsized":"2024-04-26T07:52:08.451283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2024-04-26T07:52:08.451067+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2024-04-26T07:52:08.451067+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.451067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:01.222132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'50","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.401903+0000","last_change":"2024-04-26T07:51:40.429380+0000","last_active":"2024-04-26T07:51:56.401903+0000","last_peered":"2024-04-26T07:51:56.401903+0000","last_clean":"2024-04-26T07:51:56.401903+0000","last_became_active":"2024-04-26T07:51:40.428461+0000","last_became_peered":"2024-04-26T07:51:40.428461+0000","last_unstale":"2024-04-26T07:51:56.401903+0000","last_undegraded":"2024-04-26T07:51:56.401903+0000","last_fullsized":"2024-04-26T07:51:56.401903+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.122600+0000","last_change":"2024-04-26T07:52:11.122718+0000","last_active":"2024-04-26T07:52:11.122600+0000","last_peered":"2024-04-26T07:52:11.122600+0000","last_clean":"2024-04-26T07:52:11.122600+0000","last_became_active":"2024-04-26T07:51:40.435585+0000","last_became_peered":"2024-04-26T07:51:40.435585+0000","last_unstale":"2024-04-26T07:52:11.122600+0000","last_undegraded":"2024-04-26T07:52:11.122600+0000","last_fullsized":"2024-04-26T07:52:11.122600+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:11.122301+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:11.122301+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.122301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.239827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"109'60","reported_seq":262,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.923151+0000","last_change":"2024-04-26T07:52:14.923212+0000","last_active":"2024-04-26T07:52:14.923151+0000","last_peered":"2024-04-26T07:52:14.923151+0000","last_clean":"2024-04-26T07:52:14.923151+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:52:14.923151+0000","last_undegraded":"2024-04-26T07:52:14.923151+0000","last_fullsized":"2024-04-26T07:52:14.923151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'60","last_scrub_stamp":"2024-04-26T07:52:14.922953+0000","last_deep_scrub":"109'60","last_deep_scrub_stamp":"2024-04-26T07:52:14.922953+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.922953+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:15.659118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":70,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.232920+0000","last_change":"2024-04-26T07:52:12.232987+0000","last_active":"2024-04-26T07:52:12.232920+0000","last_peered":"2024-04-26T07:52:12.232920+0000","last_clean":"2024-04-26T07:52:12.232920+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:52:12.232920+0000","last_undegraded":"2024-04-26T07:52:12.232920+0000","last_fullsized":"2024-04-26T07:52:12.232920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:12.232704+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:12.232704+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.232704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:18.870226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.865735+0000","last_change":"2024-04-26T07:52:12.865876+0000","last_active":"2024-04-26T07:52:12.865735+0000","last_peered":"2024-04-26T07:52:12.865735+0000","last_clean":"2024-04-26T07:52:12.865735+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:52:12.865735+0000","last_undegraded":"2024-04-26T07:52:12.865735+0000","last_fullsized":"2024-04-26T07:52:12.865735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:12.865444+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:12.865444+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.865444+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:20.079871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.247276+0000","last_change":"2024-04-26T07:52:08.247416+0000","last_active":"2024-04-26T07:52:08.247276+0000","last_peered":"2024-04-26T07:52:08.247276+0000","last_clean":"2024-04-26T07:52:08.247276+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:52:08.247276+0000","last_undegraded":"2024-04-26T07:52:08.247276+0000","last_fullsized":"2024-04-26T07:52:08.247276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-04-26T07:52:08.246988+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-04-26T07:52:08.246988+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.246988+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:03:31.264202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'48","reported_seq":241,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.357097+0000","last_change":"2024-04-26T07:48:21.503850+0000","last_active":"2024-04-26T07:51:56.357097+0000","last_peered":"2024-04-26T07:51:56.357097+0000","last_clean":"2024-04-26T07:51:56.357097+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:51:56.357097+0000","last_undegraded":"2024-04-26T07:51:56.357097+0000","last_fullsized":"2024-04-26T07:51:56.357097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.282867+0000","last_change":"2024-04-26T07:52:11.282934+0000","last_active":"2024-04-26T07:52:11.282867+0000","last_peered":"2024-04-26T07:52:11.282867+0000","last_clean":"2024-04-26T07:52:11.282867+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:52:11.282867+0000","last_undegraded":"2024-04-26T07:52:11.282867+0000","last_fullsized":"2024-04-26T07:52:11.282867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:11.282644+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:11.282644+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.282644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:27.077731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'42","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.194158+0000","last_change":"2024-04-26T07:48:21.503533+0000","last_active":"2024-04-26T07:51:56.194158+0000","last_peered":"2024-04-26T07:51:56.194158+0000","last_clean":"2024-04-26T07:51:56.194158+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:51:56.194158+0000","last_undegraded":"2024-04-26T07:51:56.194158+0000","last_fullsized":"2024-04-26T07:51:56.194158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.452305+0000","last_change":"2024-04-26T07:52:10.452417+0000","last_active":"2024-04-26T07:52:10.452305+0000","last_peered":"2024-04-26T07:52:10.452305+0000","last_clean":"2024-04-26T07:52:10.452305+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:52:10.452305+0000","last_undegraded":"2024-04-26T07:52:10.452305+0000","last_fullsized":"2024-04-26T07:52:10.452305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:10.452068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:10.452068+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.452068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:08.204803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'46","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.413815+0000","last_change":"2024-04-26T07:48:21.502344+0000","last_active":"2024-04-26T07:51:56.413815+0000","last_peered":"2024-04-26T07:51:56.413815+0000","last_clean":"2024-04-26T07:51:56.413815+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:51:56.413815+0000","last_undegraded":"2024-04-26T07:51:56.413815+0000","last_fullsized":"2024-04-26T07:51:56.413815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394773+0000","last_change":"2024-04-26T07:48:31.596118+0000","last_active":"2024-04-26T07:51:40.394773+0000","last_peered":"2024-04-26T07:51:40.394773+0000","last_clean":"2024-04-26T07:51:40.394773+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:51:40.394773+0000","last_undegraded":"2024-04-26T07:51:40.394773+0000","last_fullsized":"2024-04-26T07:51:40.394773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393450+0000","last_change":"2024-04-26T07:48:23.534261+0000","last_active":"2024-04-26T07:51:40.393450+0000","last_peered":"2024-04-26T07:51:40.393450+0000","last_clean":"2024-04-26T07:51:40.393450+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:51:40.393450+0000","last_undegraded":"2024-04-26T07:51:40.393450+0000","last_fullsized":"2024-04-26T07:51:40.393450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'38","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.097901+0000","last_change":"2024-04-26T07:49:08.974080+0000","last_active":"2024-04-26T07:51:56.097901+0000","last_peered":"2024-04-26T07:51:56.097901+0000","last_clean":"2024-04-26T07:51:56.097901+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:51:56.097901+0000","last_undegraded":"2024-04-26T07:51:56.097901+0000","last_fullsized":"2024-04-26T07:51:56.097901+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414455+0000","last_change":"2024-04-26T07:48:25.560076+0000","last_active":"2024-04-26T07:51:40.414455+0000","last_peered":"2024-04-26T07:51:40.414455+0000","last_clean":"2024-04-26T07:51:40.414455+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:51:40.414455+0000","last_undegraded":"2024-04-26T07:51:40.414455+0000","last_fullsized":"2024-04-26T07:51:40.414455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"109'20","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.465704+0000","last_change":"2024-04-26T07:48:27.581782+0000","last_active":"2024-04-26T07:51:55.465704+0000","last_peered":"2024-04-26T07:51:55.465704+0000","last_clean":"2024-04-26T07:51:55.465704+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:51:55.465704+0000","last_undegraded":"2024-04-26T07:51:55.465704+0000","last_fullsized":"2024-04-26T07:51:55.465704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":133,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.440147+0000","last_change":"2024-04-26T07:51:40.427384+0000","last_active":"2024-04-26T07:51:40.440147+0000","last_peered":"2024-04-26T07:51:40.440147+0000","last_clean":"2024-04-26T07:51:40.440147+0000","last_became_active":"2024-04-26T07:51:40.424563+0000","last_became_peered":"2024-04-26T07:51:40.424563+0000","last_unstale":"2024-04-26T07:51:40.440147+0000","last_undegraded":"2024-04-26T07:51:40.440147+0000","last_fullsized":"2024-04-26T07:51:40.440147+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"90'51","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410154+0000","last_change":"2024-04-26T07:48:31.601713+0000","last_active":"2024-04-26T07:51:40.410154+0000","last_peered":"2024-04-26T07:51:40.410154+0000","last_clean":"2024-04-26T07:51:40.410154+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:51:40.410154+0000","last_undegraded":"2024-04-26T07:51:40.410154+0000","last_fullsized":"2024-04-26T07:51:40.410154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.201772+0000","last_change":"2024-04-26T07:52:13.201839+0000","last_active":"2024-04-26T07:52:13.201772+0000","last_peered":"2024-04-26T07:52:13.201772+0000","last_clean":"2024-04-26T07:52:13.201772+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:52:13.201772+0000","last_undegraded":"2024-04-26T07:52:13.201772+0000","last_fullsized":"2024-04-26T07:52:13.201772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-04-26T07:52:13.201566+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-04-26T07:52:13.201566+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.201566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:18.051414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"109'40","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.348235+0000","last_change":"2024-04-26T07:48:21.523850+0000","last_active":"2024-04-26T07:51:56.348235+0000","last_peered":"2024-04-26T07:51:56.348235+0000","last_clean":"2024-04-26T07:51:56.348235+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:51:56.348235+0000","last_undegraded":"2024-04-26T07:51:56.348235+0000","last_fullsized":"2024-04-26T07:51:56.348235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393317+0000","last_change":"2024-04-26T07:48:25.575953+0000","last_active":"2024-04-26T07:51:40.393317+0000","last_peered":"2024-04-26T07:51:40.393317+0000","last_clean":"2024-04-26T07:51:40.393317+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:51:40.393317+0000","last_undegraded":"2024-04-26T07:51:40.393317+0000","last_fullsized":"2024-04-26T07:51:40.393317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"109'10","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.492370+0000","last_change":"2024-04-26T07:52:03.492498+0000","last_active":"2024-04-26T07:52:03.492370+0000","last_peered":"2024-04-26T07:52:03.492370+0000","last_clean":"2024-04-26T07:52:03.492370+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:52:03.492370+0000","last_undegraded":"2024-04-26T07:52:03.492370+0000","last_fullsized":"2024-04-26T07:52:03.492370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'10","last_scrub_stamp":"2024-04-26T07:52:03.492141+0000","last_deep_scrub":"109'10","last_deep_scrub_stamp":"2024-04-26T07:52:03.492141+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.492141+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:06.056305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396440+0000","last_change":"2024-04-26T07:48:29.594499+0000","last_active":"2024-04-26T07:51:40.396440+0000","last_peered":"2024-04-26T07:51:40.396440+0000","last_clean":"2024-04-26T07:51:40.396440+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:51:40.396440+0000","last_undegraded":"2024-04-26T07:51:40.396440+0000","last_fullsized":"2024-04-26T07:51:40.396440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.664126+0000","last_change":"2024-04-26T07:52:05.664179+0000","last_active":"2024-04-26T07:52:05.664126+0000","last_peered":"2024-04-26T07:52:05.664126+0000","last_clean":"2024-04-26T07:52:05.664126+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:52:05.664126+0000","last_undegraded":"2024-04-26T07:52:05.664126+0000","last_fullsized":"2024-04-26T07:52:05.664126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.663918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.663918+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.663918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:48.628816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.633760+0000","last_change":"2024-04-26T07:52:12.633822+0000","last_active":"2024-04-26T07:52:12.633760+0000","last_peered":"2024-04-26T07:52:12.633760+0000","last_clean":"2024-04-26T07:52:12.633760+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:52:12.633760+0000","last_undegraded":"2024-04-26T07:52:12.633760+0000","last_fullsized":"2024-04-26T07:52:12.633760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:12.633562+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.633562+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.633562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:22.886192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"109'44","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.379505+0000","last_change":"2024-04-26T07:51:40.441938+0000","last_active":"2024-04-26T07:51:56.379505+0000","last_peered":"2024-04-26T07:51:56.379505+0000","last_clean":"2024-04-26T07:51:56.379505+0000","last_became_active":"2024-04-26T07:51:40.440255+0000","last_became_peered":"2024-04-26T07:51:40.440255+0000","last_unstale":"2024-04-26T07:51:56.379505+0000","last_undegraded":"2024-04-26T07:51:56.379505+0000","last_fullsized":"2024-04-26T07:51:56.379505+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394890+0000","last_change":"2024-04-26T07:48:25.574827+0000","last_active":"2024-04-26T07:51:40.394890+0000","last_peered":"2024-04-26T07:51:40.394890+0000","last_clean":"2024-04-26T07:51:40.394890+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:51:40.394890+0000","last_undegraded":"2024-04-26T07:51:40.394890+0000","last_fullsized":"2024-04-26T07:51:40.394890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.277823+0000","last_change":"2024-04-26T07:52:14.277902+0000","last_active":"2024-04-26T07:52:14.277823+0000","last_peered":"2024-04-26T07:52:14.277823+0000","last_clean":"2024-04-26T07:52:14.277823+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:52:14.277823+0000","last_undegraded":"2024-04-26T07:52:14.277823+0000","last_fullsized":"2024-04-26T07:52:14.277823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:14.277616+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:14.277616+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.277616+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:00.703376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"109'140","reported_seq":315,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.480220+0000","last_change":"2024-04-26T07:51:40.446383+0000","last_active":"2024-04-26T07:51:56.480220+0000","last_peered":"2024-04-26T07:51:56.480220+0000","last_clean":"2024-04-26T07:51:56.480220+0000","last_became_active":"2024-04-26T07:51:40.439601+0000","last_became_peered":"2024-04-26T07:51:40.439601+0000","last_unstale":"2024-04-26T07:51:56.480220+0000","last_undegraded":"2024-04-26T07:51:56.480220+0000","last_fullsized":"2024-04-26T07:51:56.480220+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396070+0000","last_change":"2024-04-26T07:48:31.755590+0000","last_active":"2024-04-26T07:51:40.396070+0000","last_peered":"2024-04-26T07:51:40.396070+0000","last_clean":"2024-04-26T07:51:40.396070+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:51:40.396070+0000","last_undegraded":"2024-04-26T07:51:40.396070+0000","last_fullsized":"2024-04-26T07:51:40.396070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.805342+0000","last_change":"2024-04-26T07:52:15.805420+0000","last_active":"2024-04-26T07:52:15.805342+0000","last_peered":"2024-04-26T07:52:15.805342+0000","last_clean":"2024-04-26T07:52:15.805342+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:52:15.805342+0000","last_undegraded":"2024-04-26T07:52:15.805342+0000","last_fullsized":"2024-04-26T07:52:15.805342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T07:52:15.805087+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T07:52:15.805087+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.805087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:39.922613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"109'34","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.938380+0000","last_change":"2024-04-26T07:52:15.938439+0000","last_active":"2024-04-26T07:52:15.938380+0000","last_peered":"2024-04-26T07:52:15.938380+0000","last_clean":"2024-04-26T07:52:15.938380+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:52:15.938380+0000","last_undegraded":"2024-04-26T07:52:15.938380+0000","last_fullsized":"2024-04-26T07:52:15.938380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'34","last_scrub_stamp":"2024-04-26T07:52:15.938189+0000","last_deep_scrub":"109'34","last_deep_scrub_stamp":"2024-04-26T07:52:15.938189+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.938189+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:52:23.210957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414528+0000","last_change":"2024-04-26T07:48:25.558519+0000","last_active":"2024-04-26T07:51:40.414528+0000","last_peered":"2024-04-26T07:51:40.414528+0000","last_clean":"2024-04-26T07:51:40.414528+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:51:40.414528+0000","last_undegraded":"2024-04-26T07:51:40.414528+0000","last_fullsized":"2024-04-26T07:51:40.414528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"109'20","reported_seq":167,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.465469+0000","last_change":"2024-04-26T07:51:40.447428+0000","last_active":"2024-04-26T07:51:56.465469+0000","last_peered":"2024-04-26T07:51:56.465469+0000","last_clean":"2024-04-26T07:51:56.465469+0000","last_became_active":"2024-04-26T07:51:40.441381+0000","last_became_peered":"2024-04-26T07:51:40.441381+0000","last_unstale":"2024-04-26T07:51:56.465469+0000","last_undegraded":"2024-04-26T07:51:56.465469+0000","last_fullsized":"2024-04-26T07:51:56.465469+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"109'138","reported_seq":364,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.878275+0000","last_change":"2024-04-26T07:52:01.878315+0000","last_active":"2024-04-26T07:52:01.878275+0000","last_peered":"2024-04-26T07:52:01.878275+0000","last_clean":"2024-04-26T07:52:01.878275+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:52:01.878275+0000","last_undegraded":"2024-04-26T07:52:01.878275+0000","last_fullsized":"2024-04-26T07:52:01.878275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:01.878187+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:01.878187+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.878187+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:18.982430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.206891+0000","last_change":"2024-04-26T07:52:11.207035+0000","last_active":"2024-04-26T07:52:11.206891+0000","last_peered":"2024-04-26T07:52:11.206891+0000","last_clean":"2024-04-26T07:52:11.206891+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:52:11.206891+0000","last_undegraded":"2024-04-26T07:52:11.206891+0000","last_fullsized":"2024-04-26T07:52:11.206891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.206632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.206632+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.206632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:10.071458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"109'54","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.158131+0000","last_change":"2024-04-26T07:52:12.158189+0000","last_active":"2024-04-26T07:52:12.158131+0000","last_peered":"2024-04-26T07:52:12.158131+0000","last_clean":"2024-04-26T07:52:12.158131+0000","last_became_active":"2024-04-26T07:51:40.432352+0000","last_became_peered":"2024-04-26T07:51:40.432352+0000","last_unstale":"2024-04-26T07:52:12.158131+0000","last_undegraded":"2024-04-26T07:52:12.158131+0000","last_fullsized":"2024-04-26T07:52:12.158131+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'54","last_scrub_stamp":"2024-04-26T07:52:12.157906+0000","last_deep_scrub":"109'54","last_deep_scrub_stamp":"2024-04-26T07:52:12.157906+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.157906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:20.821794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.081213+0000","last_change":"2024-04-26T07:52:07.081269+0000","last_active":"2024-04-26T07:52:07.081213+0000","last_peered":"2024-04-26T07:52:07.081213+0000","last_clean":"2024-04-26T07:52:07.081213+0000","last_became_active":"2024-04-26T07:51:40.432366+0000","last_became_peered":"2024-04-26T07:51:40.432366+0000","last_unstale":"2024-04-26T07:52:07.081213+0000","last_undegraded":"2024-04-26T07:52:07.081213+0000","last_fullsized":"2024-04-26T07:52:07.081213+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.081009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.081009+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.081009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:54.855694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"109'38","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.201154+0000","last_change":"2024-04-26T07:52:02.201272+0000","last_active":"2024-04-26T07:52:02.201154+0000","last_peered":"2024-04-26T07:52:02.201154+0000","last_clean":"2024-04-26T07:52:02.201154+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:52:02.201154+0000","last_undegraded":"2024-04-26T07:52:02.201154+0000","last_fullsized":"2024-04-26T07:52:02.201154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:02.200966+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:02.200966+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.200966+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:09.415392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409420+0000","last_change":"2024-04-26T07:48:29.576785+0000","last_active":"2024-04-26T07:51:40.409420+0000","last_peered":"2024-04-26T07:51:40.409420+0000","last_clean":"2024-04-26T07:51:40.409420+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:51:40.409420+0000","last_undegraded":"2024-04-26T07:51:40.409420+0000","last_fullsized":"2024-04-26T07:51:40.409420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414127+0000","last_change":"2024-04-26T07:48:31.600940+0000","last_active":"2024-04-26T07:51:40.414127+0000","last_peered":"2024-04-26T07:51:40.414127+0000","last_clean":"2024-04-26T07:51:40.414127+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:51:40.414127+0000","last_undegraded":"2024-04-26T07:51:40.414127+0000","last_fullsized":"2024-04-26T07:51:40.414127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.392691+0000","last_change":"2024-04-26T07:52:15.392753+0000","last_active":"2024-04-26T07:52:15.392691+0000","last_peered":"2024-04-26T07:52:15.392691+0000","last_clean":"2024-04-26T07:52:15.392691+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:52:15.392691+0000","last_undegraded":"2024-04-26T07:52:15.392691+0000","last_fullsized":"2024-04-26T07:52:15.392691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:15.392452+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:15.392452+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.392452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.950767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"109'48","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.196667+0000","last_change":"2024-04-26T07:52:14.196735+0000","last_active":"2024-04-26T07:52:14.196667+0000","last_peered":"2024-04-26T07:52:14.196667+0000","last_clean":"2024-04-26T07:52:14.196667+0000","last_became_active":"2024-04-26T07:51:40.431661+0000","last_became_peered":"2024-04-26T07:51:40.431661+0000","last_unstale":"2024-04-26T07:52:14.196667+0000","last_undegraded":"2024-04-26T07:52:14.196667+0000","last_fullsized":"2024-04-26T07:52:14.196667+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:14.196452+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:14.196452+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.196452+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:29.949849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.302556+0000","last_change":"2024-04-26T07:52:03.302694+0000","last_active":"2024-04-26T07:52:03.302556+0000","last_peered":"2024-04-26T07:52:03.302556+0000","last_clean":"2024-04-26T07:52:03.302556+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:52:03.302556+0000","last_undegraded":"2024-04-26T07:52:03.302556+0000","last_fullsized":"2024-04-26T07:52:03.302556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.302295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.302295+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.302295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:39.830995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"109'23","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.834034+0000","last_change":"2024-04-26T07:52:06.834194+0000","last_active":"2024-04-26T07:52:06.834034+0000","last_peered":"2024-04-26T07:52:06.834034+0000","last_clean":"2024-04-26T07:52:06.834034+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:52:06.834034+0000","last_undegraded":"2024-04-26T07:52:06.834034+0000","last_fullsized":"2024-04-26T07:52:06.834034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'23","last_scrub_stamp":"2024-04-26T07:52:06.833802+0000","last_deep_scrub":"109'23","last_deep_scrub_stamp":"2024-04-26T07:52:06.833802+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.833802+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:11.683650+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.897942+0000","last_change":"2024-04-26T07:52:00.897979+0000","last_active":"2024-04-26T07:52:00.897942+0000","last_peered":"2024-04-26T07:52:00.897942+0000","last_clean":"2024-04-26T07:52:00.897942+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:52:00.897942+0000","last_undegraded":"2024-04-26T07:52:00.897942+0000","last_fullsized":"2024-04-26T07:52:00.897942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:00.897847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:00.897847+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.897847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:10.340550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.411651+0000","last_change":"2024-04-26T07:48:31.589262+0000","last_active":"2024-04-26T07:51:40.411651+0000","last_peered":"2024-04-26T07:51:40.411651+0000","last_clean":"2024-04-26T07:51:40.411651+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:51:40.411651+0000","last_undegraded":"2024-04-26T07:51:40.411651+0000","last_fullsized":"2024-04-26T07:51:40.411651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.793661+0000","last_change":"2024-04-26T07:52:08.793723+0000","last_active":"2024-04-26T07:52:08.793661+0000","last_peered":"2024-04-26T07:52:08.793661+0000","last_clean":"2024-04-26T07:52:08.793661+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:52:08.793661+0000","last_undegraded":"2024-04-26T07:52:08.793661+0000","last_fullsized":"2024-04-26T07:52:08.793661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:08.793455+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:08.793455+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.793455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:25.612602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"109'50","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.424500+0000","last_change":"2024-04-26T07:51:40.448016+0000","last_active":"2024-04-26T07:51:56.424500+0000","last_peered":"2024-04-26T07:51:56.424500+0000","last_clean":"2024-04-26T07:51:56.424500+0000","last_became_active":"2024-04-26T07:51:40.444713+0000","last_became_peered":"2024-04-26T07:51:40.444713+0000","last_unstale":"2024-04-26T07:51:56.424500+0000","last_undegraded":"2024-04-26T07:51:56.424500+0000","last_fullsized":"2024-04-26T07:51:56.424500+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.244619+0000","last_change":"2024-04-26T07:52:01.244670+0000","last_active":"2024-04-26T07:52:01.244619+0000","last_peered":"2024-04-26T07:52:01.244619+0000","last_clean":"2024-04-26T07:52:01.244619+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:52:01.244619+0000","last_undegraded":"2024-04-26T07:52:01.244619+0000","last_fullsized":"2024-04-26T07:52:01.244619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.244437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.244437+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.244437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:35.063751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"109'35","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.046001+0000","last_change":"2024-04-26T07:52:04.046087+0000","last_active":"2024-04-26T07:52:04.046001+0000","last_peered":"2024-04-26T07:52:04.046001+0000","last_clean":"2024-04-26T07:52:04.046001+0000","last_became_active":"2024-04-26T07:51:40.438940+0000","last_became_peered":"2024-04-26T07:51:40.438940+0000","last_unstale":"2024-04-26T07:52:04.046001+0000","last_undegraded":"2024-04-26T07:52:04.046001+0000","last_fullsized":"2024-04-26T07:52:04.046001+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'35","last_scrub_stamp":"2024-04-26T07:52:04.045815+0000","last_deep_scrub":"109'35","last_deep_scrub_stamp":"2024-04-26T07:52:04.045815+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.045815+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:29.419100+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":153,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"109'138","reported_seq":362,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.662811+0000","last_change":"2024-04-26T07:52:00.662851+0000","last_active":"2024-04-26T07:52:00.662811+0000","last_peered":"2024-04-26T07:52:00.662811+0000","last_clean":"2024-04-26T07:52:00.662811+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:52:00.662811+0000","last_undegraded":"2024-04-26T07:52:00.662811+0000","last_fullsized":"2024-04-26T07:52:00.662811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:00.662728+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:00.662728+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.662728+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:34.806313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388503+0000","last_change":"2024-04-26T07:48:31.596187+0000","last_active":"2024-04-26T07:51:40.388503+0000","last_peered":"2024-04-26T07:51:40.388503+0000","last_clean":"2024-04-26T07:51:40.388503+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:51:40.388503+0000","last_undegraded":"2024-04-26T07:51:40.388503+0000","last_fullsized":"2024-04-26T07:51:40.388503+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.388233+0000","last_change":"2024-04-26T07:48:23.540267+0000","last_active":"2024-04-26T07:51:40.388233+0000","last_peered":"2024-04-26T07:51:40.388233+0000","last_clean":"2024-04-26T07:51:40.388233+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:51:40.388233+0000","last_undegraded":"2024-04-26T07:51:40.388233+0000","last_fullsized":"2024-04-26T07:51:40.388233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"109'48","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.411842+0000","last_change":"2024-04-26T07:48:21.506463+0000","last_active":"2024-04-26T07:51:56.411842+0000","last_peered":"2024-04-26T07:51:56.411842+0000","last_clean":"2024-04-26T07:51:56.411842+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:51:56.411842+0000","last_undegraded":"2024-04-26T07:51:56.411842+0000","last_fullsized":"2024-04-26T07:51:56.411842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.310850+0000","last_change":"2024-04-26T07:52:04.310901+0000","last_active":"2024-04-26T07:52:04.310850+0000","last_peered":"2024-04-26T07:52:04.310850+0000","last_clean":"2024-04-26T07:52:04.310850+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:52:04.310850+0000","last_undegraded":"2024-04-26T07:52:04.310850+0000","last_fullsized":"2024-04-26T07:52:04.310850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.310639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.310639+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.310639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:31.403021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'35","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.429205+0000","last_change":"2024-04-26T07:48:27.584321+0000","last_active":"2024-04-26T07:51:56.429205+0000","last_peered":"2024-04-26T07:51:56.429205+0000","last_clean":"2024-04-26T07:51:56.429205+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:51:56.429205+0000","last_undegraded":"2024-04-26T07:51:56.429205+0000","last_fullsized":"2024-04-26T07:51:56.429205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.228544+0000","last_change":"2024-04-26T07:52:17.228596+0000","last_active":"2024-04-26T07:52:17.228544+0000","last_peered":"2024-04-26T07:52:17.228544+0000","last_clean":"2024-04-26T07:52:17.228544+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:52:17.228544+0000","last_undegraded":"2024-04-26T07:52:17.228544+0000","last_fullsized":"2024-04-26T07:52:17.228544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.228351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.228351+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.228351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:22.177055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"86'5","reported_seq":201,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410246+0000","last_change":"2024-04-26T07:48:31.601008+0000","last_active":"2024-04-26T07:51:40.410246+0000","last_peered":"2024-04-26T07:51:40.410246+0000","last_clean":"2024-04-26T07:51:40.410246+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:51:40.410246+0000","last_undegraded":"2024-04-26T07:51:40.410246+0000","last_fullsized":"2024-04-26T07:51:40.410246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.398528+0000","last_change":"2024-04-26T07:48:23.523793+0000","last_active":"2024-04-26T07:51:40.398528+0000","last_peered":"2024-04-26T07:51:40.398528+0000","last_clean":"2024-04-26T07:51:40.398528+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:51:40.398528+0000","last_undegraded":"2024-04-26T07:51:40.398528+0000","last_fullsized":"2024-04-26T07:51:40.398528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"109'58","reported_seq":252,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.397777+0000","last_change":"2024-04-26T07:48:21.499644+0000","last_active":"2024-04-26T07:51:56.397777+0000","last_peered":"2024-04-26T07:51:56.397777+0000","last_clean":"2024-04-26T07:51:56.397777+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:51:56.397777+0000","last_undegraded":"2024-04-26T07:51:56.397777+0000","last_fullsized":"2024-04-26T07:51:56.397777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.256236+0000","last_change":"2024-04-26T07:52:13.256290+0000","last_active":"2024-04-26T07:52:13.256236+0000","last_peered":"2024-04-26T07:52:13.256236+0000","last_clean":"2024-04-26T07:52:13.256236+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:52:13.256236+0000","last_undegraded":"2024-04-26T07:52:13.256236+0000","last_fullsized":"2024-04-26T07:52:13.256236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.256011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.256011+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.256011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:57.356082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"109'27","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.488331+0000","last_change":"2024-04-26T07:52:01.488414+0000","last_active":"2024-04-26T07:52:01.488331+0000","last_peered":"2024-04-26T07:52:01.488331+0000","last_clean":"2024-04-26T07:52:01.488331+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:52:01.488331+0000","last_undegraded":"2024-04-26T07:52:01.488331+0000","last_fullsized":"2024-04-26T07:52:01.488331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'27","last_scrub_stamp":"2024-04-26T07:52:01.488121+0000","last_deep_scrub":"109'27","last_deep_scrub_stamp":"2024-04-26T07:52:01.488121+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.488121+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:08.702547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.616322+0000","last_change":"2024-04-26T07:52:04.616379+0000","last_active":"2024-04-26T07:52:04.616322+0000","last_peered":"2024-04-26T07:52:04.616322+0000","last_clean":"2024-04-26T07:52:04.616322+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:52:04.616322+0000","last_undegraded":"2024-04-26T07:52:04.616322+0000","last_fullsized":"2024-04-26T07:52:04.616322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.616119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.616119+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.616119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:02.368854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.390140+0000","last_change":"2024-04-26T07:48:31.610215+0000","last_active":"2024-04-26T07:51:40.390140+0000","last_peered":"2024-04-26T07:51:40.390140+0000","last_clean":"2024-04-26T07:51:40.390140+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:51:40.390140+0000","last_undegraded":"2024-04-26T07:51:40.390140+0000","last_fullsized":"2024-04-26T07:51:40.390140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396996+0000","last_change":"2024-04-26T07:48:23.527208+0000","last_active":"2024-04-26T07:51:40.396996+0000","last_peered":"2024-04-26T07:51:40.396996+0000","last_clean":"2024-04-26T07:51:40.396996+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:51:40.396996+0000","last_undegraded":"2024-04-26T07:51:40.396996+0000","last_fullsized":"2024-04-26T07:51:40.396996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"109'50","reported_seq":251,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.965615+0000","last_change":"2024-04-26T07:52:16.965742+0000","last_active":"2024-04-26T07:52:16.965615+0000","last_peered":"2024-04-26T07:52:16.965615+0000","last_clean":"2024-04-26T07:52:16.965615+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:52:16.965615+0000","last_undegraded":"2024-04-26T07:52:16.965615+0000","last_fullsized":"2024-04-26T07:52:16.965615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:16.965395+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:16.965395+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.965395+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:25.582176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.533551+0000","last_change":"2024-04-26T07:52:07.533606+0000","last_active":"2024-04-26T07:52:07.533551+0000","last_peered":"2024-04-26T07:52:07.533551+0000","last_clean":"2024-04-26T07:52:07.533551+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:52:07.533551+0000","last_undegraded":"2024-04-26T07:52:07.533551+0000","last_fullsized":"2024-04-26T07:52:07.533551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.533355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.533355+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.533355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:12.482059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"109'33","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.241835+0000","last_change":"2024-04-26T07:52:15.241989+0000","last_active":"2024-04-26T07:52:15.241835+0000","last_peered":"2024-04-26T07:52:15.241835+0000","last_clean":"2024-04-26T07:52:15.241835+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:52:15.241835+0000","last_undegraded":"2024-04-26T07:52:15.241835+0000","last_fullsized":"2024-04-26T07:52:15.241835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'33","last_scrub_stamp":"2024-04-26T07:52:15.241568+0000","last_deep_scrub":"109'33","last_deep_scrub_stamp":"2024-04-26T07:52:15.241568+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.241568+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:12.356672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"109'138","reported_seq":379,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.220312+0000","last_change":"2024-04-26T07:52:16.220376+0000","last_active":"2024-04-26T07:52:16.220312+0000","last_peered":"2024-04-26T07:52:16.220312+0000","last_clean":"2024-04-26T07:52:16.220312+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:52:16.220312+0000","last_undegraded":"2024-04-26T07:52:16.220312+0000","last_fullsized":"2024-04-26T07:52:16.220312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:16.220114+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:16.220114+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.220114+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:23.434541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409096+0000","last_change":"2024-04-26T07:48:31.591006+0000","last_active":"2024-04-26T07:51:40.409096+0000","last_peered":"2024-04-26T07:51:40.409096+0000","last_clean":"2024-04-26T07:51:40.409096+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:51:40.409096+0000","last_undegraded":"2024-04-26T07:51:40.409096+0000","last_fullsized":"2024-04-26T07:51:40.409096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.474346+0000","last_change":"2024-04-26T07:52:11.474410+0000","last_active":"2024-04-26T07:52:11.474346+0000","last_peered":"2024-04-26T07:52:11.474346+0000","last_clean":"2024-04-26T07:52:11.474346+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:52:11.474346+0000","last_undegraded":"2024-04-26T07:52:11.474346+0000","last_fullsized":"2024-04-26T07:52:11.474346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:11.474096+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:11.474096+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.474096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:16.323944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"109'60","reported_seq":253,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.420877+0000","last_change":"2024-04-26T07:48:21.499119+0000","last_active":"2024-04-26T07:51:56.420877+0000","last_peered":"2024-04-26T07:51:56.420877+0000","last_clean":"2024-04-26T07:51:56.420877+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:51:56.420877+0000","last_undegraded":"2024-04-26T07:51:56.420877+0000","last_fullsized":"2024-04-26T07:51:56.420877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"109'4","reported_seq":378,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.152436+0000","last_change":"2024-04-26T07:52:15.152502+0000","last_active":"2024-04-26T07:52:15.152436+0000","last_peered":"2024-04-26T07:52:15.152436+0000","last_clean":"2024-04-26T07:52:15.152436+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:52:15.152436+0000","last_undegraded":"2024-04-26T07:52:15.152436+0000","last_fullsized":"2024-04-26T07:52:15.152436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'4","last_scrub_stamp":"2024-04-26T07:52:15.152246+0000","last_deep_scrub":"109'4","last_deep_scrub_stamp":"2024-04-26T07:52:15.152246+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.152246+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:40.525531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.839154+0000","last_change":"2024-04-26T07:52:04.839233+0000","last_active":"2024-04-26T07:52:04.839154+0000","last_peered":"2024-04-26T07:52:04.839154+0000","last_clean":"2024-04-26T07:52:04.839154+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:52:04.839154+0000","last_undegraded":"2024-04-26T07:52:04.839154+0000","last_fullsized":"2024-04-26T07:52:04.839154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:04.838959+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:04.838959+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.838959+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:03.703786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"109'138","reported_seq":406,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.482916+0000","last_change":"2024-04-26T07:48:29.574768+0000","last_active":"2024-04-26T07:51:56.482916+0000","last_peered":"2024-04-26T07:51:56.482916+0000","last_clean":"2024-04-26T07:51:56.482916+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:51:56.482916+0000","last_undegraded":"2024-04-26T07:51:56.482916+0000","last_fullsized":"2024-04-26T07:51:56.482916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.400665+0000","last_change":"2024-04-26T07:48:31.580267+0000","last_active":"2024-04-26T07:51:40.400665+0000","last_peered":"2024-04-26T07:51:40.400665+0000","last_clean":"2024-04-26T07:51:40.400665+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:51:40.400665+0000","last_undegraded":"2024-04-26T07:51:40.400665+0000","last_fullsized":"2024-04-26T07:51:40.400665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":166,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394526+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:40.394526+0000","last_peered":"2024-04-26T07:51:40.394526+0000","last_clean":"2024-04-26T07:51:40.394526+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:40.394526+0000","last_undegraded":"2024-04-26T07:51:40.394526+0000","last_fullsized":"2024-04-26T07:51:40.394526+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"109'58","reported_seq":252,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.369142+0000","last_change":"2024-04-26T07:48:21.502489+0000","last_active":"2024-04-26T07:51:56.369142+0000","last_peered":"2024-04-26T07:51:56.369142+0000","last_clean":"2024-04-26T07:51:56.369142+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:51:56.369142+0000","last_undegraded":"2024-04-26T07:51:56.369142+0000","last_fullsized":"2024-04-26T07:51:56.369142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.360458+0000","last_change":"2024-04-26T07:52:16.360510+0000","last_active":"2024-04-26T07:52:16.360458+0000","last_peered":"2024-04-26T07:52:16.360458+0000","last_clean":"2024-04-26T07:52:16.360458+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:52:16.360458+0000","last_undegraded":"2024-04-26T07:52:16.360458+0000","last_fullsized":"2024-04-26T07:52:16.360458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:16.360269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:16.360269+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.360269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:04.134953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"109'36","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.208054+0000","last_change":"2024-04-26T07:52:04.208140+0000","last_active":"2024-04-26T07:52:04.208054+0000","last_peered":"2024-04-26T07:52:04.208054+0000","last_clean":"2024-04-26T07:52:04.208054+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:52:04.208054+0000","last_undegraded":"2024-04-26T07:52:04.208054+0000","last_fullsized":"2024-04-26T07:52:04.208054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:04.207861+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:04.207861+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.207861+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:06.772025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409848+0000","last_change":"2024-04-26T07:48:29.579517+0000","last_active":"2024-04-26T07:51:40.409848+0000","last_peered":"2024-04-26T07:51:40.409848+0000","last_clean":"2024-04-26T07:51:40.409848+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:51:40.409848+0000","last_undegraded":"2024-04-26T07:51:40.409848+0000","last_fullsized":"2024-04-26T07:51:40.409848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409662+0000","last_change":"2024-04-26T07:48:31.610195+0000","last_active":"2024-04-26T07:51:40.409662+0000","last_peered":"2024-04-26T07:51:40.409662+0000","last_clean":"2024-04-26T07:51:40.409662+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:51:40.409662+0000","last_undegraded":"2024-04-26T07:51:40.409662+0000","last_fullsized":"2024-04-26T07:51:40.409662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.868649+0000","last_change":"2024-04-26T07:52:02.868761+0000","last_active":"2024-04-26T07:52:02.868649+0000","last_peered":"2024-04-26T07:52:02.868649+0000","last_clean":"2024-04-26T07:52:02.868649+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:52:02.868649+0000","last_undegraded":"2024-04-26T07:52:02.868649+0000","last_fullsized":"2024-04-26T07:52:02.868649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-26T07:52:02.868394+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-26T07:52:02.868394+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.868394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:08.921031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"109'119","reported_seq":316,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.111271+0000","last_change":"2024-04-26T07:52:08.111271+0000","last_active":"2024-04-26T07:52:08.111271+0000","last_peered":"2024-04-26T07:52:08.111271+0000","last_clean":"2024-04-26T07:52:08.111271+0000","last_became_active":"2024-04-26T07:51:40.429475+0000","last_became_peered":"2024-04-26T07:51:40.429475+0000","last_unstale":"2024-04-26T07:52:08.111271+0000","last_undegraded":"2024-04-26T07:52:08.111271+0000","last_fullsized":"2024-04-26T07:52:08.111271+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'119","last_scrub_stamp":"2024-04-26T07:52:08.110978+0000","last_deep_scrub":"109'119","last_deep_scrub_stamp":"2024-04-26T07:52:08.110978+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.110978+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:49.613873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414682+0000","last_change":"2024-04-26T07:48:15.449319+0000","last_active":"2024-04-26T07:51:40.414682+0000","last_peered":"2024-04-26T07:51:40.414682+0000","last_clean":"2024-04-26T07:51:40.414682+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:51:40.414682+0000","last_undegraded":"2024-04-26T07:51:40.414682+0000","last_fullsized":"2024-04-26T07:51:40.414682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"109'42","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.421818+0000","last_change":"2024-04-26T07:48:21.528983+0000","last_active":"2024-04-26T07:51:56.421818+0000","last_peered":"2024-04-26T07:51:56.421818+0000","last_clean":"2024-04-26T07:51:56.421818+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:51:56.421818+0000","last_undegraded":"2024-04-26T07:51:56.421818+0000","last_fullsized":"2024-04-26T07:51:56.421818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.283655+0000","last_change":"2024-04-26T07:52:18.283711+0000","last_active":"2024-04-26T07:52:18.283655+0000","last_peered":"2024-04-26T07:52:18.283655+0000","last_clean":"2024-04-26T07:52:18.283655+0000","last_became_active":"2024-04-26T07:51:40.428641+0000","last_became_peered":"2024-04-26T07:51:40.428641+0000","last_unstale":"2024-04-26T07:52:18.283655+0000","last_undegraded":"2024-04-26T07:52:18.283655+0000","last_fullsized":"2024-04-26T07:52:18.283655+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:18.283431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:18.283431+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.283431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:43.259274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"109'51","reported_seq":265,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.190027+0000","last_change":"2024-04-26T07:52:06.190110+0000","last_active":"2024-04-26T07:52:06.190027+0000","last_peered":"2024-04-26T07:52:06.190027+0000","last_clean":"2024-04-26T07:52:06.190027+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:52:06.190027+0000","last_undegraded":"2024-04-26T07:52:06.190027+0000","last_fullsized":"2024-04-26T07:52:06.190027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'51","last_scrub_stamp":"2024-04-26T07:52:06.189827+0000","last_deep_scrub":"109'51","last_deep_scrub_stamp":"2024-04-26T07:52:06.189827+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.189827+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:17.316177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":274,"num_write":26,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.682572+0000","last_change":"2024-04-26T07:52:02.682623+0000","last_active":"2024-04-26T07:52:02.682572+0000","last_peered":"2024-04-26T07:52:02.682572+0000","last_clean":"2024-04-26T07:52:02.682572+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:52:02.682572+0000","last_undegraded":"2024-04-26T07:52:02.682572+0000","last_fullsized":"2024-04-26T07:52:02.682572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:02.682386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:02.682386+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.682386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:44.099207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.407664+0000","last_change":"2024-04-26T07:48:31.605529+0000","last_active":"2024-04-26T07:51:40.407664+0000","last_peered":"2024-04-26T07:51:40.407664+0000","last_clean":"2024-04-26T07:51:40.407664+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:51:40.407664+0000","last_undegraded":"2024-04-26T07:51:40.407664+0000","last_fullsized":"2024-04-26T07:51:40.407664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.639725+0000","last_change":"2024-04-26T07:52:14.639787+0000","last_active":"2024-04-26T07:52:14.639725+0000","last_peered":"2024-04-26T07:52:14.639725+0000","last_clean":"2024-04-26T07:52:14.639725+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:52:14.639725+0000","last_undegraded":"2024-04-26T07:52:14.639725+0000","last_fullsized":"2024-04-26T07:52:14.639725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'10","last_scrub_stamp":"2024-04-26T07:52:14.639493+0000","last_deep_scrub":"72'10","last_deep_scrub_stamp":"2024-04-26T07:52:14.639493+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.639493+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:05.259721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.212344+0000","last_change":"2024-04-26T07:52:15.212344+0000","last_active":"2024-04-26T07:52:15.212344+0000","last_peered":"2024-04-26T07:52:15.212344+0000","last_clean":"2024-04-26T07:52:15.212344+0000","last_became_active":"2024-04-26T07:51:40.437582+0000","last_became_peered":"2024-04-26T07:51:40.437582+0000","last_unstale":"2024-04-26T07:52:15.212344+0000","last_undegraded":"2024-04-26T07:52:15.212344+0000","last_fullsized":"2024-04-26T07:52:15.212344+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:15.212060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:15.212060+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.212060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:27.725357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"109'40","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.417453+0000","last_change":"2024-04-26T07:48:21.493084+0000","last_active":"2024-04-26T07:51:56.417453+0000","last_peered":"2024-04-26T07:51:56.417453+0000","last_clean":"2024-04-26T07:51:56.417453+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:51:56.417453+0000","last_undegraded":"2024-04-26T07:51:56.417453+0000","last_fullsized":"2024-04-26T07:51:56.417453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.417110+0000","last_change":"2024-04-26T07:48:25.568285+0000","last_active":"2024-04-26T07:51:40.417110+0000","last_peered":"2024-04-26T07:51:40.417110+0000","last_clean":"2024-04-26T07:51:40.417110+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:51:40.417110+0000","last_undegraded":"2024-04-26T07:51:40.417110+0000","last_fullsized":"2024-04-26T07:51:40.417110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"109'156","reported_seq":460,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.547391+0000","last_change":"2024-04-26T07:52:09.547470+0000","last_active":"2024-04-26T07:52:09.547391+0000","last_peered":"2024-04-26T07:52:09.547391+0000","last_clean":"2024-04-26T07:52:09.547391+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:52:09.547391+0000","last_undegraded":"2024-04-26T07:52:09.547391+0000","last_fullsized":"2024-04-26T07:52:09.547391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'156","last_scrub_stamp":"2024-04-26T07:52:09.547197+0000","last_deep_scrub":"109'156","last_deep_scrub_stamp":"2024-04-26T07:52:09.547197+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.547197+0000","objects_scrubbed":10,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:52:16.819965+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":133,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.446814+0000","last_change":"2024-04-26T07:51:40.444144+0000","last_active":"2024-04-26T07:51:40.446814+0000","last_peered":"2024-04-26T07:51:40.446814+0000","last_clean":"2024-04-26T07:51:40.446814+0000","last_became_active":"2024-04-26T07:51:40.439356+0000","last_became_peered":"2024-04-26T07:51:40.439356+0000","last_unstale":"2024-04-26T07:51:40.446814+0000","last_undegraded":"2024-04-26T07:51:40.446814+0000","last_fullsized":"2024-04-26T07:51:40.446814+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408314+0000","last_change":"2024-04-26T07:48:31.757814+0000","last_active":"2024-04-26T07:51:40.408314+0000","last_peered":"2024-04-26T07:51:40.408314+0000","last_clean":"2024-04-26T07:51:40.408314+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:51:40.408314+0000","last_undegraded":"2024-04-26T07:51:40.408314+0000","last_fullsized":"2024-04-26T07:51:40.408314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.572971+0000","last_change":"2024-04-26T07:52:06.573026+0000","last_active":"2024-04-26T07:52:06.572971+0000","last_peered":"2024-04-26T07:52:06.572971+0000","last_clean":"2024-04-26T07:52:06.572971+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:52:06.572971+0000","last_undegraded":"2024-04-26T07:52:06.572971+0000","last_fullsized":"2024-04-26T07:52:06.572971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:06.572770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:06.572770+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.572770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:13.787197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.359728+0000","last_change":"2024-04-26T07:52:05.359784+0000","last_active":"2024-04-26T07:52:05.359728+0000","last_peered":"2024-04-26T07:52:05.359728+0000","last_clean":"2024-04-26T07:52:05.359728+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:52:05.359728+0000","last_undegraded":"2024-04-26T07:52:05.359728+0000","last_fullsized":"2024-04-26T07:52:05.359728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.359508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.359508+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.359508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:45.415341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"109'52","reported_seq":245,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.389596+0000","last_change":"2024-04-26T07:48:21.500546+0000","last_active":"2024-04-26T07:51:56.389596+0000","last_peered":"2024-04-26T07:51:56.389596+0000","last_clean":"2024-04-26T07:51:56.389596+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:51:56.389596+0000","last_undegraded":"2024-04-26T07:51:56.389596+0000","last_fullsized":"2024-04-26T07:51:56.389596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"109'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.288765+0000","last_change":"2024-04-26T07:52:02.288828+0000","last_active":"2024-04-26T07:52:02.288765+0000","last_peered":"2024-04-26T07:52:02.288765+0000","last_clean":"2024-04-26T07:52:02.288765+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:52:02.288765+0000","last_undegraded":"2024-04-26T07:52:02.288765+0000","last_fullsized":"2024-04-26T07:52:02.288765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:02.288582+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:02.288582+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.288582+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:12.977945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"109'18","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:48.969426+0000","last_change":"2024-04-26T07:51:40.448691+0000","last_active":"2024-04-26T07:51:48.969426+0000","last_peered":"2024-04-26T07:51:48.969426+0000","last_clean":"2024-04-26T07:51:48.969426+0000","last_became_active":"2024-04-26T07:51:40.445444+0000","last_became_peered":"2024-04-26T07:51:40.445444+0000","last_unstale":"2024-04-26T07:51:48.969426+0000","last_undegraded":"2024-04-26T07:51:48.969426+0000","last_fullsized":"2024-04-26T07:51:48.969426+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.659215+0000","last_change":"2024-04-26T07:52:03.659273+0000","last_active":"2024-04-26T07:52:03.659215+0000","last_peered":"2024-04-26T07:52:03.659215+0000","last_clean":"2024-04-26T07:52:03.659215+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:52:03.659215+0000","last_undegraded":"2024-04-26T07:52:03.659215+0000","last_fullsized":"2024-04-26T07:52:03.659215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.659029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.659029+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.659029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.870936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.392407+0000","last_change":"2024-04-26T07:48:31.584964+0000","last_active":"2024-04-26T07:51:40.392407+0000","last_peered":"2024-04-26T07:51:40.392407+0000","last_clean":"2024-04-26T07:51:40.392407+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:51:40.392407+0000","last_undegraded":"2024-04-26T07:51:40.392407+0000","last_fullsized":"2024-04-26T07:51:40.392407+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.562279+0000","last_change":"2024-04-26T07:52:12.562346+0000","last_active":"2024-04-26T07:52:12.562279+0000","last_peered":"2024-04-26T07:52:12.562279+0000","last_clean":"2024-04-26T07:52:12.562279+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:52:12.562279+0000","last_undegraded":"2024-04-26T07:52:12.562279+0000","last_fullsized":"2024-04-26T07:52:12.562279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-26T07:52:12.562055+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.562055+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.562055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:46.705639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414442+0000","last_change":"2024-04-26T07:48:15.453922+0000","last_active":"2024-04-26T07:51:40.414442+0000","last_peered":"2024-04-26T07:51:40.414442+0000","last_clean":"2024-04-26T07:51:40.414442+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:51:40.414442+0000","last_undegraded":"2024-04-26T07:51:40.414442+0000","last_fullsized":"2024-04-26T07:51:40.414442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:14.430639+0000","last_clean_scrub_stamp":"2024-04-26T07:48:14.430639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"109'40","reported_seq":233,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.401645+0000","last_change":"2024-04-26T07:48:21.495241+0000","last_active":"2024-04-26T07:51:56.401645+0000","last_peered":"2024-04-26T07:51:56.401645+0000","last_clean":"2024-04-26T07:51:56.401645+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:51:56.401645+0000","last_undegraded":"2024-04-26T07:51:56.401645+0000","last_fullsized":"2024-04-26T07:51:56.401645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.634281+0000","last_change":"2024-04-26T07:52:09.634380+0000","last_active":"2024-04-26T07:52:09.634281+0000","last_peered":"2024-04-26T07:52:09.634281+0000","last_clean":"2024-04-26T07:52:09.634281+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:52:09.634281+0000","last_undegraded":"2024-04-26T07:52:09.634281+0000","last_fullsized":"2024-04-26T07:52:09.634281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:09.634025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:09.634025+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.634025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:39.955994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":200,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393950+0000","last_change":"2024-04-26T07:48:27.557449+0000","last_active":"2024-04-26T07:51:40.393950+0000","last_peered":"2024-04-26T07:51:40.393950+0000","last_clean":"2024-04-26T07:51:40.393950+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:51:40.393950+0000","last_undegraded":"2024-04-26T07:51:40.393950+0000","last_fullsized":"2024-04-26T07:51:40.393950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.412245+0000","last_change":"2024-04-26T07:48:29.602498+0000","last_active":"2024-04-26T07:51:40.412245+0000","last_peered":"2024-04-26T07:51:40.412245+0000","last_clean":"2024-04-26T07:51:40.412245+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:51:40.412245+0000","last_undegraded":"2024-04-26T07:51:40.412245+0000","last_fullsized":"2024-04-26T07:51:40.412245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409588+0000","last_change":"2024-04-26T07:48:31.601206+0000","last_active":"2024-04-26T07:51:40.409588+0000","last_peered":"2024-04-26T07:51:40.409588+0000","last_clean":"2024-04-26T07:51:40.409588+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:51:40.409588+0000","last_undegraded":"2024-04-26T07:51:40.409588+0000","last_fullsized":"2024-04-26T07:51:40.409588+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.539530+0000","last_change":"2024-04-26T07:52:08.539589+0000","last_active":"2024-04-26T07:52:08.539530+0000","last_peered":"2024-04-26T07:52:08.539530+0000","last_clean":"2024-04-26T07:52:08.539530+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:52:08.539530+0000","last_undegraded":"2024-04-26T07:52:08.539530+0000","last_fullsized":"2024-04-26T07:52:08.539530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:08.539328+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:08.539328+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.539328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:09.275493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"109'48","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.374209+0000","last_change":"2024-04-26T07:48:21.504911+0000","last_active":"2024-04-26T07:51:56.374209+0000","last_peered":"2024-04-26T07:51:56.374209+0000","last_clean":"2024-04-26T07:51:56.374209+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:51:56.374209+0000","last_undegraded":"2024-04-26T07:51:56.374209+0000","last_fullsized":"2024-04-26T07:51:56.374209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.553903+0000","last_change":"2024-04-26T07:52:14.553963+0000","last_active":"2024-04-26T07:52:14.553903+0000","last_peered":"2024-04-26T07:52:14.553903+0000","last_clean":"2024-04-26T07:52:14.553903+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:52:14.553903+0000","last_undegraded":"2024-04-26T07:52:14.553903+0000","last_fullsized":"2024-04-26T07:52:14.553903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:14.553682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:14.553682+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.553682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:55.970503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.626315+0000","last_change":"2024-04-26T07:52:13.626371+0000","last_active":"2024-04-26T07:52:13.626315+0000","last_peered":"2024-04-26T07:52:13.626315+0000","last_clean":"2024-04-26T07:52:13.626315+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:52:13.626315+0000","last_undegraded":"2024-04-26T07:52:13.626315+0000","last_fullsized":"2024-04-26T07:52:13.626315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.626121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.626121+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.626121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:23.768965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"109'48","reported_seq":258,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.592826+0000","last_change":"2024-04-26T07:52:17.592928+0000","last_active":"2024-04-26T07:52:17.592826+0000","last_peered":"2024-04-26T07:52:17.592826+0000","last_clean":"2024-04-26T07:52:17.592826+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:52:17.592826+0000","last_undegraded":"2024-04-26T07:52:17.592826+0000","last_fullsized":"2024-04-26T07:52:17.592826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:17.592612+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:17.592612+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.592612+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:23.468407+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":45,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395017+0000","last_change":"2024-04-26T07:48:29.577086+0000","last_active":"2024-04-26T07:51:40.395017+0000","last_peered":"2024-04-26T07:51:40.395017+0000","last_clean":"2024-04-26T07:51:40.395017+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:51:40.395017+0000","last_undegraded":"2024-04-26T07:51:40.395017+0000","last_fullsized":"2024-04-26T07:51:40.395017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387562+0000","last_change":"2024-04-26T07:48:31.758538+0000","last_active":"2024-04-26T07:51:40.387562+0000","last_peered":"2024-04-26T07:51:40.387562+0000","last_clean":"2024-04-26T07:51:40.387562+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:51:40.387562+0000","last_undegraded":"2024-04-26T07:51:40.387562+0000","last_fullsized":"2024-04-26T07:51:40.387562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.551865+0000","last_change":"2024-04-26T07:52:18.551935+0000","last_active":"2024-04-26T07:52:18.551865+0000","last_peered":"2024-04-26T07:52:18.551865+0000","last_clean":"2024-04-26T07:52:18.551865+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:52:18.551865+0000","last_undegraded":"2024-04-26T07:52:18.551865+0000","last_fullsized":"2024-04-26T07:52:18.551865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:18.551602+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:18.551602+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.551602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:19.194908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'44","reported_seq":245,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.508225+0000","last_change":"2024-04-26T07:52:18.508286+0000","last_active":"2024-04-26T07:52:18.508225+0000","last_peered":"2024-04-26T07:52:18.508225+0000","last_clean":"2024-04-26T07:52:18.508225+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:52:18.508225+0000","last_undegraded":"2024-04-26T07:52:18.508225+0000","last_fullsized":"2024-04-26T07:52:18.508225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:18.508026+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:18.508026+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.508026+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:11.571289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.246100+0000","last_change":"2024-04-26T07:52:17.246156+0000","last_active":"2024-04-26T07:52:17.246100+0000","last_peered":"2024-04-26T07:52:17.246100+0000","last_clean":"2024-04-26T07:52:17.246100+0000","last_became_active":"2024-04-26T07:51:40.433293+0000","last_became_peered":"2024-04-26T07:51:40.433293+0000","last_unstale":"2024-04-26T07:52:17.246100+0000","last_undegraded":"2024-04-26T07:52:17.246100+0000","last_fullsized":"2024-04-26T07:52:17.246100+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.245909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.245909+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.245909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:34.468197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.874348+0000","last_change":"2024-04-26T07:52:03.874398+0000","last_active":"2024-04-26T07:52:03.874348+0000","last_peered":"2024-04-26T07:52:03.874348+0000","last_clean":"2024-04-26T07:52:03.874348+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:52:03.874348+0000","last_undegraded":"2024-04-26T07:52:03.874348+0000","last_fullsized":"2024-04-26T07:52:03.874348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.874164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.874164+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.874164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:34.208516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"90'15","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408734+0000","last_change":"2024-04-26T07:48:27.654423+0000","last_active":"2024-04-26T07:51:40.408734+0000","last_peered":"2024-04-26T07:51:40.408734+0000","last_clean":"2024-04-26T07:51:40.408734+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:51:40.408734+0000","last_undegraded":"2024-04-26T07:51:40.408734+0000","last_fullsized":"2024-04-26T07:51:40.408734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"109'138","reported_seq":392,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.182380+0000","last_change":"2024-04-26T07:52:05.182627+0000","last_active":"2024-04-26T07:52:05.182380+0000","last_peered":"2024-04-26T07:52:05.182380+0000","last_clean":"2024-04-26T07:52:05.182380+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:52:05.182380+0000","last_undegraded":"2024-04-26T07:52:05.182380+0000","last_fullsized":"2024-04-26T07:52:05.182380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:05.182189+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:05.182189+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.182189+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:45.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394412+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:40.394412+0000","last_peered":"2024-04-26T07:51:40.394412+0000","last_clean":"2024-04-26T07:51:40.394412+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:40.394412+0000","last_undegraded":"2024-04-26T07:51:40.394412+0000","last_fullsized":"2024-04-26T07:51:40.394412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.826143+0000","last_change":"2024-04-26T07:52:17.826299+0000","last_active":"2024-04-26T07:52:17.826143+0000","last_peered":"2024-04-26T07:52:17.826143+0000","last_clean":"2024-04-26T07:52:17.826143+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:52:17.826143+0000","last_undegraded":"2024-04-26T07:52:17.826143+0000","last_fullsized":"2024-04-26T07:52:17.826143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:17.825908+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:17.825908+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.825908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:20.716480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'38","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.273668+0000","last_change":"2024-04-26T07:48:21.519502+0000","last_active":"2024-04-26T07:51:56.273668+0000","last_peered":"2024-04-26T07:51:56.273668+0000","last_clean":"2024-04-26T07:51:56.273668+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:51:56.273668+0000","last_undegraded":"2024-04-26T07:51:56.273668+0000","last_fullsized":"2024-04-26T07:51:56.273668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.541858+0000","last_change":"2024-04-26T07:52:13.541968+0000","last_active":"2024-04-26T07:52:13.541858+0000","last_peered":"2024-04-26T07:52:13.541858+0000","last_clean":"2024-04-26T07:52:13.541858+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:52:13.541858+0000","last_undegraded":"2024-04-26T07:52:13.541858+0000","last_fullsized":"2024-04-26T07:52:13.541858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.541642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.541642+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.541642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:17.963815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395455+0000","last_change":"2024-04-26T07:48:25.554200+0000","last_active":"2024-04-26T07:51:40.395455+0000","last_peered":"2024-04-26T07:51:40.395455+0000","last_clean":"2024-04-26T07:51:40.395455+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:51:40.395455+0000","last_undegraded":"2024-04-26T07:51:40.395455+0000","last_fullsized":"2024-04-26T07:51:40.395455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"109'15","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.460445+0000","last_change":"2024-04-26T07:52:05.460523+0000","last_active":"2024-04-26T07:52:05.460445+0000","last_peered":"2024-04-26T07:52:05.460445+0000","last_clean":"2024-04-26T07:52:05.460445+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:52:05.460445+0000","last_undegraded":"2024-04-26T07:52:05.460445+0000","last_fullsized":"2024-04-26T07:52:05.460445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:05.460261+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:05.460261+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.460261+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:16.586612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"109'138","reported_seq":364,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.843766+0000","last_change":"2024-04-26T07:52:09.843830+0000","last_active":"2024-04-26T07:52:09.843766+0000","last_peered":"2024-04-26T07:52:09.843766+0000","last_clean":"2024-04-26T07:52:09.843766+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:52:09.843766+0000","last_undegraded":"2024-04-26T07:52:09.843766+0000","last_fullsized":"2024-04-26T07:52:09.843766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:09.843553+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:09.843553+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.843553+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:33.665682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"72'3","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387135+0000","last_change":"2024-04-26T07:48:31.598767+0000","last_active":"2024-04-26T07:51:40.387135+0000","last_peered":"2024-04-26T07:51:40.387135+0000","last_clean":"2024-04-26T07:51:40.387135+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:51:40.387135+0000","last_undegraded":"2024-04-26T07:51:40.387135+0000","last_fullsized":"2024-04-26T07:51:40.387135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395884+0000","last_change":"2024-04-26T07:48:23.521788+0000","last_active":"2024-04-26T07:51:40.395884+0000","last_peered":"2024-04-26T07:51:40.395884+0000","last_clean":"2024-04-26T07:51:40.395884+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:51:40.395884+0000","last_undegraded":"2024-04-26T07:51:40.395884+0000","last_fullsized":"2024-04-26T07:51:40.395884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"109'42","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.318066+0000","last_change":"2024-04-26T07:48:21.502276+0000","last_active":"2024-04-26T07:51:56.318066+0000","last_peered":"2024-04-26T07:51:56.318066+0000","last_clean":"2024-04-26T07:51:56.318066+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:51:56.318066+0000","last_undegraded":"2024-04-26T07:51:56.318066+0000","last_fullsized":"2024-04-26T07:51:56.318066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.830608+0000","last_change":"2024-04-26T07:52:11.830671+0000","last_active":"2024-04-26T07:52:11.830608+0000","last_peered":"2024-04-26T07:52:11.830608+0000","last_clean":"2024-04-26T07:52:11.830608+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:52:11.830608+0000","last_undegraded":"2024-04-26T07:52:11.830608+0000","last_fullsized":"2024-04-26T07:52:11.830608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.830410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.830410+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.830410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:08.945514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"22'1","reported_seq":278,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.337675+0000","last_change":"2024-04-26T07:48:25.563298+0000","last_active":"2024-04-26T07:51:55.337675+0000","last_peered":"2024-04-26T07:51:55.337675+0000","last_clean":"2024-04-26T07:51:55.337675+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:51:55.337675+0000","last_undegraded":"2024-04-26T07:51:55.337675+0000","last_fullsized":"2024-04-26T07:51:55.337675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"109'54","reported_seq":217,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.458215+0000","last_change":"2024-04-26T07:51:40.419562+0000","last_active":"2024-04-26T07:51:56.458215+0000","last_peered":"2024-04-26T07:51:56.458215+0000","last_clean":"2024-04-26T07:51:56.458215+0000","last_became_active":"2024-04-26T07:51:40.418680+0000","last_became_peered":"2024-04-26T07:51:40.418680+0000","last_unstale":"2024-04-26T07:51:56.458215+0000","last_undegraded":"2024-04-26T07:51:56.458215+0000","last_fullsized":"2024-04-26T07:51:56.458215+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":166,"num_write":32,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.864357+0000","last_change":"2024-04-26T07:52:02.864385+0000","last_active":"2024-04-26T07:52:02.864357+0000","last_peered":"2024-04-26T07:52:02.864357+0000","last_clean":"2024-04-26T07:52:02.864357+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:52:02.864357+0000","last_undegraded":"2024-04-26T07:52:02.864357+0000","last_fullsized":"2024-04-26T07:52:02.864357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:02.864165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:02.864165+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.864165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:34.200900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414004+0000","last_change":"2024-04-26T07:48:31.600032+0000","last_active":"2024-04-26T07:51:40.414004+0000","last_peered":"2024-04-26T07:51:40.414004+0000","last_clean":"2024-04-26T07:51:40.414004+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:51:40.414004+0000","last_undegraded":"2024-04-26T07:51:40.414004+0000","last_fullsized":"2024-04-26T07:51:40.414004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387893+0000","last_change":"2024-04-26T07:48:31.610257+0000","last_active":"2024-04-26T07:51:40.387893+0000","last_peered":"2024-04-26T07:51:40.387893+0000","last_clean":"2024-04-26T07:51:40.387893+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:51:40.387893+0000","last_undegraded":"2024-04-26T07:51:40.387893+0000","last_fullsized":"2024-04-26T07:51:40.387893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.410949+0000","last_change":"2024-04-26T07:52:09.411013+0000","last_active":"2024-04-26T07:52:09.410949+0000","last_peered":"2024-04-26T07:52:09.410949+0000","last_clean":"2024-04-26T07:52:09.410949+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:52:09.410949+0000","last_undegraded":"2024-04-26T07:52:09.410949+0000","last_fullsized":"2024-04-26T07:52:09.410949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'6","last_scrub_stamp":"2024-04-26T07:52:09.410717+0000","last_deep_scrub":"55'6","last_deep_scrub_stamp":"2024-04-26T07:52:09.410717+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.410717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:06.622624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"109'62","reported_seq":255,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.418563+0000","last_change":"2024-04-26T07:48:21.526785+0000","last_active":"2024-04-26T07:51:56.418563+0000","last_peered":"2024-04-26T07:51:56.418563+0000","last_clean":"2024-04-26T07:51:56.418563+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:51:56.418563+0000","last_undegraded":"2024-04-26T07:51:56.418563+0000","last_fullsized":"2024-04-26T07:51:56.418563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.609035+0000","last_change":"2024-04-26T07:52:01.609059+0000","last_active":"2024-04-26T07:52:01.609035+0000","last_peered":"2024-04-26T07:52:01.609035+0000","last_clean":"2024-04-26T07:52:01.609035+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:52:01.609035+0000","last_undegraded":"2024-04-26T07:52:01.609035+0000","last_fullsized":"2024-04-26T07:52:01.609035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.608926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.608926+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.608926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:17.404013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"109'26","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.842931+0000","last_change":"2024-04-26T07:52:08.843013+0000","last_active":"2024-04-26T07:52:08.842931+0000","last_peered":"2024-04-26T07:52:08.842931+0000","last_clean":"2024-04-26T07:52:08.842931+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:52:08.842931+0000","last_undegraded":"2024-04-26T07:52:08.842931+0000","last_fullsized":"2024-04-26T07:52:08.842931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'26","last_scrub_stamp":"2024-04-26T07:52:08.842689+0000","last_deep_scrub":"109'26","last_deep_scrub_stamp":"2024-04-26T07:52:08.842689+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.842689+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:34.215975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.801116+0000","last_change":"2024-04-26T07:52:05.801172+0000","last_active":"2024-04-26T07:52:05.801116+0000","last_peered":"2024-04-26T07:52:05.801116+0000","last_clean":"2024-04-26T07:52:05.801116+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:52:05.801116+0000","last_undegraded":"2024-04-26T07:52:05.801116+0000","last_fullsized":"2024-04-26T07:52:05.801116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.800909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.800909+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.800909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.438432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393648+0000","last_change":"2024-04-26T07:48:31.592883+0000","last_active":"2024-04-26T07:51:40.393648+0000","last_peered":"2024-04-26T07:51:40.393648+0000","last_clean":"2024-04-26T07:51:40.393648+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:51:40.393648+0000","last_undegraded":"2024-04-26T07:51:40.393648+0000","last_fullsized":"2024-04-26T07:51:40.393648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.542531+0000","last_change":"2024-04-26T07:52:04.542583+0000","last_active":"2024-04-26T07:52:04.542531+0000","last_peered":"2024-04-26T07:52:04.542531+0000","last_clean":"2024-04-26T07:52:04.542531+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:52:04.542531+0000","last_undegraded":"2024-04-26T07:52:04.542531+0000","last_fullsized":"2024-04-26T07:52:04.542531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.542332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.542332+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.542332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:50.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"109'36","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.401873+0000","last_change":"2024-04-26T07:51:40.447435+0000","last_active":"2024-04-26T07:51:56.401873+0000","last_peered":"2024-04-26T07:51:56.401873+0000","last_clean":"2024-04-26T07:51:56.401873+0000","last_became_active":"2024-04-26T07:51:40.444446+0000","last_became_peered":"2024-04-26T07:51:40.444446+0000","last_unstale":"2024-04-26T07:51:56.401873+0000","last_undegraded":"2024-04-26T07:51:56.401873+0000","last_fullsized":"2024-04-26T07:51:56.401873+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"22'1","reported_seq":278,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:55.316003+0000","last_change":"2024-04-26T07:48:25.560341+0000","last_active":"2024-04-26T07:51:55.316003+0000","last_peered":"2024-04-26T07:51:55.316003+0000","last_clean":"2024-04-26T07:51:55.316003+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:51:55.316003+0000","last_undegraded":"2024-04-26T07:51:55.316003+0000","last_fullsized":"2024-04-26T07:51:55.316003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"109'13","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.604202+0000","last_change":"2024-04-26T07:52:15.604331+0000","last_active":"2024-04-26T07:52:15.604202+0000","last_peered":"2024-04-26T07:52:15.604202+0000","last_clean":"2024-04-26T07:52:15.604202+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:52:15.604202+0000","last_undegraded":"2024-04-26T07:52:15.604202+0000","last_fullsized":"2024-04-26T07:52:15.604202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'13","last_scrub_stamp":"2024-04-26T07:52:15.603892+0000","last_deep_scrub":"109'13","last_deep_scrub_stamp":"2024-04-26T07:52:15.603892+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.603892+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:39.721417+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.261783+0000","last_change":"2024-04-26T07:52:16.261836+0000","last_active":"2024-04-26T07:52:16.261783+0000","last_peered":"2024-04-26T07:52:16.261783+0000","last_clean":"2024-04-26T07:52:16.261783+0000","last_became_active":"2024-04-26T07:51:40.431762+0000","last_became_peered":"2024-04-26T07:51:40.431762+0000","last_unstale":"2024-04-26T07:52:16.261783+0000","last_undegraded":"2024-04-26T07:52:16.261783+0000","last_fullsized":"2024-04-26T07:52:16.261783+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:16.261572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:16.261572+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.261572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:21.754727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.387002+0000","last_change":"2024-04-26T07:48:31.594407+0000","last_active":"2024-04-26T07:51:40.387002+0000","last_peered":"2024-04-26T07:51:40.387002+0000","last_clean":"2024-04-26T07:51:40.387002+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:51:40.387002+0000","last_undegraded":"2024-04-26T07:51:40.387002+0000","last_fullsized":"2024-04-26T07:51:40.387002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.815325+0000","last_change":"2024-04-26T07:52:11.815393+0000","last_active":"2024-04-26T07:52:11.815325+0000","last_peered":"2024-04-26T07:52:11.815325+0000","last_clean":"2024-04-26T07:52:11.815325+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:52:11.815325+0000","last_undegraded":"2024-04-26T07:52:11.815325+0000","last_fullsized":"2024-04-26T07:52:11.815325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:11.815117+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:11.815117+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.815117+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:59.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"109'48","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.415493+0000","last_change":"2024-04-26T07:48:21.518108+0000","last_active":"2024-04-26T07:51:56.415493+0000","last_peered":"2024-04-26T07:51:56.415493+0000","last_clean":"2024-04-26T07:51:56.415493+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:51:56.415493+0000","last_undegraded":"2024-04-26T07:51:56.415493+0000","last_fullsized":"2024-04-26T07:51:56.415493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.036487+0000","last_change":"2024-04-26T07:52:03.036548+0000","last_active":"2024-04-26T07:52:03.036487+0000","last_peered":"2024-04-26T07:52:03.036487+0000","last_clean":"2024-04-26T07:52:03.036487+0000","last_became_active":"2024-04-26T07:51:40.439845+0000","last_became_peered":"2024-04-26T07:51:40.439845+0000","last_unstale":"2024-04-26T07:52:03.036487+0000","last_undegraded":"2024-04-26T07:52:03.036487+0000","last_fullsized":"2024-04-26T07:52:03.036487+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.036278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.036278+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.036278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:14.765411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"109'27","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.818099+0000","last_change":"2024-04-26T07:52:10.818173+0000","last_active":"2024-04-26T07:52:10.818099+0000","last_peered":"2024-04-26T07:52:10.818099+0000","last_clean":"2024-04-26T07:52:10.818099+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:52:10.818099+0000","last_undegraded":"2024-04-26T07:52:10.818099+0000","last_fullsized":"2024-04-26T07:52:10.818099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'27","last_scrub_stamp":"2024-04-26T07:52:10.817912+0000","last_deep_scrub":"109'27","last_deep_scrub_stamp":"2024-04-26T07:52:10.817912+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.817912+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:51.319828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410095+0000","last_change":"2024-04-26T07:48:29.599721+0000","last_active":"2024-04-26T07:51:40.410095+0000","last_peered":"2024-04-26T07:51:40.410095+0000","last_clean":"2024-04-26T07:51:40.410095+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:51:40.410095+0000","last_undegraded":"2024-04-26T07:51:40.410095+0000","last_fullsized":"2024-04-26T07:51:40.410095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.413825+0000","last_change":"2024-04-26T07:48:31.601641+0000","last_active":"2024-04-26T07:51:40.413825+0000","last_peered":"2024-04-26T07:51:40.413825+0000","last_clean":"2024-04-26T07:51:40.413825+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:51:40.413825+0000","last_undegraded":"2024-04-26T07:51:40.413825+0000","last_fullsized":"2024-04-26T07:51:40.413825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.831172+0000","last_change":"2024-04-26T07:52:14.831324+0000","last_active":"2024-04-26T07:52:14.831172+0000","last_peered":"2024-04-26T07:52:14.831172+0000","last_clean":"2024-04-26T07:52:14.831172+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:52:14.831172+0000","last_undegraded":"2024-04-26T07:52:14.831172+0000","last_fullsized":"2024-04-26T07:52:14.831172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:14.830852+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:14.830852+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.830852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:05.451081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'50","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.394219+0000","last_change":"2024-04-26T07:48:21.506351+0000","last_active":"2024-04-26T07:51:56.394219+0000","last_peered":"2024-04-26T07:51:56.394219+0000","last_clean":"2024-04-26T07:51:56.394219+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:51:56.394219+0000","last_undegraded":"2024-04-26T07:51:56.394219+0000","last_fullsized":"2024-04-26T07:51:56.394219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.775643+0000","last_change":"2024-04-26T07:52:07.775698+0000","last_active":"2024-04-26T07:52:07.775643+0000","last_peered":"2024-04-26T07:52:07.775643+0000","last_clean":"2024-04-26T07:52:07.775643+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:52:07.775643+0000","last_undegraded":"2024-04-26T07:52:07.775643+0000","last_fullsized":"2024-04-26T07:52:07.775643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.775411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.775411+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.775411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:23.570498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"109'21","reported_seq":168,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.443085+0000","last_change":"2024-04-26T07:51:40.418821+0000","last_active":"2024-04-26T07:51:56.443085+0000","last_peered":"2024-04-26T07:51:56.443085+0000","last_clean":"2024-04-26T07:51:56.443085+0000","last_became_active":"2024-04-26T07:51:40.417916+0000","last_became_peered":"2024-04-26T07:51:40.417916+0000","last_unstale":"2024-04-26T07:51:56.443085+0000","last_undegraded":"2024-04-26T07:51:56.443085+0000","last_fullsized":"2024-04-26T07:51:56.443085+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.713395+0000","last_change":"2024-04-26T07:52:01.713436+0000","last_active":"2024-04-26T07:52:01.713395+0000","last_peered":"2024-04-26T07:52:01.713395+0000","last_clean":"2024-04-26T07:52:01.713395+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:52:01.713395+0000","last_undegraded":"2024-04-26T07:52:01.713395+0000","last_fullsized":"2024-04-26T07:52:01.713395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.713273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.713273+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.713273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:06.135446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.827446+0000","last_change":"2024-04-26T07:52:04.827505+0000","last_active":"2024-04-26T07:52:04.827446+0000","last_peered":"2024-04-26T07:52:04.827446+0000","last_clean":"2024-04-26T07:52:04.827446+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:52:04.827446+0000","last_undegraded":"2024-04-26T07:52:04.827446+0000","last_fullsized":"2024-04-26T07:52:04.827446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:04.827246+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:04.827246+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.827246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:51.792004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"109'46","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.297725+0000","last_change":"2024-04-26T07:48:21.500641+0000","last_active":"2024-04-26T07:51:56.297725+0000","last_peered":"2024-04-26T07:51:56.297725+0000","last_clean":"2024-04-26T07:51:56.297725+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:51:56.297725+0000","last_undegraded":"2024-04-26T07:51:56.297725+0000","last_fullsized":"2024-04-26T07:51:56.297725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.668470+0000","last_change":"2024-04-26T07:52:11.668524+0000","last_active":"2024-04-26T07:52:11.668470+0000","last_peered":"2024-04-26T07:52:11.668470+0000","last_clean":"2024-04-26T07:52:11.668470+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:52:11.668470+0000","last_undegraded":"2024-04-26T07:52:11.668470+0000","last_fullsized":"2024-04-26T07:52:11.668470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.668272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.668272+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.668272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:17.018585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"109'38","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.527131+0000","last_change":"2024-04-26T07:52:11.527291+0000","last_active":"2024-04-26T07:52:11.527131+0000","last_peered":"2024-04-26T07:52:11.527131+0000","last_clean":"2024-04-26T07:52:11.527131+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:52:11.527131+0000","last_undegraded":"2024-04-26T07:52:11.527131+0000","last_fullsized":"2024-04-26T07:52:11.527131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:11.526881+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:11.526881+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.526881+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:40.166851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.414380+0000","last_change":"2024-04-26T07:48:29.576449+0000","last_active":"2024-04-26T07:51:40.414380+0000","last_peered":"2024-04-26T07:51:40.414380+0000","last_clean":"2024-04-26T07:51:40.414380+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:51:40.414380+0000","last_undegraded":"2024-04-26T07:51:40.414380+0000","last_fullsized":"2024-04-26T07:51:40.414380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391816+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:40.391816+0000","last_peered":"2024-04-26T07:51:40.391816+0000","last_clean":"2024-04-26T07:51:40.391816+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:40.391816+0000","last_undegraded":"2024-04-26T07:51:40.391816+0000","last_fullsized":"2024-04-26T07:51:40.391816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.622208+0000","last_change":"2024-04-26T07:52:07.622332+0000","last_active":"2024-04-26T07:52:07.622208+0000","last_peered":"2024-04-26T07:52:07.622208+0000","last_clean":"2024-04-26T07:52:07.622208+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:52:07.622208+0000","last_undegraded":"2024-04-26T07:52:07.622208+0000","last_fullsized":"2024-04-26T07:52:07.622208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-04-26T07:52:07.621942+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-04-26T07:52:07.621942+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.621942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:57.800288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"109'32","reported_seq":233,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.533271+0000","last_change":"2024-04-26T07:52:17.533339+0000","last_active":"2024-04-26T07:52:17.533271+0000","last_peered":"2024-04-26T07:52:17.533271+0000","last_clean":"2024-04-26T07:52:17.533271+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:52:17.533271+0000","last_undegraded":"2024-04-26T07:52:17.533271+0000","last_fullsized":"2024-04-26T07:52:17.533271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'32","last_scrub_stamp":"2024-04-26T07:52:17.533071+0000","last_deep_scrub":"109'32","last_deep_scrub_stamp":"2024-04-26T07:52:17.533071+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.533071+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:00.497968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.778458+0000","last_change":"2024-04-26T07:52:05.778513+0000","last_active":"2024-04-26T07:52:05.778458+0000","last_peered":"2024-04-26T07:52:05.778458+0000","last_clean":"2024-04-26T07:52:05.778458+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:52:05.778458+0000","last_undegraded":"2024-04-26T07:52:05.778458+0000","last_fullsized":"2024-04-26T07:52:05.778458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.778217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.778217+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.778217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.242490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"109'29","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.454066+0000","last_change":"2024-04-26T07:51:40.427441+0000","last_active":"2024-04-26T07:51:56.454066+0000","last_peered":"2024-04-26T07:51:56.454066+0000","last_clean":"2024-04-26T07:51:56.454066+0000","last_became_active":"2024-04-26T07:51:40.424476+0000","last_became_peered":"2024-04-26T07:51:40.424476+0000","last_unstale":"2024-04-26T07:51:56.454066+0000","last_undegraded":"2024-04-26T07:51:56.454066+0000","last_fullsized":"2024-04-26T07:51:56.454066+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410046+0000","last_change":"2024-04-26T07:48:29.577010+0000","last_active":"2024-04-26T07:51:40.410046+0000","last_peered":"2024-04-26T07:51:40.410046+0000","last_clean":"2024-04-26T07:51:40.410046+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:51:40.410046+0000","last_undegraded":"2024-04-26T07:51:40.410046+0000","last_fullsized":"2024-04-26T07:51:40.410046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408315+0000","last_change":"2024-04-26T07:48:31.589167+0000","last_active":"2024-04-26T07:51:40.408315+0000","last_peered":"2024-04-26T07:51:40.408315+0000","last_clean":"2024-04-26T07:51:40.408315+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:51:40.408315+0000","last_undegraded":"2024-04-26T07:51:40.408315+0000","last_fullsized":"2024-04-26T07:51:40.408315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.783244+0000","last_change":"2024-04-26T07:52:18.783315+0000","last_active":"2024-04-26T07:52:18.783244+0000","last_peered":"2024-04-26T07:52:18.783244+0000","last_clean":"2024-04-26T07:52:18.783244+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:52:18.783244+0000","last_undegraded":"2024-04-26T07:52:18.783244+0000","last_fullsized":"2024-04-26T07:52:18.783244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-26T07:52:18.783017+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-26T07:52:18.783017+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.783017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:19.426323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'62","reported_seq":255,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.399010+0000","last_change":"2024-04-26T07:48:21.494368+0000","last_active":"2024-04-26T07:51:56.399010+0000","last_peered":"2024-04-26T07:51:56.399010+0000","last_clean":"2024-04-26T07:51:56.399010+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:51:56.399010+0000","last_undegraded":"2024-04-26T07:51:56.399010+0000","last_fullsized":"2024-04-26T07:51:56.399010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.367629+0000","last_change":"2024-04-26T07:52:18.367686+0000","last_active":"2024-04-26T07:52:18.367629+0000","last_peered":"2024-04-26T07:52:18.367629+0000","last_clean":"2024-04-26T07:52:18.367629+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:52:18.367629+0000","last_undegraded":"2024-04-26T07:52:18.367629+0000","last_fullsized":"2024-04-26T07:52:18.367629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:18.367438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:18.367438+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.367438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:34.844082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"109'26","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.851911+0000","last_change":"2024-04-26T07:52:03.852009+0000","last_active":"2024-04-26T07:52:03.851911+0000","last_peered":"2024-04-26T07:52:03.851911+0000","last_clean":"2024-04-26T07:52:03.851911+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:52:03.851911+0000","last_undegraded":"2024-04-26T07:52:03.851911+0000","last_fullsized":"2024-04-26T07:52:03.851911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'26","last_scrub_stamp":"2024-04-26T07:52:03.851724+0000","last_deep_scrub":"109'26","last_deep_scrub_stamp":"2024-04-26T07:52:03.851724+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.851724+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:44.785331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.409854+0000","last_change":"2024-04-26T07:48:29.577507+0000","last_active":"2024-04-26T07:51:40.409854+0000","last_peered":"2024-04-26T07:51:40.409854+0000","last_clean":"2024-04-26T07:51:40.409854+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:51:40.409854+0000","last_undegraded":"2024-04-26T07:51:40.409854+0000","last_fullsized":"2024-04-26T07:51:40.409854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.410517+0000","last_change":"2024-04-26T07:48:31.601174+0000","last_active":"2024-04-26T07:51:40.410517+0000","last_peered":"2024-04-26T07:51:40.410517+0000","last_clean":"2024-04-26T07:51:40.410517+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:51:40.410517+0000","last_undegraded":"2024-04-26T07:51:40.410517+0000","last_fullsized":"2024-04-26T07:51:40.410517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.296636+0000","last_change":"2024-04-26T07:52:10.296697+0000","last_active":"2024-04-26T07:52:10.296636+0000","last_peered":"2024-04-26T07:52:10.296636+0000","last_clean":"2024-04-26T07:52:10.296636+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:52:10.296636+0000","last_undegraded":"2024-04-26T07:52:10.296636+0000","last_fullsized":"2024-04-26T07:52:10.296636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-04-26T07:52:10.296422+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-04-26T07:52:10.296422+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.296422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:34.609000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"109'36","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.409501+0000","last_change":"2024-04-26T07:48:21.502378+0000","last_active":"2024-04-26T07:51:56.409501+0000","last_peered":"2024-04-26T07:51:56.409501+0000","last_clean":"2024-04-26T07:51:56.409501+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:51:56.409501+0000","last_undegraded":"2024-04-26T07:51:56.409501+0000","last_fullsized":"2024-04-26T07:51:56.409501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.550280+0000","last_change":"2024-04-26T07:52:05.550332+0000","last_active":"2024-04-26T07:52:05.550280+0000","last_peered":"2024-04-26T07:52:05.550280+0000","last_clean":"2024-04-26T07:52:05.550280+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:52:05.550280+0000","last_undegraded":"2024-04-26T07:52:05.550280+0000","last_fullsized":"2024-04-26T07:52:05.550280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.550072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.550072+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.550072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:02.665176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"109'15","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.465693+0000","last_change":"2024-04-26T07:52:04.465783+0000","last_active":"2024-04-26T07:52:04.465693+0000","last_peered":"2024-04-26T07:52:04.465693+0000","last_clean":"2024-04-26T07:52:04.465693+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:52:04.465693+0000","last_undegraded":"2024-04-26T07:52:04.465693+0000","last_fullsized":"2024-04-26T07:52:04.465693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:04.465500+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:04.465500+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.465500+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:13.082281+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"109'138","reported_seq":441,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.803667+0000","last_change":"2024-04-26T07:52:09.803732+0000","last_active":"2024-04-26T07:52:09.803667+0000","last_peered":"2024-04-26T07:52:09.803667+0000","last_clean":"2024-04-26T07:52:09.803667+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:52:09.803667+0000","last_undegraded":"2024-04-26T07:52:09.803667+0000","last_fullsized":"2024-04-26T07:52:09.803667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:09.803458+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:09.803458+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.803458+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:53.903529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":145,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.122433+0000","last_change":"2024-04-26T07:52:09.122499+0000","last_active":"2024-04-26T07:52:09.122433+0000","last_peered":"2024-04-26T07:52:09.122433+0000","last_clean":"2024-04-26T07:52:09.122433+0000","last_became_active":"2024-04-26T07:51:40.436379+0000","last_became_peered":"2024-04-26T07:51:40.436379+0000","last_unstale":"2024-04-26T07:52:09.122433+0000","last_undegraded":"2024-04-26T07:52:09.122433+0000","last_fullsized":"2024-04-26T07:52:09.122433+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'5","last_scrub_stamp":"2024-04-26T07:52:09.122230+0000","last_deep_scrub":"55'5","last_deep_scrub_stamp":"2024-04-26T07:52:09.122230+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.122230+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:25.598874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.396344+0000","last_change":"2024-04-26T07:48:23.527510+0000","last_active":"2024-04-26T07:51:40.396344+0000","last_peered":"2024-04-26T07:51:40.396344+0000","last_clean":"2024-04-26T07:51:40.396344+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:51:40.396344+0000","last_undegraded":"2024-04-26T07:51:40.396344+0000","last_fullsized":"2024-04-26T07:51:40.396344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"109'28","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.422071+0000","last_change":"2024-04-26T07:49:08.973938+0000","last_active":"2024-04-26T07:51:56.422071+0000","last_peered":"2024-04-26T07:51:56.422071+0000","last_clean":"2024-04-26T07:51:56.422071+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:51:56.422071+0000","last_undegraded":"2024-04-26T07:51:56.422071+0000","last_fullsized":"2024-04-26T07:51:56.422071+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.439219+0000","last_change":"2024-04-26T07:51:40.428700+0000","last_active":"2024-04-26T07:51:40.439219+0000","last_peered":"2024-04-26T07:51:40.439219+0000","last_clean":"2024-04-26T07:51:40.439219+0000","last_became_active":"2024-04-26T07:51:40.427906+0000","last_became_peered":"2024-04-26T07:51:40.427906+0000","last_unstale":"2024-04-26T07:51:40.439219+0000","last_undegraded":"2024-04-26T07:51:40.439219+0000","last_fullsized":"2024-04-26T07:51:40.439219+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"109'32","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.175930+0000","last_change":"2024-04-26T07:52:03.176073+0000","last_active":"2024-04-26T07:52:03.175930+0000","last_peered":"2024-04-26T07:52:03.175930+0000","last_clean":"2024-04-26T07:52:03.175930+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:52:03.175930+0000","last_undegraded":"2024-04-26T07:52:03.175930+0000","last_fullsized":"2024-04-26T07:52:03.175930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'32","last_scrub_stamp":"2024-04-26T07:52:03.175641+0000","last_deep_scrub":"109'32","last_deep_scrub_stamp":"2024-04-26T07:52:03.175641+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.175641+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:24.733999+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.663317+0000","last_change":"2024-04-26T07:52:06.663476+0000","last_active":"2024-04-26T07:52:06.663317+0000","last_peered":"2024-04-26T07:52:06.663317+0000","last_clean":"2024-04-26T07:52:06.663317+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:52:06.663317+0000","last_undegraded":"2024-04-26T07:52:06.663317+0000","last_fullsized":"2024-04-26T07:52:06.663317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:06.663096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:06.663096+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.663096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.726359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.169457+0000","last_change":"2024-04-26T07:52:10.169518+0000","last_active":"2024-04-26T07:52:10.169457+0000","last_peered":"2024-04-26T07:52:10.169457+0000","last_clean":"2024-04-26T07:52:10.169457+0000","last_became_active":"2024-04-26T07:51:40.432230+0000","last_became_peered":"2024-04-26T07:51:40.432230+0000","last_unstale":"2024-04-26T07:52:10.169457+0000","last_undegraded":"2024-04-26T07:52:10.169457+0000","last_fullsized":"2024-04-26T07:52:10.169457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-04-26T07:52:10.169197+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.169197+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.169197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:29.864550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.431292+0000","last_change":"2024-04-26T07:52:14.431351+0000","last_active":"2024-04-26T07:52:14.431292+0000","last_peered":"2024-04-26T07:52:14.431292+0000","last_clean":"2024-04-26T07:52:14.431292+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:52:14.431292+0000","last_undegraded":"2024-04-26T07:52:14.431292+0000","last_fullsized":"2024-04-26T07:52:14.431292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:14.431047+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:14.431047+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.431047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:38.253176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"109'56","reported_seq":256,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.128328+0000","last_change":"2024-04-26T07:52:18.128389+0000","last_active":"2024-04-26T07:52:18.128328+0000","last_peered":"2024-04-26T07:52:18.128328+0000","last_clean":"2024-04-26T07:52:18.128328+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:52:18.128328+0000","last_undegraded":"2024-04-26T07:52:18.128328+0000","last_fullsized":"2024-04-26T07:52:18.128328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'56","last_scrub_stamp":"2024-04-26T07:52:18.128132+0000","last_deep_scrub":"109'56","last_deep_scrub_stamp":"2024-04-26T07:52:18.128132+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.128132+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:51.014245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.149428+0000","last_change":"2024-04-26T07:52:17.149485+0000","last_active":"2024-04-26T07:52:17.149428+0000","last_peered":"2024-04-26T07:52:17.149428+0000","last_clean":"2024-04-26T07:52:17.149428+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:52:17.149428+0000","last_undegraded":"2024-04-26T07:52:17.149428+0000","last_fullsized":"2024-04-26T07:52:17.149428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.149207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.149207+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.149207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:57.651124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"109'21","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.251760+0000","last_change":"2024-04-26T07:48:27.576387+0000","last_active":"2024-04-26T07:51:56.251760+0000","last_peered":"2024-04-26T07:51:56.251760+0000","last_clean":"2024-04-26T07:51:56.251760+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:51:56.251760+0000","last_undegraded":"2024-04-26T07:51:56.251760+0000","last_fullsized":"2024-04-26T07:51:56.251760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:26.538451+0000","last_clean_scrub_stamp":"2024-04-26T07:48:26.538451+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.408566+0000","last_change":"2024-04-26T07:48:29.584402+0000","last_active":"2024-04-26T07:51:40.408566+0000","last_peered":"2024-04-26T07:51:40.408566+0000","last_clean":"2024-04-26T07:51:40.408566+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:51:40.408566+0000","last_undegraded":"2024-04-26T07:51:40.408566+0000","last_fullsized":"2024-04-26T07:51:40.408566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393806+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:40.393806+0000","last_peered":"2024-04-26T07:51:40.393806+0000","last_clean":"2024-04-26T07:51:40.393806+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:40.393806+0000","last_undegraded":"2024-04-26T07:51:40.393806+0000","last_fullsized":"2024-04-26T07:51:40.393806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391471+0000","last_change":"2024-04-26T07:48:23.522165+0000","last_active":"2024-04-26T07:51:40.391471+0000","last_peered":"2024-04-26T07:51:40.391471+0000","last_clean":"2024-04-26T07:51:40.391471+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:51:40.391471+0000","last_undegraded":"2024-04-26T07:51:40.391471+0000","last_fullsized":"2024-04-26T07:51:40.391471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"109'52","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.219981+0000","last_change":"2024-04-26T07:52:18.220125+0000","last_active":"2024-04-26T07:52:18.219981+0000","last_peered":"2024-04-26T07:52:18.219981+0000","last_clean":"2024-04-26T07:52:18.219981+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:52:18.219981+0000","last_undegraded":"2024-04-26T07:52:18.219981+0000","last_fullsized":"2024-04-26T07:52:18.219981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:18.219694+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:18.219694+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.219694+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:18.955859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394875+0000","last_change":"2024-04-26T07:48:25.570020+0000","last_active":"2024-04-26T07:51:40.394875+0000","last_peered":"2024-04-26T07:51:40.394875+0000","last_clean":"2024-04-26T07:51:40.394875+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:51:40.394875+0000","last_undegraded":"2024-04-26T07:51:40.394875+0000","last_fullsized":"2024-04-26T07:51:40.394875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:24.527456+0000","last_clean_scrub_stamp":"2024-04-26T07:48:24.527456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"109'17","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.877700+0000","last_change":"2024-04-26T07:52:07.877769+0000","last_active":"2024-04-26T07:52:07.877700+0000","last_peered":"2024-04-26T07:52:07.877700+0000","last_clean":"2024-04-26T07:52:07.877700+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:52:07.877700+0000","last_undegraded":"2024-04-26T07:52:07.877700+0000","last_fullsized":"2024-04-26T07:52:07.877700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'17","last_scrub_stamp":"2024-04-26T07:52:07.877498+0000","last_deep_scrub":"109'17","last_deep_scrub_stamp":"2024-04-26T07:52:07.877498+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.877498+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:19.606631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":177,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395263+0000","last_change":"2024-04-26T07:48:29.572335+0000","last_active":"2024-04-26T07:51:40.395263+0000","last_peered":"2024-04-26T07:51:40.395263+0000","last_clean":"2024-04-26T07:51:40.395263+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:51:40.395263+0000","last_undegraded":"2024-04-26T07:51:40.395263+0000","last_fullsized":"2024-04-26T07:51:40.395263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:28.544638+0000","last_clean_scrub_stamp":"2024-04-26T07:48:28.544638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":129,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.448652+0000","last_change":"2024-04-26T07:51:40.446873+0000","last_active":"2024-04-26T07:51:40.448652+0000","last_peered":"2024-04-26T07:51:40.448652+0000","last_clean":"2024-04-26T07:51:40.448652+0000","last_became_active":"2024-04-26T07:51:40.440377+0000","last_became_peered":"2024-04-26T07:51:40.440377+0000","last_unstale":"2024-04-26T07:51:40.448652+0000","last_undegraded":"2024-04-26T07:51:40.448652+0000","last_fullsized":"2024-04-26T07:51:40.448652+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":255,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.395508+0000","last_change":"2024-04-26T07:48:23.524582+0000","last_active":"2024-04-26T07:51:40.395508+0000","last_peered":"2024-04-26T07:51:40.395508+0000","last_clean":"2024-04-26T07:51:40.395508+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:51:40.395508+0000","last_undegraded":"2024-04-26T07:51:40.395508+0000","last_fullsized":"2024-04-26T07:51:40.395508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"109'50","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.421310+0000","last_change":"2024-04-26T07:49:08.964074+0000","last_active":"2024-04-26T07:51:56.421310+0000","last_peered":"2024-04-26T07:51:56.421310+0000","last_clean":"2024-04-26T07:51:56.421310+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:51:56.421310+0000","last_undegraded":"2024-04-26T07:51:56.421310+0000","last_fullsized":"2024-04-26T07:51:56.421310+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"109'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.588924+0000","last_change":"2024-04-26T07:52:03.588987+0000","last_active":"2024-04-26T07:52:03.588924+0000","last_peered":"2024-04-26T07:52:03.588924+0000","last_clean":"2024-04-26T07:52:03.588924+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:52:03.588924+0000","last_undegraded":"2024-04-26T07:52:03.588924+0000","last_fullsized":"2024-04-26T07:52:03.588924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:03.588732+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:03.588732+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.588732+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:47.688802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"109'23","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.495785+0000","last_change":"2024-04-26T07:52:02.495868+0000","last_active":"2024-04-26T07:52:02.495785+0000","last_peered":"2024-04-26T07:52:02.495785+0000","last_clean":"2024-04-26T07:52:02.495785+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:52:02.495785+0000","last_undegraded":"2024-04-26T07:52:02.495785+0000","last_fullsized":"2024-04-26T07:52:02.495785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'23","last_scrub_stamp":"2024-04-26T07:52:02.495366+0000","last_deep_scrub":"109'23","last_deep_scrub_stamp":"2024-04-26T07:52:02.495366+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.495366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:24.053723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:59.667741+0000","last_change":"2024-04-26T07:51:59.667797+0000","last_active":"2024-04-26T07:51:59.667741+0000","last_peered":"2024-04-26T07:51:59.667741+0000","last_clean":"2024-04-26T07:51:59.667741+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:59.667741+0000","last_undegraded":"2024-04-26T07:51:59.667741+0000","last_fullsized":"2024-04-26T07:51:59.667741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:51:59.667623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:51:59.667623+0000","last_clean_scrub_stamp":"2024-04-26T07:51:59.667623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:10.793974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":176,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.399632+0000","last_change":"2024-04-26T07:48:31.589395+0000","last_active":"2024-04-26T07:51:40.399632+0000","last_peered":"2024-04-26T07:51:40.399632+0000","last_clean":"2024-04-26T07:51:40.399632+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:51:40.399632+0000","last_undegraded":"2024-04-26T07:51:40.399632+0000","last_fullsized":"2024-04-26T07:51:40.399632+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":238,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.582987+0000","last_change":"2024-04-26T07:52:02.583013+0000","last_active":"2024-04-26T07:52:02.582987+0000","last_peered":"2024-04-26T07:52:02.582987+0000","last_clean":"2024-04-26T07:52:02.582987+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:52:02.582987+0000","last_undegraded":"2024-04-26T07:52:02.582987+0000","last_fullsized":"2024-04-26T07:52:02.582987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'10","last_scrub_stamp":"2024-04-26T07:52:02.582912+0000","last_deep_scrub":"90'10","last_deep_scrub_stamp":"2024-04-26T07:52:02.582912+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.582912+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:19.402059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.910290+0000","last_change":"2024-04-26T07:52:13.910349+0000","last_active":"2024-04-26T07:52:13.910290+0000","last_peered":"2024-04-26T07:52:13.910290+0000","last_clean":"2024-04-26T07:52:13.910290+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:52:13.910290+0000","last_undegraded":"2024-04-26T07:52:13.910290+0000","last_fullsized":"2024-04-26T07:52:13.910290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:13.910108+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:13.910108+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.910108+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:18.858812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.548514+0000","last_change":"2024-04-26T07:52:10.548575+0000","last_active":"2024-04-26T07:52:10.548514+0000","last_peered":"2024-04-26T07:52:10.548514+0000","last_clean":"2024-04-26T07:52:10.548514+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:52:10.548514+0000","last_undegraded":"2024-04-26T07:52:10.548514+0000","last_fullsized":"2024-04-26T07:52:10.548514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:10.548310+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.548310+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.548310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:19.165091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"109'52","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.288786+0000","last_change":"2024-04-26T07:52:07.288845+0000","last_active":"2024-04-26T07:52:07.288786+0000","last_peered":"2024-04-26T07:52:07.288786+0000","last_clean":"2024-04-26T07:52:07.288786+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:52:07.288786+0000","last_undegraded":"2024-04-26T07:52:07.288786+0000","last_fullsized":"2024-04-26T07:52:07.288786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:07.288594+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:07.288594+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.288594+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:27.311783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.191215+0000","last_change":"2024-04-26T07:52:09.191274+0000","last_active":"2024-04-26T07:52:09.191215+0000","last_peered":"2024-04-26T07:52:09.191215+0000","last_clean":"2024-04-26T07:52:09.191215+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:52:09.191215+0000","last_undegraded":"2024-04-26T07:52:09.191215+0000","last_fullsized":"2024-04-26T07:52:09.191215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:09.190998+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:09.190998+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.190998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:40.527734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"109'36","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.401672+0000","last_change":"2024-04-26T07:48:21.516824+0000","last_active":"2024-04-26T07:51:56.401672+0000","last_peered":"2024-04-26T07:51:56.401672+0000","last_clean":"2024-04-26T07:51:56.401672+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:51:56.401672+0000","last_undegraded":"2024-04-26T07:51:56.401672+0000","last_fullsized":"2024-04-26T07:51:56.401672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.652915+0000","last_change":"2024-04-26T07:52:00.652938+0000","last_active":"2024-04-26T07:52:00.652915+0000","last_peered":"2024-04-26T07:52:00.652915+0000","last_clean":"2024-04-26T07:52:00.652915+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:52:00.652915+0000","last_undegraded":"2024-04-26T07:52:00.652915+0000","last_fullsized":"2024-04-26T07:52:00.652915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T07:52:00.652831+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T07:52:00.652831+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.652831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:24.965409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"109'46","reported_seq":238,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.414208+0000","last_change":"2024-04-26T07:48:21.498440+0000","last_active":"2024-04-26T07:51:56.414208+0000","last_peered":"2024-04-26T07:51:56.414208+0000","last_clean":"2024-04-26T07:51:56.414208+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:51:56.414208+0000","last_undegraded":"2024-04-26T07:51:56.414208+0000","last_fullsized":"2024-04-26T07:51:56.414208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.794593+0000","last_change":"2024-04-26T07:52:13.794652+0000","last_active":"2024-04-26T07:52:13.794593+0000","last_peered":"2024-04-26T07:52:13.794593+0000","last_clean":"2024-04-26T07:52:13.794593+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:52:13.794593+0000","last_undegraded":"2024-04-26T07:52:13.794593+0000","last_fullsized":"2024-04-26T07:52:13.794593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.794365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.794365+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.794365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:23.937209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"109'64","reported_seq":258,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.385702+0000","last_change":"2024-04-26T07:48:21.493578+0000","last_active":"2024-04-26T07:51:56.385702+0000","last_peered":"2024-04-26T07:51:56.385702+0000","last_clean":"2024-04-26T07:51:56.385702+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:51:56.385702+0000","last_undegraded":"2024-04-26T07:51:56.385702+0000","last_fullsized":"2024-04-26T07:51:56.385702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.468987+0000","last_change":"2024-04-26T07:52:13.469047+0000","last_active":"2024-04-26T07:52:13.468987+0000","last_peered":"2024-04-26T07:52:13.468987+0000","last_clean":"2024-04-26T07:52:13.468987+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:52:13.468987+0000","last_undegraded":"2024-04-26T07:52:13.468987+0000","last_fullsized":"2024-04-26T07:52:13.468987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:13.468781+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:13.468781+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.468781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:38.842066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"109'70","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.446350+0000","last_change":"2024-04-26T07:48:21.498519+0000","last_active":"2024-04-26T07:51:56.446350+0000","last_peered":"2024-04-26T07:51:56.446350+0000","last_clean":"2024-04-26T07:51:56.446350+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:51:56.446350+0000","last_undegraded":"2024-04-26T07:51:56.446350+0000","last_fullsized":"2024-04-26T07:51:56.446350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.807071+0000","last_change":"2024-04-26T07:52:16.807221+0000","last_active":"2024-04-26T07:52:16.807071+0000","last_peered":"2024-04-26T07:52:16.807071+0000","last_clean":"2024-04-26T07:52:16.807071+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:52:16.807071+0000","last_undegraded":"2024-04-26T07:52:16.807071+0000","last_fullsized":"2024-04-26T07:52:16.807071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-04-26T07:52:16.806813+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-04-26T07:52:16.806813+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.806813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:25.470700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"109'46","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.940293+0000","last_change":"2024-04-26T07:52:17.940350+0000","last_active":"2024-04-26T07:52:17.940293+0000","last_peered":"2024-04-26T07:52:17.940293+0000","last_clean":"2024-04-26T07:52:17.940293+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:52:17.940293+0000","last_undegraded":"2024-04-26T07:52:17.940293+0000","last_fullsized":"2024-04-26T07:52:17.940293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:17.940091+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:17.940091+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.940091+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:46.580061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.822853+0000","last_change":"2024-04-26T07:52:10.822917+0000","last_active":"2024-04-26T07:52:10.822853+0000","last_peered":"2024-04-26T07:52:10.822853+0000","last_clean":"2024-04-26T07:52:10.822853+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:52:10.822853+0000","last_undegraded":"2024-04-26T07:52:10.822853+0000","last_fullsized":"2024-04-26T07:52:10.822853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:10.822644+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.822644+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.822644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:57.248404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"109'58","reported_seq":252,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.416490+0000","last_change":"2024-04-26T07:48:21.511007+0000","last_active":"2024-04-26T07:51:56.416490+0000","last_peered":"2024-04-26T07:51:56.416490+0000","last_clean":"2024-04-26T07:51:56.416490+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:51:56.416490+0000","last_undegraded":"2024-04-26T07:51:56.416490+0000","last_fullsized":"2024-04-26T07:51:56.416490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.654716+0000","last_change":"2024-04-26T07:52:08.654810+0000","last_active":"2024-04-26T07:52:08.654716+0000","last_peered":"2024-04-26T07:52:08.654716+0000","last_clean":"2024-04-26T07:52:08.654716+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:52:08.654716+0000","last_undegraded":"2024-04-26T07:52:08.654716+0000","last_fullsized":"2024-04-26T07:52:08.654716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:08.654501+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:08.654501+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.654501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:34:27.598040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"109'48","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.402141+0000","last_change":"2024-04-26T07:48:21.498043+0000","last_active":"2024-04-26T07:51:56.402141+0000","last_peered":"2024-04-26T07:51:56.402141+0000","last_clean":"2024-04-26T07:51:56.402141+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:51:56.402141+0000","last_undegraded":"2024-04-26T07:51:56.402141+0000","last_fullsized":"2024-04-26T07:51:56.402141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.365149+0000","last_change":"2024-04-26T07:52:17.365274+0000","last_active":"2024-04-26T07:52:17.365149+0000","last_peered":"2024-04-26T07:52:17.365149+0000","last_clean":"2024-04-26T07:52:17.365149+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:52:17.365149+0000","last_undegraded":"2024-04-26T07:52:17.365149+0000","last_fullsized":"2024-04-26T07:52:17.365149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:17.364889+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:17.364889+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.364889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.867784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"109'42","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.347490+0000","last_change":"2024-04-26T07:48:21.523265+0000","last_active":"2024-04-26T07:51:56.347490+0000","last_peered":"2024-04-26T07:51:56.347490+0000","last_clean":"2024-04-26T07:51:56.347490+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:51:56.347490+0000","last_undegraded":"2024-04-26T07:51:56.347490+0000","last_fullsized":"2024-04-26T07:51:56.347490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":220,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.281613+0000","last_change":"2024-04-26T07:52:12.281677+0000","last_active":"2024-04-26T07:52:12.281613+0000","last_peered":"2024-04-26T07:52:12.281613+0000","last_clean":"2024-04-26T07:52:12.281613+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:52:12.281613+0000","last_undegraded":"2024-04-26T07:52:12.281613+0000","last_fullsized":"2024-04-26T07:52:12.281613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-26T07:52:12.281168+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-26T07:52:12.281168+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.281168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:29.100315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"109'28","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.176086+0000","last_change":"2024-04-26T07:52:14.176145+0000","last_active":"2024-04-26T07:52:14.176086+0000","last_peered":"2024-04-26T07:52:14.176086+0000","last_clean":"2024-04-26T07:52:14.176086+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:52:14.176086+0000","last_undegraded":"2024-04-26T07:52:14.176086+0000","last_fullsized":"2024-04-26T07:52:14.176086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'28","last_scrub_stamp":"2024-04-26T07:52:14.175886+0000","last_deep_scrub":"109'28","last_deep_scrub_stamp":"2024-04-26T07:52:14.175886+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.175886+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:25.905019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.482704+0000","last_change":"2024-04-26T07:52:07.482768+0000","last_active":"2024-04-26T07:52:07.482704+0000","last_peered":"2024-04-26T07:52:07.482704+0000","last_clean":"2024-04-26T07:52:07.482704+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:52:07.482704+0000","last_undegraded":"2024-04-26T07:52:07.482704+0000","last_fullsized":"2024-04-26T07:52:07.482704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:07.482485+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:07.482485+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.482485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:38.819221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"109'52","reported_seq":245,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.409889+0000","last_change":"2024-04-26T07:48:21.519191+0000","last_active":"2024-04-26T07:51:56.409889+0000","last_peered":"2024-04-26T07:51:56.409889+0000","last_clean":"2024-04-26T07:51:56.409889+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:51:56.409889+0000","last_undegraded":"2024-04-26T07:51:56.409889+0000","last_fullsized":"2024-04-26T07:51:56.409889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":163,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.438931+0000","last_change":"2024-04-26T07:51:40.428116+0000","last_active":"2024-04-26T07:51:40.438931+0000","last_peered":"2024-04-26T07:51:40.438931+0000","last_clean":"2024-04-26T07:51:40.438931+0000","last_became_active":"2024-04-26T07:51:40.427193+0000","last_became_peered":"2024-04-26T07:51:40.427193+0000","last_unstale":"2024-04-26T07:51:40.438931+0000","last_undegraded":"2024-04-26T07:51:40.438931+0000","last_fullsized":"2024-04-26T07:51:40.438931+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"109'42","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.409236+0000","last_change":"2024-04-26T07:48:21.522752+0000","last_active":"2024-04-26T07:51:56.409236+0000","last_peered":"2024-04-26T07:51:56.409236+0000","last_clean":"2024-04-26T07:51:56.409236+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:51:56.409236+0000","last_undegraded":"2024-04-26T07:51:56.409236+0000","last_fullsized":"2024-04-26T07:51:56.409236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.552115+0000","last_change":"2024-04-26T07:52:16.552177+0000","last_active":"2024-04-26T07:52:16.552115+0000","last_peered":"2024-04-26T07:52:16.552115+0000","last_clean":"2024-04-26T07:52:16.552115+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:52:16.552115+0000","last_undegraded":"2024-04-26T07:52:16.552115+0000","last_fullsized":"2024-04-26T07:52:16.552115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:16.551883+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:16.551883+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.551883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:25.215770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'54","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.409064+0000","last_change":"2024-04-26T07:51:40.449013+0000","last_active":"2024-04-26T07:51:56.409064+0000","last_peered":"2024-04-26T07:51:56.409064+0000","last_clean":"2024-04-26T07:51:56.409064+0000","last_became_active":"2024-04-26T07:51:40.445977+0000","last_became_peered":"2024-04-26T07:51:40.445977+0000","last_unstale":"2024-04-26T07:51:56.409064+0000","last_undegraded":"2024-04-26T07:51:56.409064+0000","last_fullsized":"2024-04-26T07:51:56.409064+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.801426+0000","last_change":"2024-04-26T07:52:12.801497+0000","last_active":"2024-04-26T07:52:12.801426+0000","last_peered":"2024-04-26T07:52:12.801426+0000","last_clean":"2024-04-26T07:52:12.801426+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:52:12.801426+0000","last_undegraded":"2024-04-26T07:52:12.801426+0000","last_fullsized":"2024-04-26T07:52:12.801426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T07:52:12.801171+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.801171+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.801171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:54.304065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"109'64","reported_seq":266,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.315131+0000","last_change":"2024-04-26T07:52:06.315193+0000","last_active":"2024-04-26T07:52:06.315131+0000","last_peered":"2024-04-26T07:52:06.315131+0000","last_clean":"2024-04-26T07:52:06.315131+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:52:06.315131+0000","last_undegraded":"2024-04-26T07:52:06.315131+0000","last_fullsized":"2024-04-26T07:52:06.315131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'64","last_scrub_stamp":"2024-04-26T07:52:06.314920+0000","last_deep_scrub":"109'64","last_deep_scrub_stamp":"2024-04-26T07:52:06.314920+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.314920+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:21.520117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.066500+0000","last_change":"2024-04-26T07:52:05.066559+0000","last_active":"2024-04-26T07:52:05.066500+0000","last_peered":"2024-04-26T07:52:05.066500+0000","last_clean":"2024-04-26T07:52:05.066500+0000","last_became_active":"2024-04-26T07:51:40.433471+0000","last_became_peered":"2024-04-26T07:51:40.433471+0000","last_unstale":"2024-04-26T07:52:05.066500+0000","last_undegraded":"2024-04-26T07:52:05.066500+0000","last_fullsized":"2024-04-26T07:52:05.066500+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-04-26T07:52:05.066305+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-04-26T07:52:05.066305+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.066305+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.388274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"109'42","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.328382+0000","last_change":"2024-04-26T07:48:21.518089+0000","last_active":"2024-04-26T07:51:56.328382+0000","last_peered":"2024-04-26T07:51:56.328382+0000","last_clean":"2024-04-26T07:51:56.328382+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:51:56.328382+0000","last_undegraded":"2024-04-26T07:51:56.328382+0000","last_fullsized":"2024-04-26T07:51:56.328382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"109'42","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:56.412335+0000","last_change":"2024-04-26T07:48:21.514377+0000","last_active":"2024-04-26T07:51:56.412335+0000","last_peered":"2024-04-26T07:51:56.412335+0000","last_clean":"2024-04-26T07:51:56.412335+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:51:56.412335+0000","last_undegraded":"2024-04-26T07:51:56.412335+0000","last_fullsized":"2024-04-26T07:51:56.412335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:20.466824+0000","last_clean_scrub_stamp":"2024-04-26T07:48:20.466824+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.684401+0000","last_change":"2024-04-26T07:52:10.684452+0000","last_active":"2024-04-26T07:52:10.684401+0000","last_peered":"2024-04-26T07:52:10.684401+0000","last_clean":"2024-04-26T07:52:10.684401+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:52:10.684401+0000","last_undegraded":"2024-04-26T07:52:10.684401+0000","last_fullsized":"2024-04-26T07:52:10.684401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:10.684218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:10.684218+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.684218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:35.242533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"109'58","reported_seq":259,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.523509+0000","last_change":"2024-04-26T07:52:15.523580+0000","last_active":"2024-04-26T07:52:15.523509+0000","last_peered":"2024-04-26T07:52:15.523509+0000","last_clean":"2024-04-26T07:52:15.523509+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:52:15.523509+0000","last_undegraded":"2024-04-26T07:52:15.523509+0000","last_fullsized":"2024-04-26T07:52:15.523509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:15.523309+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:15.523309+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.523309+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:56.456917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.227504+0000","last_change":"2024-04-26T07:52:07.227564+0000","last_active":"2024-04-26T07:52:07.227504+0000","last_peered":"2024-04-26T07:52:07.227504+0000","last_clean":"2024-04-26T07:52:07.227504+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:52:07.227504+0000","last_undegraded":"2024-04-26T07:52:07.227504+0000","last_fullsized":"2024-04-26T07:52:07.227504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-26T07:52:07.227294+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-26T07:52:07.227294+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.227294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:16.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1106,"ondisk_log_size":1106,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1065,"num_read_kb":1546,"num_write":541,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1446,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":1945600,"data_stored":1357749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1327104,"data_stored":766721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":1372160,"data_stored":767549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335220,"statfs":{"total":96636764160,"available":96599265280,"internally_reserved":0,"allocated":1314816,"data_stored":766219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40824,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331016,"statfs":{"total":96636764160,"available":96594960384,"internally_reserved":0,"allocated":1359872,"data_stored":768949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335220,"statfs":{"total":96636764160,"available":96599265280,"internally_reserved":0,"allocated":1314816,"data_stored":766283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40816,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331024,"statfs":{"total":96636764160,"available":96594968576,"internally_reserved":0,"allocated":1351680,"data_stored":767799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41384,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330456,"statfs":{"total":96636764160,"available":96594386944,"internally_reserved":0,"allocated":1933312,"data_stored":1358159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:52:23.626 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.627 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.627 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.627 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.627 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.628 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.628 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.628 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.628 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.628 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.628 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.629 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.629 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.629 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.629 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.629 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.629 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.629 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.629 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.630 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.630 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.630 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.630 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.630 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.631 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.631 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.631 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.631 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.631 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.631 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.632 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.632 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.632 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.632 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.632 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.633 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.633 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.633 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.633 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.633 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.634 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.634 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.634 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.634 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.634 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.634 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.634 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.635 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.636 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.636 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T07:48:14.430639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=14, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.636 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.636 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.636 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.636 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.636 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.637 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.637 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.637 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.637 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.637 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.637 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.637 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.637 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.638 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.638 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.638 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.638 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.638 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.638 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.638 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.638 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.639 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.639 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.639 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.639 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.639 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.639 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.640 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.640 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.640 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.640 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.640 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.640 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.640 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.640 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.641 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.641 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.641 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.641 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.641 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.641 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.642 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-26T07:48:26.538451+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.642 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.642 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.642 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.642 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T07:48:24.527456+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.642 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T07:48:28.544638+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=28, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.642 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.642 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.643 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.643 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.643 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.643 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.643 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.643 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.643 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.643 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.644 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.644 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.644 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.644 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.644 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.644 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.644 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T07:48:20.466824+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:23.644 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:52:43.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:52:44.007 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:52:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:52:44.035 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-04-26T07:52:43.879948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620002,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5012,"num_read_kb":3913,"num_write":4425,"num_write_kb":6187918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5697,"ondisk_log_size":5697,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":306808,"kb_used_data":11640,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667912,"statfs":{"total":773094113280,"available":772779941888,"internally_reserved":0,"allocated":11919360,"data_stored":7319428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006230"},"pg_stats":[{"pgid":"3.3f","version":"109'54","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.209508+0000","last_change":"2024-04-26T07:52:23.209508+0000","last_active":"2024-04-26T07:52:23.209508+0000","last_peered":"2024-04-26T07:52:23.209508+0000","last_clean":"2024-04-26T07:52:23.209508+0000","last_became_active":"2024-04-26T07:51:40.418691+0000","last_became_peered":"2024-04-26T07:51:40.418691+0000","last_unstale":"2024-04-26T07:52:23.209508+0000","last_undegraded":"2024-04-26T07:52:23.209508+0000","last_fullsized":"2024-04-26T07:52:23.209508+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'54","last_scrub_stamp":"2024-04-26T07:52:23.209215+0000","last_deep_scrub":"109'54","last_deep_scrub_stamp":"2024-04-26T07:52:23.209215+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.209215+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:43.038857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.213429+0000","last_change":"2024-04-26T07:52:08.213487+0000","last_active":"2024-04-26T07:52:08.213429+0000","last_peered":"2024-04-26T07:52:08.213429+0000","last_clean":"2024-04-26T07:52:08.213429+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:52:08.213429+0000","last_undegraded":"2024-04-26T07:52:08.213429+0000","last_fullsized":"2024-04-26T07:52:08.213429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'10","last_scrub_stamp":"2024-04-26T07:52:08.213207+0000","last_deep_scrub":"72'10","last_deep_scrub_stamp":"2024-04-26T07:52:08.213207+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.213207+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:25.317450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"109'52","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.522139+0000","last_change":"2024-04-26T07:52:16.522139+0000","last_active":"2024-04-26T07:52:16.522139+0000","last_peered":"2024-04-26T07:52:16.522139+0000","last_clean":"2024-04-26T07:52:16.522139+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:52:16.522139+0000","last_undegraded":"2024-04-26T07:52:16.522139+0000","last_fullsized":"2024-04-26T07:52:16.522139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:16.521885+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:16.521885+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.521885+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:14.274620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":153,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.163478+0000","last_change":"2024-04-26T07:52:13.163536+0000","last_active":"2024-04-26T07:52:13.163478+0000","last_peered":"2024-04-26T07:52:13.163478+0000","last_clean":"2024-04-26T07:52:13.163478+0000","last_became_active":"2024-04-26T07:51:40.437448+0000","last_became_peered":"2024-04-26T07:51:40.437448+0000","last_unstale":"2024-04-26T07:52:13.163478+0000","last_undegraded":"2024-04-26T07:52:13.163478+0000","last_fullsized":"2024-04-26T07:52:13.163478+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.163252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.163252+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.163252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:16.053824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.570106+0000","last_change":"2024-04-26T07:52:24.570106+0000","last_active":"2024-04-26T07:52:24.570106+0000","last_peered":"2024-04-26T07:52:24.570106+0000","last_clean":"2024-04-26T07:52:24.570106+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:52:24.570106+0000","last_undegraded":"2024-04-26T07:52:24.570106+0000","last_fullsized":"2024-04-26T07:52:24.570106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:24.569841+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:24.569841+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.569841+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:52.753746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.454006+0000","last_change":"2024-04-26T07:52:06.454066+0000","last_active":"2024-04-26T07:52:06.454006+0000","last_peered":"2024-04-26T07:52:06.454006+0000","last_clean":"2024-04-26T07:52:06.454006+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:52:06.454006+0000","last_undegraded":"2024-04-26T07:52:06.454006+0000","last_fullsized":"2024-04-26T07:52:06.454006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-04-26T07:52:06.453798+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-04-26T07:52:06.453798+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.453798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:15.896501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"109'44","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.024457+0000","last_change":"2024-04-26T07:52:27.024516+0000","last_active":"2024-04-26T07:52:27.024457+0000","last_peered":"2024-04-26T07:52:27.024457+0000","last_clean":"2024-04-26T07:52:27.024457+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:52:27.024457+0000","last_undegraded":"2024-04-26T07:52:27.024457+0000","last_fullsized":"2024-04-26T07:52:27.024457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:27.024268+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:27.024268+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.024268+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:32.517423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:37.646931+0000","last_change":"2024-04-26T07:52:37.647066+0000","last_active":"2024-04-26T07:52:37.646931+0000","last_peered":"2024-04-26T07:52:37.646931+0000","last_clean":"2024-04-26T07:52:37.646931+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:52:37.646931+0000","last_undegraded":"2024-04-26T07:52:37.646931+0000","last_fullsized":"2024-04-26T07:52:37.646931+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:37.646673+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:37.646673+0000","last_clean_scrub_stamp":"2024-04-26T07:52:37.646673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:56.820075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'46","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.064569+0000","last_change":"2024-04-26T07:52:06.064633+0000","last_active":"2024-04-26T07:52:06.064569+0000","last_peered":"2024-04-26T07:52:06.064569+0000","last_clean":"2024-04-26T07:52:06.064569+0000","last_became_active":"2024-04-26T07:51:40.433215+0000","last_became_peered":"2024-04-26T07:51:40.433215+0000","last_unstale":"2024-04-26T07:52:06.064569+0000","last_undegraded":"2024-04-26T07:52:06.064569+0000","last_fullsized":"2024-04-26T07:52:06.064569+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:06.064366+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:06.064366+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.064366+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:30.622681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":220,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.748822+0000","last_change":"2024-04-26T07:52:06.748822+0000","last_active":"2024-04-26T07:52:06.748822+0000","last_peered":"2024-04-26T07:52:06.748822+0000","last_clean":"2024-04-26T07:52:06.748822+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:52:06.748822+0000","last_undegraded":"2024-04-26T07:52:06.748822+0000","last_fullsized":"2024-04-26T07:52:06.748822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-26T07:52:06.748541+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-26T07:52:06.748541+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.748541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:31.061119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"109'44","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.164476+0000","last_change":"2024-04-26T07:52:16.164636+0000","last_active":"2024-04-26T07:52:16.164476+0000","last_peered":"2024-04-26T07:52:16.164476+0000","last_clean":"2024-04-26T07:52:16.164476+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:52:16.164476+0000","last_undegraded":"2024-04-26T07:52:16.164476+0000","last_fullsized":"2024-04-26T07:52:16.164476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:16.164249+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:16.164249+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.164249+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:39.986378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.500006+0000","last_change":"2024-04-26T07:52:12.500006+0000","last_active":"2024-04-26T07:52:12.500006+0000","last_peered":"2024-04-26T07:52:12.500006+0000","last_clean":"2024-04-26T07:52:12.500006+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:52:12.500006+0000","last_undegraded":"2024-04-26T07:52:12.500006+0000","last_fullsized":"2024-04-26T07:52:12.500006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-26T07:52:12.499701+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.499701+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.499701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:13.383983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"109'36","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.260172+0000","last_change":"2024-04-26T07:52:28.260232+0000","last_active":"2024-04-26T07:52:28.260172+0000","last_peered":"2024-04-26T07:52:28.260172+0000","last_clean":"2024-04-26T07:52:28.260172+0000","last_became_active":"2024-04-26T07:51:40.428267+0000","last_became_peered":"2024-04-26T07:51:40.428267+0000","last_unstale":"2024-04-26T07:52:28.260172+0000","last_undegraded":"2024-04-26T07:52:28.260172+0000","last_fullsized":"2024-04-26T07:52:28.260172+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:28.259968+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:28.259968+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.259968+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:50.333307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":46,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.240714+0000","last_change":"2024-04-26T07:52:10.240714+0000","last_active":"2024-04-26T07:52:10.240714+0000","last_peered":"2024-04-26T07:52:10.240714+0000","last_clean":"2024-04-26T07:52:10.240714+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:52:10.240714+0000","last_undegraded":"2024-04-26T07:52:10.240714+0000","last_fullsized":"2024-04-26T07:52:10.240714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:10.240434+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:10.240434+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.240434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:51.174041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'46","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.777459+0000","last_change":"2024-04-26T07:52:32.777522+0000","last_active":"2024-04-26T07:52:32.777459+0000","last_peered":"2024-04-26T07:52:32.777459+0000","last_clean":"2024-04-26T07:52:32.777459+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:52:32.777459+0000","last_undegraded":"2024-04-26T07:52:32.777459+0000","last_fullsized":"2024-04-26T07:52:32.777459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:32.777259+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:32.777259+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.777259+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:46.906907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.261323+0000","last_change":"2024-04-26T07:52:09.261323+0000","last_active":"2024-04-26T07:52:09.261323+0000","last_peered":"2024-04-26T07:52:09.261323+0000","last_clean":"2024-04-26T07:52:09.261323+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:52:09.261323+0000","last_undegraded":"2024-04-26T07:52:09.261323+0000","last_fullsized":"2024-04-26T07:52:09.261323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-26T07:52:09.261030+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-26T07:52:09.261030+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.261030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.240500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.451283+0000","last_change":"2024-04-26T07:52:08.451346+0000","last_active":"2024-04-26T07:52:08.451283+0000","last_peered":"2024-04-26T07:52:08.451283+0000","last_clean":"2024-04-26T07:52:08.451283+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:52:08.451283+0000","last_undegraded":"2024-04-26T07:52:08.451283+0000","last_fullsized":"2024-04-26T07:52:08.451283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2024-04-26T07:52:08.451067+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2024-04-26T07:52:08.451067+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.451067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:01.222132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'50","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.221522+0000","last_change":"2024-04-26T07:52:20.221589+0000","last_active":"2024-04-26T07:52:20.221522+0000","last_peered":"2024-04-26T07:52:20.221522+0000","last_clean":"2024-04-26T07:52:20.221522+0000","last_became_active":"2024-04-26T07:51:40.428461+0000","last_became_peered":"2024-04-26T07:51:40.428461+0000","last_unstale":"2024-04-26T07:52:20.221522+0000","last_undegraded":"2024-04-26T07:52:20.221522+0000","last_fullsized":"2024-04-26T07:52:20.221522+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:20.221290+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:20.221290+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.221290+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:36.889013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.122600+0000","last_change":"2024-04-26T07:52:11.122718+0000","last_active":"2024-04-26T07:52:11.122600+0000","last_peered":"2024-04-26T07:52:11.122600+0000","last_clean":"2024-04-26T07:52:11.122600+0000","last_became_active":"2024-04-26T07:51:40.435585+0000","last_became_peered":"2024-04-26T07:51:40.435585+0000","last_unstale":"2024-04-26T07:52:11.122600+0000","last_undegraded":"2024-04-26T07:52:11.122600+0000","last_fullsized":"2024-04-26T07:52:11.122600+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:11.122301+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:11.122301+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.122301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.239827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"109'60","reported_seq":262,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.923151+0000","last_change":"2024-04-26T07:52:14.923212+0000","last_active":"2024-04-26T07:52:14.923151+0000","last_peered":"2024-04-26T07:52:14.923151+0000","last_clean":"2024-04-26T07:52:14.923151+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:52:14.923151+0000","last_undegraded":"2024-04-26T07:52:14.923151+0000","last_fullsized":"2024-04-26T07:52:14.923151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'60","last_scrub_stamp":"2024-04-26T07:52:14.922953+0000","last_deep_scrub":"109'60","last_deep_scrub_stamp":"2024-04-26T07:52:14.922953+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.922953+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:15.659118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":70,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.232920+0000","last_change":"2024-04-26T07:52:12.232987+0000","last_active":"2024-04-26T07:52:12.232920+0000","last_peered":"2024-04-26T07:52:12.232920+0000","last_clean":"2024-04-26T07:52:12.232920+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:52:12.232920+0000","last_undegraded":"2024-04-26T07:52:12.232920+0000","last_fullsized":"2024-04-26T07:52:12.232920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:12.232704+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:12.232704+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.232704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:18.870226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.865735+0000","last_change":"2024-04-26T07:52:12.865876+0000","last_active":"2024-04-26T07:52:12.865735+0000","last_peered":"2024-04-26T07:52:12.865735+0000","last_clean":"2024-04-26T07:52:12.865735+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:52:12.865735+0000","last_undegraded":"2024-04-26T07:52:12.865735+0000","last_fullsized":"2024-04-26T07:52:12.865735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:12.865444+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:12.865444+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.865444+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:20.079871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.247276+0000","last_change":"2024-04-26T07:52:08.247416+0000","last_active":"2024-04-26T07:52:08.247276+0000","last_peered":"2024-04-26T07:52:08.247276+0000","last_clean":"2024-04-26T07:52:08.247276+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:52:08.247276+0000","last_undegraded":"2024-04-26T07:52:08.247276+0000","last_fullsized":"2024-04-26T07:52:08.247276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-04-26T07:52:08.246988+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-04-26T07:52:08.246988+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.246988+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:03:31.264202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'48","reported_seq":249,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.328511+0000","last_change":"2024-04-26T07:52:25.328578+0000","last_active":"2024-04-26T07:52:25.328511+0000","last_peered":"2024-04-26T07:52:25.328511+0000","last_clean":"2024-04-26T07:52:25.328511+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:52:25.328511+0000","last_undegraded":"2024-04-26T07:52:25.328511+0000","last_fullsized":"2024-04-26T07:52:25.328511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:25.328282+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:25.328282+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.328282+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:09:24.930839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.282867+0000","last_change":"2024-04-26T07:52:11.282934+0000","last_active":"2024-04-26T07:52:11.282867+0000","last_peered":"2024-04-26T07:52:11.282867+0000","last_clean":"2024-04-26T07:52:11.282867+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:52:11.282867+0000","last_undegraded":"2024-04-26T07:52:11.282867+0000","last_fullsized":"2024-04-26T07:52:11.282867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:11.282644+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:11.282644+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.282644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:27.077731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'42","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.790621+0000","last_change":"2024-04-26T07:52:31.790682+0000","last_active":"2024-04-26T07:52:31.790621+0000","last_peered":"2024-04-26T07:52:31.790621+0000","last_clean":"2024-04-26T07:52:31.790621+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:52:31.790621+0000","last_undegraded":"2024-04-26T07:52:31.790621+0000","last_fullsized":"2024-04-26T07:52:31.790621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:31.790421+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:31.790421+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.790421+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:33.406793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.452305+0000","last_change":"2024-04-26T07:52:10.452417+0000","last_active":"2024-04-26T07:52:10.452305+0000","last_peered":"2024-04-26T07:52:10.452305+0000","last_clean":"2024-04-26T07:52:10.452305+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:52:10.452305+0000","last_undegraded":"2024-04-26T07:52:10.452305+0000","last_fullsized":"2024-04-26T07:52:10.452305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:10.452068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:10.452068+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.452068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:08.204803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'46","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.574531+0000","last_change":"2024-04-26T07:52:27.574591+0000","last_active":"2024-04-26T07:52:27.574531+0000","last_peered":"2024-04-26T07:52:27.574531+0000","last_clean":"2024-04-26T07:52:27.574531+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:52:27.574531+0000","last_undegraded":"2024-04-26T07:52:27.574531+0000","last_fullsized":"2024-04-26T07:52:27.574531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:27.574340+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:27.574340+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.574340+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:47.403983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.396774+0000","last_change":"2024-04-26T07:52:36.396834+0000","last_active":"2024-04-26T07:52:36.396774+0000","last_peered":"2024-04-26T07:52:36.396774+0000","last_clean":"2024-04-26T07:52:36.396774+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:52:36.396774+0000","last_undegraded":"2024-04-26T07:52:36.396774+0000","last_fullsized":"2024-04-26T07:52:36.396774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:36.396577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:36.396577+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.396577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:50.526225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.792860+0000","last_change":"2024-04-26T07:52:20.792914+0000","last_active":"2024-04-26T07:52:20.792860+0000","last_peered":"2024-04-26T07:52:20.792860+0000","last_clean":"2024-04-26T07:52:20.792860+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:52:20.792860+0000","last_undegraded":"2024-04-26T07:52:20.792860+0000","last_fullsized":"2024-04-26T07:52:20.792860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:20.792663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:20.792663+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.792663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:09:20.395220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'38","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.208432+0000","last_change":"2024-04-26T07:52:20.208570+0000","last_active":"2024-04-26T07:52:20.208432+0000","last_peered":"2024-04-26T07:52:20.208432+0000","last_clean":"2024-04-26T07:52:20.208432+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:52:20.208432+0000","last_undegraded":"2024-04-26T07:52:20.208432+0000","last_fullsized":"2024-04-26T07:52:20.208432+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:20.208184+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:20.208184+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.208184+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:28.824965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.064095+0000","last_change":"2024-04-26T07:52:21.064149+0000","last_active":"2024-04-26T07:52:21.064095+0000","last_peered":"2024-04-26T07:52:21.064095+0000","last_clean":"2024-04-26T07:52:21.064095+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:52:21.064095+0000","last_undegraded":"2024-04-26T07:52:21.064095+0000","last_fullsized":"2024-04-26T07:52:21.064095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:21.063889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:21.063889+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.063889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:40.759242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"109'23","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.553495+0000","last_change":"2024-04-26T07:52:21.553579+0000","last_active":"2024-04-26T07:52:21.553495+0000","last_peered":"2024-04-26T07:52:21.553495+0000","last_clean":"2024-04-26T07:52:21.553495+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:52:21.553495+0000","last_undegraded":"2024-04-26T07:52:21.553495+0000","last_fullsized":"2024-04-26T07:52:21.553495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'23","last_scrub_stamp":"2024-04-26T07:52:21.553289+0000","last_deep_scrub":"109'23","last_deep_scrub_stamp":"2024-04-26T07:52:21.553289+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.553289+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:38.775577+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.200022+0000","last_change":"2024-04-26T07:52:24.200075+0000","last_active":"2024-04-26T07:52:24.200022+0000","last_peered":"2024-04-26T07:52:24.200022+0000","last_clean":"2024-04-26T07:52:24.200022+0000","last_became_active":"2024-04-26T07:51:40.424563+0000","last_became_peered":"2024-04-26T07:51:40.424563+0000","last_unstale":"2024-04-26T07:52:24.200022+0000","last_undegraded":"2024-04-26T07:52:24.200022+0000","last_fullsized":"2024-04-26T07:52:24.200022+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:24.199830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:24.199830+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.199830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:12:11.276539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"109'52","reported_seq":252,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.958842+0000","last_change":"2024-04-26T07:52:36.958915+0000","last_active":"2024-04-26T07:52:36.958842+0000","last_peered":"2024-04-26T07:52:36.958842+0000","last_clean":"2024-04-26T07:52:36.958842+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:52:36.958842+0000","last_undegraded":"2024-04-26T07:52:36.958842+0000","last_fullsized":"2024-04-26T07:52:36.958842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:36.958644+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:36.958644+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.958644+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:52.355089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.201772+0000","last_change":"2024-04-26T07:52:13.201839+0000","last_active":"2024-04-26T07:52:13.201772+0000","last_peered":"2024-04-26T07:52:13.201772+0000","last_clean":"2024-04-26T07:52:13.201772+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:52:13.201772+0000","last_undegraded":"2024-04-26T07:52:13.201772+0000","last_fullsized":"2024-04-26T07:52:13.201772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-04-26T07:52:13.201566+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-04-26T07:52:13.201566+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.201566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:18.051414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"109'40","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.589082+0000","last_change":"2024-04-26T07:52:22.589145+0000","last_active":"2024-04-26T07:52:22.589082+0000","last_peered":"2024-04-26T07:52:22.589082+0000","last_clean":"2024-04-26T07:52:22.589082+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:52:22.589082+0000","last_undegraded":"2024-04-26T07:52:22.589082+0000","last_fullsized":"2024-04-26T07:52:22.589082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'40","last_scrub_stamp":"2024-04-26T07:52:22.588888+0000","last_deep_scrub":"109'40","last_deep_scrub_stamp":"2024-04-26T07:52:22.588888+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.588888+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:47.564730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.698716+0000","last_change":"2024-04-26T07:52:25.698776+0000","last_active":"2024-04-26T07:52:25.698716+0000","last_peered":"2024-04-26T07:52:25.698716+0000","last_clean":"2024-04-26T07:52:25.698716+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:52:25.698716+0000","last_undegraded":"2024-04-26T07:52:25.698716+0000","last_fullsized":"2024-04-26T07:52:25.698716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:25.698497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:25.698497+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.698497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:15.184101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"109'10","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.492370+0000","last_change":"2024-04-26T07:52:03.492498+0000","last_active":"2024-04-26T07:52:03.492370+0000","last_peered":"2024-04-26T07:52:03.492370+0000","last_clean":"2024-04-26T07:52:03.492370+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:52:03.492370+0000","last_undegraded":"2024-04-26T07:52:03.492370+0000","last_fullsized":"2024-04-26T07:52:03.492370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'10","last_scrub_stamp":"2024-04-26T07:52:03.492141+0000","last_deep_scrub":"109'10","last_deep_scrub_stamp":"2024-04-26T07:52:03.492141+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.492141+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:06.056305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.385794+0000","last_change":"2024-04-26T07:52:33.385843+0000","last_active":"2024-04-26T07:52:33.385794+0000","last_peered":"2024-04-26T07:52:33.385794+0000","last_clean":"2024-04-26T07:52:33.385794+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:52:33.385794+0000","last_undegraded":"2024-04-26T07:52:33.385794+0000","last_fullsized":"2024-04-26T07:52:33.385794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:33.385603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:33.385603+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.385603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:51.925063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.664126+0000","last_change":"2024-04-26T07:52:05.664179+0000","last_active":"2024-04-26T07:52:05.664126+0000","last_peered":"2024-04-26T07:52:05.664126+0000","last_clean":"2024-04-26T07:52:05.664126+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:52:05.664126+0000","last_undegraded":"2024-04-26T07:52:05.664126+0000","last_fullsized":"2024-04-26T07:52:05.664126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.663918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.663918+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.663918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:48.628816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.633760+0000","last_change":"2024-04-26T07:52:12.633822+0000","last_active":"2024-04-26T07:52:12.633760+0000","last_peered":"2024-04-26T07:52:12.633760+0000","last_clean":"2024-04-26T07:52:12.633760+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:52:12.633760+0000","last_undegraded":"2024-04-26T07:52:12.633760+0000","last_fullsized":"2024-04-26T07:52:12.633760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:12.633562+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.633562+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.633562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:22.886192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"109'44","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.259531+0000","last_change":"2024-04-26T07:52:19.259589+0000","last_active":"2024-04-26T07:52:19.259531+0000","last_peered":"2024-04-26T07:52:19.259531+0000","last_clean":"2024-04-26T07:52:19.259531+0000","last_became_active":"2024-04-26T07:51:40.440255+0000","last_became_peered":"2024-04-26T07:51:40.440255+0000","last_unstale":"2024-04-26T07:52:19.259531+0000","last_undegraded":"2024-04-26T07:52:19.259531+0000","last_fullsized":"2024-04-26T07:52:19.259531+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:19.259340+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:19.259340+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.259340+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:38.836356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.758888+0000","last_change":"2024-04-26T07:52:23.758946+0000","last_active":"2024-04-26T07:52:23.758888+0000","last_peered":"2024-04-26T07:52:23.758888+0000","last_clean":"2024-04-26T07:52:23.758888+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:52:23.758888+0000","last_undegraded":"2024-04-26T07:52:23.758888+0000","last_fullsized":"2024-04-26T07:52:23.758888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:23.758701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:23.758701+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.758701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:40.426424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.277823+0000","last_change":"2024-04-26T07:52:14.277902+0000","last_active":"2024-04-26T07:52:14.277823+0000","last_peered":"2024-04-26T07:52:14.277823+0000","last_clean":"2024-04-26T07:52:14.277823+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:52:14.277823+0000","last_undegraded":"2024-04-26T07:52:14.277823+0000","last_fullsized":"2024-04-26T07:52:14.277823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:14.277616+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:14.277616+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.277616+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:00.703376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"109'141","reported_seq":324,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.210904+0000","last_change":"2024-04-26T07:52:30.210979+0000","last_active":"2024-04-26T07:52:30.210904+0000","last_peered":"2024-04-26T07:52:30.210904+0000","last_clean":"2024-04-26T07:52:30.210904+0000","last_became_active":"2024-04-26T07:51:40.439601+0000","last_became_peered":"2024-04-26T07:51:40.439601+0000","last_unstale":"2024-04-26T07:52:30.210904+0000","last_undegraded":"2024-04-26T07:52:30.210904+0000","last_fullsized":"2024-04-26T07:52:30.210904+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'141","last_scrub_stamp":"2024-04-26T07:52:30.210715+0000","last_deep_scrub":"109'141","last_deep_scrub_stamp":"2024-04-26T07:52:30.210715+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.210715+0000","objects_scrubbed":1,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:59.681409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:37.370436+0000","last_change":"2024-04-26T07:52:37.370491+0000","last_active":"2024-04-26T07:52:37.370436+0000","last_peered":"2024-04-26T07:52:37.370436+0000","last_clean":"2024-04-26T07:52:37.370436+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:52:37.370436+0000","last_undegraded":"2024-04-26T07:52:37.370436+0000","last_fullsized":"2024-04-26T07:52:37.370436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:37.370234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:37.370234+0000","last_clean_scrub_stamp":"2024-04-26T07:52:37.370234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:04.936707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.805342+0000","last_change":"2024-04-26T07:52:15.805420+0000","last_active":"2024-04-26T07:52:15.805342+0000","last_peered":"2024-04-26T07:52:15.805342+0000","last_clean":"2024-04-26T07:52:15.805342+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:52:15.805342+0000","last_undegraded":"2024-04-26T07:52:15.805342+0000","last_fullsized":"2024-04-26T07:52:15.805342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T07:52:15.805087+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T07:52:15.805087+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.805087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:39.922613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"109'34","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.938380+0000","last_change":"2024-04-26T07:52:15.938439+0000","last_active":"2024-04-26T07:52:15.938380+0000","last_peered":"2024-04-26T07:52:15.938380+0000","last_clean":"2024-04-26T07:52:15.938380+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:52:15.938380+0000","last_undegraded":"2024-04-26T07:52:15.938380+0000","last_fullsized":"2024-04-26T07:52:15.938380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'34","last_scrub_stamp":"2024-04-26T07:52:15.938189+0000","last_deep_scrub":"109'34","last_deep_scrub_stamp":"2024-04-26T07:52:15.938189+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.938189+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:52:23.210957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.089778+0000","last_change":"2024-04-26T07:52:19.089839+0000","last_active":"2024-04-26T07:52:19.089778+0000","last_peered":"2024-04-26T07:52:19.089778+0000","last_clean":"2024-04-26T07:52:19.089778+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:52:19.089778+0000","last_undegraded":"2024-04-26T07:52:19.089778+0000","last_fullsized":"2024-04-26T07:52:19.089778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:19.089577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:19.089577+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.089577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:00.592471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"109'24","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.209422+0000","last_change":"2024-04-26T07:52:33.209613+0000","last_active":"2024-04-26T07:52:33.209422+0000","last_peered":"2024-04-26T07:52:33.209422+0000","last_clean":"2024-04-26T07:52:33.209422+0000","last_became_active":"2024-04-26T07:51:40.441381+0000","last_became_peered":"2024-04-26T07:51:40.441381+0000","last_unstale":"2024-04-26T07:52:33.209422+0000","last_undegraded":"2024-04-26T07:52:33.209422+0000","last_fullsized":"2024-04-26T07:52:33.209422+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'24","last_scrub_stamp":"2024-04-26T07:52:33.209187+0000","last_deep_scrub":"109'24","last_deep_scrub_stamp":"2024-04-26T07:52:33.209187+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.209187+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:22.953535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"109'138","reported_seq":364,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.878275+0000","last_change":"2024-04-26T07:52:01.878315+0000","last_active":"2024-04-26T07:52:01.878275+0000","last_peered":"2024-04-26T07:52:01.878275+0000","last_clean":"2024-04-26T07:52:01.878275+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:52:01.878275+0000","last_undegraded":"2024-04-26T07:52:01.878275+0000","last_fullsized":"2024-04-26T07:52:01.878275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:01.878187+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:01.878187+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.878187+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:18.982430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.206891+0000","last_change":"2024-04-26T07:52:11.207035+0000","last_active":"2024-04-26T07:52:11.206891+0000","last_peered":"2024-04-26T07:52:11.206891+0000","last_clean":"2024-04-26T07:52:11.206891+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:52:11.206891+0000","last_undegraded":"2024-04-26T07:52:11.206891+0000","last_fullsized":"2024-04-26T07:52:11.206891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.206632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.206632+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.206632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:10.071458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"109'54","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.158131+0000","last_change":"2024-04-26T07:52:12.158189+0000","last_active":"2024-04-26T07:52:12.158131+0000","last_peered":"2024-04-26T07:52:12.158131+0000","last_clean":"2024-04-26T07:52:12.158131+0000","last_became_active":"2024-04-26T07:51:40.432352+0000","last_became_peered":"2024-04-26T07:51:40.432352+0000","last_unstale":"2024-04-26T07:52:12.158131+0000","last_undegraded":"2024-04-26T07:52:12.158131+0000","last_fullsized":"2024-04-26T07:52:12.158131+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'54","last_scrub_stamp":"2024-04-26T07:52:12.157906+0000","last_deep_scrub":"109'54","last_deep_scrub_stamp":"2024-04-26T07:52:12.157906+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.157906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:20.821794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.081213+0000","last_change":"2024-04-26T07:52:07.081269+0000","last_active":"2024-04-26T07:52:07.081213+0000","last_peered":"2024-04-26T07:52:07.081213+0000","last_clean":"2024-04-26T07:52:07.081213+0000","last_became_active":"2024-04-26T07:51:40.432366+0000","last_became_peered":"2024-04-26T07:51:40.432366+0000","last_unstale":"2024-04-26T07:52:07.081213+0000","last_undegraded":"2024-04-26T07:52:07.081213+0000","last_fullsized":"2024-04-26T07:52:07.081213+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.081009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.081009+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.081009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:54.855694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"109'38","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.201154+0000","last_change":"2024-04-26T07:52:02.201272+0000","last_active":"2024-04-26T07:52:02.201154+0000","last_peered":"2024-04-26T07:52:02.201154+0000","last_clean":"2024-04-26T07:52:02.201154+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:52:02.201154+0000","last_undegraded":"2024-04-26T07:52:02.201154+0000","last_fullsized":"2024-04-26T07:52:02.201154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:02.200966+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:02.200966+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.200966+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:09.415392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.461025+0000","last_change":"2024-04-26T07:52:22.461085+0000","last_active":"2024-04-26T07:52:22.461025+0000","last_peered":"2024-04-26T07:52:22.461025+0000","last_clean":"2024-04-26T07:52:22.461025+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:52:22.461025+0000","last_undegraded":"2024-04-26T07:52:22.461025+0000","last_fullsized":"2024-04-26T07:52:22.461025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:22.460796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:22.460796+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.460796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:47.019111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":190,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.971019+0000","last_change":"2024-04-26T07:52:32.971088+0000","last_active":"2024-04-26T07:52:32.971019+0000","last_peered":"2024-04-26T07:52:32.971019+0000","last_clean":"2024-04-26T07:52:32.971019+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:52:32.971019+0000","last_undegraded":"2024-04-26T07:52:32.971019+0000","last_fullsized":"2024-04-26T07:52:32.971019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-26T07:52:32.970790+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-26T07:52:32.970790+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.970790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:47.665827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.392691+0000","last_change":"2024-04-26T07:52:15.392753+0000","last_active":"2024-04-26T07:52:15.392691+0000","last_peered":"2024-04-26T07:52:15.392691+0000","last_clean":"2024-04-26T07:52:15.392691+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:52:15.392691+0000","last_undegraded":"2024-04-26T07:52:15.392691+0000","last_fullsized":"2024-04-26T07:52:15.392691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:15.392452+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:15.392452+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.392452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.950767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"109'48","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.196667+0000","last_change":"2024-04-26T07:52:14.196735+0000","last_active":"2024-04-26T07:52:14.196667+0000","last_peered":"2024-04-26T07:52:14.196667+0000","last_clean":"2024-04-26T07:52:14.196667+0000","last_became_active":"2024-04-26T07:51:40.431661+0000","last_became_peered":"2024-04-26T07:51:40.431661+0000","last_unstale":"2024-04-26T07:52:14.196667+0000","last_undegraded":"2024-04-26T07:52:14.196667+0000","last_fullsized":"2024-04-26T07:52:14.196667+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:14.196452+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:14.196452+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.196452+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:29.949849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.302556+0000","last_change":"2024-04-26T07:52:03.302694+0000","last_active":"2024-04-26T07:52:03.302556+0000","last_peered":"2024-04-26T07:52:03.302556+0000","last_clean":"2024-04-26T07:52:03.302556+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:52:03.302556+0000","last_undegraded":"2024-04-26T07:52:03.302556+0000","last_fullsized":"2024-04-26T07:52:03.302556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.302295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.302295+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.302295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:39.830995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"109'23","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.834034+0000","last_change":"2024-04-26T07:52:06.834194+0000","last_active":"2024-04-26T07:52:06.834034+0000","last_peered":"2024-04-26T07:52:06.834034+0000","last_clean":"2024-04-26T07:52:06.834034+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:52:06.834034+0000","last_undegraded":"2024-04-26T07:52:06.834034+0000","last_fullsized":"2024-04-26T07:52:06.834034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'23","last_scrub_stamp":"2024-04-26T07:52:06.833802+0000","last_deep_scrub":"109'23","last_deep_scrub_stamp":"2024-04-26T07:52:06.833802+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.833802+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:11.683650+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.897942+0000","last_change":"2024-04-26T07:52:00.897979+0000","last_active":"2024-04-26T07:52:00.897942+0000","last_peered":"2024-04-26T07:52:00.897942+0000","last_clean":"2024-04-26T07:52:00.897942+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:52:00.897942+0000","last_undegraded":"2024-04-26T07:52:00.897942+0000","last_fullsized":"2024-04-26T07:52:00.897942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:00.897847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:00.897847+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.897847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:10.340550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.882027+0000","last_change":"2024-04-26T07:52:25.882148+0000","last_active":"2024-04-26T07:52:25.882027+0000","last_peered":"2024-04-26T07:52:25.882027+0000","last_clean":"2024-04-26T07:52:25.882027+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:52:25.882027+0000","last_undegraded":"2024-04-26T07:52:25.882027+0000","last_fullsized":"2024-04-26T07:52:25.882027+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:25.881800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:25.881800+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.881800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:16.060146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.793661+0000","last_change":"2024-04-26T07:52:08.793723+0000","last_active":"2024-04-26T07:52:08.793661+0000","last_peered":"2024-04-26T07:52:08.793661+0000","last_clean":"2024-04-26T07:52:08.793661+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:52:08.793661+0000","last_undegraded":"2024-04-26T07:52:08.793661+0000","last_fullsized":"2024-04-26T07:52:08.793661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:08.793455+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:08.793455+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.793455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:25.612602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"109'50","reported_seq":217,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.175467+0000","last_change":"2024-04-26T07:52:34.175525+0000","last_active":"2024-04-26T07:52:34.175467+0000","last_peered":"2024-04-26T07:52:34.175467+0000","last_clean":"2024-04-26T07:52:34.175467+0000","last_became_active":"2024-04-26T07:51:40.444713+0000","last_became_peered":"2024-04-26T07:51:40.444713+0000","last_unstale":"2024-04-26T07:52:34.175467+0000","last_undegraded":"2024-04-26T07:52:34.175467+0000","last_fullsized":"2024-04-26T07:52:34.175467+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:34.175267+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:34.175267+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.175267+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:52.103499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.244619+0000","last_change":"2024-04-26T07:52:01.244670+0000","last_active":"2024-04-26T07:52:01.244619+0000","last_peered":"2024-04-26T07:52:01.244619+0000","last_clean":"2024-04-26T07:52:01.244619+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:52:01.244619+0000","last_undegraded":"2024-04-26T07:52:01.244619+0000","last_fullsized":"2024-04-26T07:52:01.244619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.244437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.244437+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.244437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:35.063751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"109'35","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.046001+0000","last_change":"2024-04-26T07:52:04.046087+0000","last_active":"2024-04-26T07:52:04.046001+0000","last_peered":"2024-04-26T07:52:04.046001+0000","last_clean":"2024-04-26T07:52:04.046001+0000","last_became_active":"2024-04-26T07:51:40.438940+0000","last_became_peered":"2024-04-26T07:51:40.438940+0000","last_unstale":"2024-04-26T07:52:04.046001+0000","last_undegraded":"2024-04-26T07:52:04.046001+0000","last_fullsized":"2024-04-26T07:52:04.046001+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'35","last_scrub_stamp":"2024-04-26T07:52:04.045815+0000","last_deep_scrub":"109'35","last_deep_scrub_stamp":"2024-04-26T07:52:04.045815+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.045815+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:29.419100+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":153,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"109'138","reported_seq":362,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.662811+0000","last_change":"2024-04-26T07:52:00.662851+0000","last_active":"2024-04-26T07:52:00.662811+0000","last_peered":"2024-04-26T07:52:00.662811+0000","last_clean":"2024-04-26T07:52:00.662811+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:52:00.662811+0000","last_undegraded":"2024-04-26T07:52:00.662811+0000","last_fullsized":"2024-04-26T07:52:00.662811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:00.662728+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:00.662728+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.662728+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:34.806313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.616052+0000","last_change":"2024-04-26T07:52:33.616117+0000","last_active":"2024-04-26T07:52:33.616052+0000","last_peered":"2024-04-26T07:52:33.616052+0000","last_clean":"2024-04-26T07:52:33.616052+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:52:33.616052+0000","last_undegraded":"2024-04-26T07:52:33.616052+0000","last_fullsized":"2024-04-26T07:52:33.616052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:33.615826+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:33.615826+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.615826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:01.182300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.525208+0000","last_change":"2024-04-26T07:52:20.525270+0000","last_active":"2024-04-26T07:52:20.525208+0000","last_peered":"2024-04-26T07:52:20.525208+0000","last_clean":"2024-04-26T07:52:20.525208+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:52:20.525208+0000","last_undegraded":"2024-04-26T07:52:20.525208+0000","last_fullsized":"2024-04-26T07:52:20.525208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:20.525011+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:20.525011+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.525011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:26.101551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"109'48","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.997173+0000","last_change":"2024-04-26T07:52:27.997233+0000","last_active":"2024-04-26T07:52:27.997173+0000","last_peered":"2024-04-26T07:52:27.997173+0000","last_clean":"2024-04-26T07:52:27.997173+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:52:27.997173+0000","last_undegraded":"2024-04-26T07:52:27.997173+0000","last_fullsized":"2024-04-26T07:52:27.997173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:27.996948+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:27.996948+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.996948+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:09:27.599505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.310850+0000","last_change":"2024-04-26T07:52:04.310901+0000","last_active":"2024-04-26T07:52:04.310850+0000","last_peered":"2024-04-26T07:52:04.310850+0000","last_clean":"2024-04-26T07:52:04.310850+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:52:04.310850+0000","last_undegraded":"2024-04-26T07:52:04.310850+0000","last_fullsized":"2024-04-26T07:52:04.310850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.310639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.310639+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.310639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:31.403021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'40","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.606739+0000","last_change":"2024-04-26T07:52:31.606902+0000","last_active":"2024-04-26T07:52:31.606739+0000","last_peered":"2024-04-26T07:52:31.606739+0000","last_clean":"2024-04-26T07:52:31.606739+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:52:31.606739+0000","last_undegraded":"2024-04-26T07:52:31.606739+0000","last_fullsized":"2024-04-26T07:52:31.606739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'40","last_scrub_stamp":"2024-04-26T07:52:31.606501+0000","last_deep_scrub":"109'40","last_deep_scrub_stamp":"2024-04-26T07:52:31.606501+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.606501+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:33.222872+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.228544+0000","last_change":"2024-04-26T07:52:17.228596+0000","last_active":"2024-04-26T07:52:17.228544+0000","last_peered":"2024-04-26T07:52:17.228544+0000","last_clean":"2024-04-26T07:52:17.228544+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:52:17.228544+0000","last_undegraded":"2024-04-26T07:52:17.228544+0000","last_fullsized":"2024-04-26T07:52:17.228544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.228351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.228351+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.228351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:22.177055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"109'6","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.479133+0000","last_change":"2024-04-26T07:52:26.479203+0000","last_active":"2024-04-26T07:52:26.479133+0000","last_peered":"2024-04-26T07:52:26.479133+0000","last_clean":"2024-04-26T07:52:26.479133+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:52:26.479133+0000","last_undegraded":"2024-04-26T07:52:26.479133+0000","last_fullsized":"2024-04-26T07:52:26.479133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'6","last_scrub_stamp":"2024-04-26T07:52:26.478934+0000","last_deep_scrub":"109'6","last_deep_scrub_stamp":"2024-04-26T07:52:26.478934+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.478934+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:17.099163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":251,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.379233+0000","last_change":"2024-04-26T07:52:28.379387+0000","last_active":"2024-04-26T07:52:28.379233+0000","last_peered":"2024-04-26T07:52:28.379233+0000","last_clean":"2024-04-26T07:52:28.379233+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:52:28.379233+0000","last_undegraded":"2024-04-26T07:52:28.379233+0000","last_fullsized":"2024-04-26T07:52:28.379233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'16","last_scrub_stamp":"2024-04-26T07:52:28.378996+0000","last_deep_scrub":"90'16","last_deep_scrub_stamp":"2024-04-26T07:52:28.378996+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.378996+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:56.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"109'58","reported_seq":260,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.738477+0000","last_change":"2024-04-26T07:52:28.738658+0000","last_active":"2024-04-26T07:52:28.738477+0000","last_peered":"2024-04-26T07:52:28.738477+0000","last_clean":"2024-04-26T07:52:28.738477+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:52:28.738477+0000","last_undegraded":"2024-04-26T07:52:28.738477+0000","last_fullsized":"2024-04-26T07:52:28.738477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:28.738244+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:28.738244+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.738244+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.320740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.256236+0000","last_change":"2024-04-26T07:52:13.256290+0000","last_active":"2024-04-26T07:52:13.256236+0000","last_peered":"2024-04-26T07:52:13.256236+0000","last_clean":"2024-04-26T07:52:13.256236+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:52:13.256236+0000","last_undegraded":"2024-04-26T07:52:13.256236+0000","last_fullsized":"2024-04-26T07:52:13.256236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.256011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.256011+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.256011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:57.356082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"109'27","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.488331+0000","last_change":"2024-04-26T07:52:01.488414+0000","last_active":"2024-04-26T07:52:01.488331+0000","last_peered":"2024-04-26T07:52:01.488331+0000","last_clean":"2024-04-26T07:52:01.488331+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:52:01.488331+0000","last_undegraded":"2024-04-26T07:52:01.488331+0000","last_fullsized":"2024-04-26T07:52:01.488331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'27","last_scrub_stamp":"2024-04-26T07:52:01.488121+0000","last_deep_scrub":"109'27","last_deep_scrub_stamp":"2024-04-26T07:52:01.488121+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.488121+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:08.702547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.616322+0000","last_change":"2024-04-26T07:52:04.616379+0000","last_active":"2024-04-26T07:52:04.616322+0000","last_peered":"2024-04-26T07:52:04.616322+0000","last_clean":"2024-04-26T07:52:04.616322+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:52:04.616322+0000","last_undegraded":"2024-04-26T07:52:04.616322+0000","last_fullsized":"2024-04-26T07:52:04.616322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.616119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.616119+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.616119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:02.368854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:38.809853+0000","last_change":"2024-04-26T07:52:38.809913+0000","last_active":"2024-04-26T07:52:38.809853+0000","last_peered":"2024-04-26T07:52:38.809853+0000","last_clean":"2024-04-26T07:52:38.809853+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:52:38.809853+0000","last_undegraded":"2024-04-26T07:52:38.809853+0000","last_fullsized":"2024-04-26T07:52:38.809853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:38.809616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:38.809616+0000","last_clean_scrub_stamp":"2024-04-26T07:52:38.809616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:20.874315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.306687+0000","last_change":"2024-04-26T07:52:21.306811+0000","last_active":"2024-04-26T07:52:21.306687+0000","last_peered":"2024-04-26T07:52:21.306687+0000","last_clean":"2024-04-26T07:52:21.306687+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:52:21.306687+0000","last_undegraded":"2024-04-26T07:52:21.306687+0000","last_fullsized":"2024-04-26T07:52:21.306687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:21.306456+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:21.306456+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.306456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:24.197027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"109'50","reported_seq":251,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.965615+0000","last_change":"2024-04-26T07:52:16.965742+0000","last_active":"2024-04-26T07:52:16.965615+0000","last_peered":"2024-04-26T07:52:16.965615+0000","last_clean":"2024-04-26T07:52:16.965615+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:52:16.965615+0000","last_undegraded":"2024-04-26T07:52:16.965615+0000","last_fullsized":"2024-04-26T07:52:16.965615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:16.965395+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:16.965395+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.965395+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:25.582176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.533551+0000","last_change":"2024-04-26T07:52:07.533606+0000","last_active":"2024-04-26T07:52:07.533551+0000","last_peered":"2024-04-26T07:52:07.533551+0000","last_clean":"2024-04-26T07:52:07.533551+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:52:07.533551+0000","last_undegraded":"2024-04-26T07:52:07.533551+0000","last_fullsized":"2024-04-26T07:52:07.533551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.533355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.533355+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.533355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:12.482059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"109'33","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.241835+0000","last_change":"2024-04-26T07:52:15.241989+0000","last_active":"2024-04-26T07:52:15.241835+0000","last_peered":"2024-04-26T07:52:15.241835+0000","last_clean":"2024-04-26T07:52:15.241835+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:52:15.241835+0000","last_undegraded":"2024-04-26T07:52:15.241835+0000","last_fullsized":"2024-04-26T07:52:15.241835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'33","last_scrub_stamp":"2024-04-26T07:52:15.241568+0000","last_deep_scrub":"109'33","last_deep_scrub_stamp":"2024-04-26T07:52:15.241568+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.241568+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:12.356672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"109'138","reported_seq":379,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.220312+0000","last_change":"2024-04-26T07:52:16.220376+0000","last_active":"2024-04-26T07:52:16.220312+0000","last_peered":"2024-04-26T07:52:16.220312+0000","last_clean":"2024-04-26T07:52:16.220312+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:52:16.220312+0000","last_undegraded":"2024-04-26T07:52:16.220312+0000","last_fullsized":"2024-04-26T07:52:16.220312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:16.220114+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:16.220114+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.220114+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:23.434541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.481187+0000","last_change":"2024-04-26T07:52:25.481241+0000","last_active":"2024-04-26T07:52:25.481187+0000","last_peered":"2024-04-26T07:52:25.481187+0000","last_clean":"2024-04-26T07:52:25.481187+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:52:25.481187+0000","last_undegraded":"2024-04-26T07:52:25.481187+0000","last_fullsized":"2024-04-26T07:52:25.481187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:25.480977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:25.480977+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.480977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.623821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.474346+0000","last_change":"2024-04-26T07:52:11.474410+0000","last_active":"2024-04-26T07:52:11.474346+0000","last_peered":"2024-04-26T07:52:11.474346+0000","last_clean":"2024-04-26T07:52:11.474346+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:52:11.474346+0000","last_undegraded":"2024-04-26T07:52:11.474346+0000","last_fullsized":"2024-04-26T07:52:11.474346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:11.474096+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:11.474096+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.474096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:16.323944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"109'60","reported_seq":261,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.363430+0000","last_change":"2024-04-26T07:52:24.363495+0000","last_active":"2024-04-26T07:52:24.363430+0000","last_peered":"2024-04-26T07:52:24.363430+0000","last_clean":"2024-04-26T07:52:24.363430+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:52:24.363430+0000","last_undegraded":"2024-04-26T07:52:24.363430+0000","last_fullsized":"2024-04-26T07:52:24.363430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'60","last_scrub_stamp":"2024-04-26T07:52:24.363229+0000","last_deep_scrub":"109'60","last_deep_scrub_stamp":"2024-04-26T07:52:24.363229+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.363229+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:29.856384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"109'4","reported_seq":378,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.152436+0000","last_change":"2024-04-26T07:52:15.152502+0000","last_active":"2024-04-26T07:52:15.152436+0000","last_peered":"2024-04-26T07:52:15.152436+0000","last_clean":"2024-04-26T07:52:15.152436+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:52:15.152436+0000","last_undegraded":"2024-04-26T07:52:15.152436+0000","last_fullsized":"2024-04-26T07:52:15.152436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'4","last_scrub_stamp":"2024-04-26T07:52:15.152246+0000","last_deep_scrub":"109'4","last_deep_scrub_stamp":"2024-04-26T07:52:15.152246+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.152246+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:40.525531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.839154+0000","last_change":"2024-04-26T07:52:04.839233+0000","last_active":"2024-04-26T07:52:04.839154+0000","last_peered":"2024-04-26T07:52:04.839154+0000","last_clean":"2024-04-26T07:52:04.839154+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:52:04.839154+0000","last_undegraded":"2024-04-26T07:52:04.839154+0000","last_fullsized":"2024-04-26T07:52:04.839154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:04.838959+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:04.838959+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.838959+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:03.703786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"109'138","reported_seq":414,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.930534+0000","last_change":"2024-04-26T07:52:19.930602+0000","last_active":"2024-04-26T07:52:19.930534+0000","last_peered":"2024-04-26T07:52:19.930534+0000","last_clean":"2024-04-26T07:52:19.930534+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:52:19.930534+0000","last_undegraded":"2024-04-26T07:52:19.930534+0000","last_fullsized":"2024-04-26T07:52:19.930534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:19.930341+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:19.930341+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.930341+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:24.352514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.383758+0000","last_change":"2024-04-26T07:52:34.383818+0000","last_active":"2024-04-26T07:52:34.383758+0000","last_peered":"2024-04-26T07:52:34.383758+0000","last_clean":"2024-04-26T07:52:34.383758+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:52:34.383758+0000","last_undegraded":"2024-04-26T07:52:34.383758+0000","last_fullsized":"2024-04-26T07:52:34.383758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:34.383543+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:34.383543+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.383543+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:49.779988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":166,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394526+0000","last_change":"2024-04-26T07:48:53.779161+0000","last_active":"2024-04-26T07:51:40.394526+0000","last_peered":"2024-04-26T07:51:40.394526+0000","last_clean":"2024-04-26T07:51:40.394526+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:51:40.394526+0000","last_undegraded":"2024-04-26T07:51:40.394526+0000","last_fullsized":"2024-04-26T07:51:40.394526+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:22.491812+0000","last_clean_scrub_stamp":"2024-04-26T07:48:22.491812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"109'58","reported_seq":260,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.792338+0000","last_change":"2024-04-26T07:52:30.792403+0000","last_active":"2024-04-26T07:52:30.792338+0000","last_peered":"2024-04-26T07:52:30.792338+0000","last_clean":"2024-04-26T07:52:30.792338+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:52:30.792338+0000","last_undegraded":"2024-04-26T07:52:30.792338+0000","last_fullsized":"2024-04-26T07:52:30.792338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:30.792060+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:30.792060+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.792060+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:46.188505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.360458+0000","last_change":"2024-04-26T07:52:16.360510+0000","last_active":"2024-04-26T07:52:16.360458+0000","last_peered":"2024-04-26T07:52:16.360458+0000","last_clean":"2024-04-26T07:52:16.360458+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:52:16.360458+0000","last_undegraded":"2024-04-26T07:52:16.360458+0000","last_fullsized":"2024-04-26T07:52:16.360458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:16.360269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:16.360269+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.360269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:04.134953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"109'36","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.208054+0000","last_change":"2024-04-26T07:52:04.208140+0000","last_active":"2024-04-26T07:52:04.208054+0000","last_peered":"2024-04-26T07:52:04.208054+0000","last_clean":"2024-04-26T07:52:04.208054+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:52:04.208054+0000","last_undegraded":"2024-04-26T07:52:04.208054+0000","last_fullsized":"2024-04-26T07:52:04.208054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:04.207861+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:04.207861+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.207861+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:06.772025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.888650+0000","last_change":"2024-04-26T07:52:20.888704+0000","last_active":"2024-04-26T07:52:20.888650+0000","last_peered":"2024-04-26T07:52:20.888650+0000","last_clean":"2024-04-26T07:52:20.888650+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:52:20.888650+0000","last_undegraded":"2024-04-26T07:52:20.888650+0000","last_fullsized":"2024-04-26T07:52:20.888650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:20.888449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:20.888449+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.888449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:02.305270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.496186+0000","last_change":"2024-04-26T07:52:27.496242+0000","last_active":"2024-04-26T07:52:27.496186+0000","last_peered":"2024-04-26T07:52:27.496186+0000","last_clean":"2024-04-26T07:52:27.496186+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:52:27.496186+0000","last_undegraded":"2024-04-26T07:52:27.496186+0000","last_fullsized":"2024-04-26T07:52:27.496186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:27.495948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:27.495948+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.495948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:51.613474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.868761+0000","last_change":"2024-04-26T07:52:02.868761+0000","last_active":"2024-04-26T07:52:02.868761+0000","last_peered":"2024-04-26T07:52:02.868761+0000","last_clean":"2024-04-26T07:52:02.868761+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:52:02.868761+0000","last_undegraded":"2024-04-26T07:52:02.868761+0000","last_fullsized":"2024-04-26T07:52:02.868761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-26T07:52:02.868394+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-26T07:52:02.868394+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.868394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:08.921031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"109'119","reported_seq":316,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.111271+0000","last_change":"2024-04-26T07:52:08.111271+0000","last_active":"2024-04-26T07:52:08.111271+0000","last_peered":"2024-04-26T07:52:08.111271+0000","last_clean":"2024-04-26T07:52:08.111271+0000","last_became_active":"2024-04-26T07:51:40.429475+0000","last_became_peered":"2024-04-26T07:51:40.429475+0000","last_unstale":"2024-04-26T07:52:08.111271+0000","last_undegraded":"2024-04-26T07:52:08.111271+0000","last_fullsized":"2024-04-26T07:52:08.111271+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'119","last_scrub_stamp":"2024-04-26T07:52:08.110978+0000","last_deep_scrub":"109'119","last_deep_scrub_stamp":"2024-04-26T07:52:08.110978+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.110978+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:49.613873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.042139+0000","last_change":"2024-04-26T07:52:23.042139+0000","last_active":"2024-04-26T07:52:23.042139+0000","last_peered":"2024-04-26T07:52:23.042139+0000","last_clean":"2024-04-26T07:52:23.042139+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:52:23.042139+0000","last_undegraded":"2024-04-26T07:52:23.042139+0000","last_fullsized":"2024-04-26T07:52:23.042139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:23.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:23.041869+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:44.998833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"109'42","reported_seq":245,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.721411+0000","last_change":"2024-04-26T07:52:24.721411+0000","last_active":"2024-04-26T07:52:24.721411+0000","last_peered":"2024-04-26T07:52:24.721411+0000","last_clean":"2024-04-26T07:52:24.721411+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:52:24.721411+0000","last_undegraded":"2024-04-26T07:52:24.721411+0000","last_fullsized":"2024-04-26T07:52:24.721411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:24.721015+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:24.721015+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.721015+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:52.904920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":150,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.283711+0000","last_change":"2024-04-26T07:52:18.283711+0000","last_active":"2024-04-26T07:52:18.283711+0000","last_peered":"2024-04-26T07:52:18.283711+0000","last_clean":"2024-04-26T07:52:18.283711+0000","last_became_active":"2024-04-26T07:51:40.428641+0000","last_became_peered":"2024-04-26T07:51:40.428641+0000","last_unstale":"2024-04-26T07:52:18.283711+0000","last_undegraded":"2024-04-26T07:52:18.283711+0000","last_fullsized":"2024-04-26T07:52:18.283711+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:18.283431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:18.283431+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.283431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:43.259274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"109'51","reported_seq":265,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.190027+0000","last_change":"2024-04-26T07:52:06.190110+0000","last_active":"2024-04-26T07:52:06.190027+0000","last_peered":"2024-04-26T07:52:06.190027+0000","last_clean":"2024-04-26T07:52:06.190027+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:52:06.190027+0000","last_undegraded":"2024-04-26T07:52:06.190027+0000","last_fullsized":"2024-04-26T07:52:06.190027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'51","last_scrub_stamp":"2024-04-26T07:52:06.189827+0000","last_deep_scrub":"109'51","last_deep_scrub_stamp":"2024-04-26T07:52:06.189827+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.189827+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:17.316177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":274,"num_write":26,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.682572+0000","last_change":"2024-04-26T07:52:02.682623+0000","last_active":"2024-04-26T07:52:02.682572+0000","last_peered":"2024-04-26T07:52:02.682572+0000","last_clean":"2024-04-26T07:52:02.682572+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:52:02.682572+0000","last_undegraded":"2024-04-26T07:52:02.682572+0000","last_fullsized":"2024-04-26T07:52:02.682572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:02.682386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:02.682386+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.682386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:44.099207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.844495+0000","last_change":"2024-04-26T07:52:26.844554+0000","last_active":"2024-04-26T07:52:26.844495+0000","last_peered":"2024-04-26T07:52:26.844495+0000","last_clean":"2024-04-26T07:52:26.844495+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:52:26.844495+0000","last_undegraded":"2024-04-26T07:52:26.844495+0000","last_fullsized":"2024-04-26T07:52:26.844495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:26.844280+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:26.844280+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.844280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:34:45.787818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.639725+0000","last_change":"2024-04-26T07:52:14.639787+0000","last_active":"2024-04-26T07:52:14.639725+0000","last_peered":"2024-04-26T07:52:14.639725+0000","last_clean":"2024-04-26T07:52:14.639725+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:52:14.639725+0000","last_undegraded":"2024-04-26T07:52:14.639725+0000","last_fullsized":"2024-04-26T07:52:14.639725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'10","last_scrub_stamp":"2024-04-26T07:52:14.639493+0000","last_deep_scrub":"72'10","last_deep_scrub_stamp":"2024-04-26T07:52:14.639493+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.639493+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:05.259721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.212344+0000","last_change":"2024-04-26T07:52:15.212344+0000","last_active":"2024-04-26T07:52:15.212344+0000","last_peered":"2024-04-26T07:52:15.212344+0000","last_clean":"2024-04-26T07:52:15.212344+0000","last_became_active":"2024-04-26T07:51:40.437582+0000","last_became_peered":"2024-04-26T07:51:40.437582+0000","last_unstale":"2024-04-26T07:52:15.212344+0000","last_undegraded":"2024-04-26T07:52:15.212344+0000","last_fullsized":"2024-04-26T07:52:15.212344+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:15.212060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:15.212060+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.212060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:27.725357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"109'40","reported_seq":241,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.564876+0000","last_change":"2024-04-26T07:52:23.564876+0000","last_active":"2024-04-26T07:52:23.564876+0000","last_peered":"2024-04-26T07:52:23.564876+0000","last_clean":"2024-04-26T07:52:23.564876+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:52:23.564876+0000","last_undegraded":"2024-04-26T07:52:23.564876+0000","last_fullsized":"2024-04-26T07:52:23.564876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'40","last_scrub_stamp":"2024-04-26T07:52:23.564708+0000","last_deep_scrub":"109'40","last_deep_scrub_stamp":"2024-04-26T07:52:23.564708+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.564708+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:40.232431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.014754+0000","last_change":"2024-04-26T07:52:31.014807+0000","last_active":"2024-04-26T07:52:31.014754+0000","last_peered":"2024-04-26T07:52:31.014754+0000","last_clean":"2024-04-26T07:52:31.014754+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:52:31.014754+0000","last_undegraded":"2024-04-26T07:52:31.014754+0000","last_fullsized":"2024-04-26T07:52:31.014754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:31.014549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:31.014549+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.014549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:16:15.149860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"109'156","reported_seq":461,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.547470+0000","last_change":"2024-04-26T07:52:09.547470+0000","last_active":"2024-04-26T07:52:09.547470+0000","last_peered":"2024-04-26T07:52:09.547470+0000","last_clean":"2024-04-26T07:52:09.547470+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:52:09.547470+0000","last_undegraded":"2024-04-26T07:52:09.547470+0000","last_fullsized":"2024-04-26T07:52:09.547470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'156","last_scrub_stamp":"2024-04-26T07:52:09.547197+0000","last_deep_scrub":"109'156","last_deep_scrub_stamp":"2024-04-26T07:52:09.547197+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.547197+0000","objects_scrubbed":10,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:52:16.819965+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":142,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.241931+0000","last_change":"2024-04-26T07:52:29.241931+0000","last_active":"2024-04-26T07:52:29.241931+0000","last_peered":"2024-04-26T07:52:29.241931+0000","last_clean":"2024-04-26T07:52:29.241931+0000","last_became_active":"2024-04-26T07:51:40.439356+0000","last_became_peered":"2024-04-26T07:51:40.439356+0000","last_unstale":"2024-04-26T07:52:29.241931+0000","last_undegraded":"2024-04-26T07:52:29.241931+0000","last_fullsized":"2024-04-26T07:52:29.241931+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:29.241579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:29.241579+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.241579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:56.808053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.500687+0000","last_change":"2024-04-26T07:52:28.500858+0000","last_active":"2024-04-26T07:52:28.500687+0000","last_peered":"2024-04-26T07:52:28.500687+0000","last_clean":"2024-04-26T07:52:28.500687+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:52:28.500687+0000","last_undegraded":"2024-04-26T07:52:28.500687+0000","last_fullsized":"2024-04-26T07:52:28.500687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3","last_scrub_stamp":"2024-04-26T07:52:28.500442+0000","last_deep_scrub":"55'3","last_deep_scrub_stamp":"2024-04-26T07:52:28.500442+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.500442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:37.164330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.572971+0000","last_change":"2024-04-26T07:52:06.573026+0000","last_active":"2024-04-26T07:52:06.572971+0000","last_peered":"2024-04-26T07:52:06.572971+0000","last_clean":"2024-04-26T07:52:06.572971+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:52:06.572971+0000","last_undegraded":"2024-04-26T07:52:06.572971+0000","last_fullsized":"2024-04-26T07:52:06.572971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:06.572770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:06.572770+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.572770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:13.787197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.359784+0000","last_change":"2024-04-26T07:52:05.359784+0000","last_active":"2024-04-26T07:52:05.359784+0000","last_peered":"2024-04-26T07:52:05.359784+0000","last_clean":"2024-04-26T07:52:05.359784+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:52:05.359784+0000","last_undegraded":"2024-04-26T07:52:05.359784+0000","last_fullsized":"2024-04-26T07:52:05.359784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.359508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.359508+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.359508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:45.415341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"109'52","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.480204+0000","last_change":"2024-04-26T07:52:20.480204+0000","last_active":"2024-04-26T07:52:20.480204+0000","last_peered":"2024-04-26T07:52:20.480204+0000","last_clean":"2024-04-26T07:52:20.480204+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:52:20.480204+0000","last_undegraded":"2024-04-26T07:52:20.480204+0000","last_fullsized":"2024-04-26T07:52:20.480204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:20.479934+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:20.479934+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.479934+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:34:39.423473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"109'2","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.288765+0000","last_change":"2024-04-26T07:52:02.288828+0000","last_active":"2024-04-26T07:52:02.288765+0000","last_peered":"2024-04-26T07:52:02.288765+0000","last_clean":"2024-04-26T07:52:02.288765+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:52:02.288765+0000","last_undegraded":"2024-04-26T07:52:02.288765+0000","last_fullsized":"2024-04-26T07:52:02.288765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:02.288582+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:02.288582+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.288582+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:12.977945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"109'26","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.211440+0000","last_change":"2024-04-26T07:52:35.211440+0000","last_active":"2024-04-26T07:52:35.211440+0000","last_peered":"2024-04-26T07:52:35.211440+0000","last_clean":"2024-04-26T07:52:35.211440+0000","last_became_active":"2024-04-26T07:51:40.445444+0000","last_became_peered":"2024-04-26T07:51:40.445444+0000","last_unstale":"2024-04-26T07:52:35.211440+0000","last_undegraded":"2024-04-26T07:52:35.211440+0000","last_fullsized":"2024-04-26T07:52:35.211440+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'26","last_scrub_stamp":"2024-04-26T07:52:35.211175+0000","last_deep_scrub":"109'26","last_deep_scrub_stamp":"2024-04-26T07:52:35.211175+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.211175+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:43.870202+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.659273+0000","last_change":"2024-04-26T07:52:03.659273+0000","last_active":"2024-04-26T07:52:03.659273+0000","last_peered":"2024-04-26T07:52:03.659273+0000","last_clean":"2024-04-26T07:52:03.659273+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:52:03.659273+0000","last_undegraded":"2024-04-26T07:52:03.659273+0000","last_fullsized":"2024-04-26T07:52:03.659273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.659029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.659029+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.659029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.870936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.778037+0000","last_change":"2024-04-26T07:52:36.778097+0000","last_active":"2024-04-26T07:52:36.778037+0000","last_peered":"2024-04-26T07:52:36.778037+0000","last_clean":"2024-04-26T07:52:36.778037+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:52:36.778037+0000","last_undegraded":"2024-04-26T07:52:36.778037+0000","last_fullsized":"2024-04-26T07:52:36.778037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'6","last_scrub_stamp":"2024-04-26T07:52:36.777844+0000","last_deep_scrub":"55'6","last_deep_scrub_stamp":"2024-04-26T07:52:36.777844+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.777844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:26.522191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.562346+0000","last_change":"2024-04-26T07:52:12.562346+0000","last_active":"2024-04-26T07:52:12.562346+0000","last_peered":"2024-04-26T07:52:12.562346+0000","last_clean":"2024-04-26T07:52:12.562346+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:52:12.562346+0000","last_undegraded":"2024-04-26T07:52:12.562346+0000","last_fullsized":"2024-04-26T07:52:12.562346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-26T07:52:12.562055+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.562055+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.562055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:46.705639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.015497+0000","last_change":"2024-04-26T07:52:24.015549+0000","last_active":"2024-04-26T07:52:24.015497+0000","last_peered":"2024-04-26T07:52:24.015497+0000","last_clean":"2024-04-26T07:52:24.015497+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:52:24.015497+0000","last_undegraded":"2024-04-26T07:52:24.015497+0000","last_fullsized":"2024-04-26T07:52:24.015497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:24.015293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:24.015293+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.015293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:26.905864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"109'40","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.351273+0000","last_change":"2024-04-26T07:52:23.351273+0000","last_active":"2024-04-26T07:52:23.351273+0000","last_peered":"2024-04-26T07:52:23.351273+0000","last_clean":"2024-04-26T07:52:23.351273+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:52:23.351273+0000","last_undegraded":"2024-04-26T07:52:23.351273+0000","last_fullsized":"2024-04-26T07:52:23.351273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'40","last_scrub_stamp":"2024-04-26T07:52:23.350914+0000","last_deep_scrub":"109'40","last_deep_scrub_stamp":"2024-04-26T07:52:23.350914+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.350914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:35.864211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.634380+0000","last_change":"2024-04-26T07:52:09.634380+0000","last_active":"2024-04-26T07:52:09.634380+0000","last_peered":"2024-04-26T07:52:09.634380+0000","last_clean":"2024-04-26T07:52:09.634380+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:52:09.634380+0000","last_undegraded":"2024-04-26T07:52:09.634380+0000","last_fullsized":"2024-04-26T07:52:09.634380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:09.634025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:09.634025+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.634025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:39.955994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"109'18","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.830403+0000","last_change":"2024-04-26T07:52:35.830487+0000","last_active":"2024-04-26T07:52:35.830403+0000","last_peered":"2024-04-26T07:52:35.830403+0000","last_clean":"2024-04-26T07:52:35.830403+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:52:35.830403+0000","last_undegraded":"2024-04-26T07:52:35.830403+0000","last_fullsized":"2024-04-26T07:52:35.830403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'18","last_scrub_stamp":"2024-04-26T07:52:35.830215+0000","last_deep_scrub":"109'18","last_deep_scrub_stamp":"2024-04-26T07:52:35.830215+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.830215+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:30.276751+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.873446+0000","last_change":"2024-04-26T07:52:23.873565+0000","last_active":"2024-04-26T07:52:23.873446+0000","last_peered":"2024-04-26T07:52:23.873446+0000","last_clean":"2024-04-26T07:52:23.873446+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:52:23.873446+0000","last_undegraded":"2024-04-26T07:52:23.873446+0000","last_fullsized":"2024-04-26T07:52:23.873446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:23.873186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:23.873186+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.873186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:06.838084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.917590+0000","last_change":"2024-04-26T07:52:34.917692+0000","last_active":"2024-04-26T07:52:34.917590+0000","last_peered":"2024-04-26T07:52:34.917590+0000","last_clean":"2024-04-26T07:52:34.917590+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:52:34.917590+0000","last_undegraded":"2024-04-26T07:52:34.917590+0000","last_fullsized":"2024-04-26T07:52:34.917590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:34.917289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:34.917289+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.917289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:12:21.993998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.539589+0000","last_change":"2024-04-26T07:52:08.539589+0000","last_active":"2024-04-26T07:52:08.539589+0000","last_peered":"2024-04-26T07:52:08.539589+0000","last_clean":"2024-04-26T07:52:08.539589+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:52:08.539589+0000","last_undegraded":"2024-04-26T07:52:08.539589+0000","last_fullsized":"2024-04-26T07:52:08.539589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:08.539328+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:08.539328+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.539328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:09.275493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"109'48","reported_seq":249,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.025384+0000","last_change":"2024-04-26T07:52:26.025384+0000","last_active":"2024-04-26T07:52:26.025384+0000","last_peered":"2024-04-26T07:52:26.025384+0000","last_clean":"2024-04-26T07:52:26.025384+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:52:26.025384+0000","last_undegraded":"2024-04-26T07:52:26.025384+0000","last_fullsized":"2024-04-26T07:52:26.025384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:26.025085+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:26.025085+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.025085+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:38.538383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.553963+0000","last_change":"2024-04-26T07:52:14.553963+0000","last_active":"2024-04-26T07:52:14.553963+0000","last_peered":"2024-04-26T07:52:14.553963+0000","last_clean":"2024-04-26T07:52:14.553963+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:52:14.553963+0000","last_undegraded":"2024-04-26T07:52:14.553963+0000","last_fullsized":"2024-04-26T07:52:14.553963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:14.553682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:14.553682+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.553682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:55.970503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.626371+0000","last_change":"2024-04-26T07:52:13.626371+0000","last_active":"2024-04-26T07:52:13.626371+0000","last_peered":"2024-04-26T07:52:13.626371+0000","last_clean":"2024-04-26T07:52:13.626371+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:52:13.626371+0000","last_undegraded":"2024-04-26T07:52:13.626371+0000","last_fullsized":"2024-04-26T07:52:13.626371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.626121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.626121+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.626121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:23.768965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"109'48","reported_seq":259,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.592928+0000","last_change":"2024-04-26T07:52:17.592928+0000","last_active":"2024-04-26T07:52:17.592928+0000","last_peered":"2024-04-26T07:52:17.592928+0000","last_clean":"2024-04-26T07:52:17.592928+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:52:17.592928+0000","last_undegraded":"2024-04-26T07:52:17.592928+0000","last_fullsized":"2024-04-26T07:52:17.592928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:17.592612+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:17.592612+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.592612+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:23.468407+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":45,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.342336+0000","last_change":"2024-04-26T07:52:32.342336+0000","last_active":"2024-04-26T07:52:32.342336+0000","last_peered":"2024-04-26T07:52:32.342336+0000","last_clean":"2024-04-26T07:52:32.342336+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:52:32.342336+0000","last_undegraded":"2024-04-26T07:52:32.342336+0000","last_fullsized":"2024-04-26T07:52:32.342336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:32.342088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:32.342088+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.342088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:28.924584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.663689+0000","last_change":"2024-04-26T07:52:36.663833+0000","last_active":"2024-04-26T07:52:36.663689+0000","last_peered":"2024-04-26T07:52:36.663689+0000","last_clean":"2024-04-26T07:52:36.663689+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:52:36.663689+0000","last_undegraded":"2024-04-26T07:52:36.663689+0000","last_fullsized":"2024-04-26T07:52:36.663689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2024-04-26T07:52:36.663424+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2024-04-26T07:52:36.663424+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.663424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:57.617993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.551935+0000","last_change":"2024-04-26T07:52:18.551935+0000","last_active":"2024-04-26T07:52:18.551935+0000","last_peered":"2024-04-26T07:52:18.551935+0000","last_clean":"2024-04-26T07:52:18.551935+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:52:18.551935+0000","last_undegraded":"2024-04-26T07:52:18.551935+0000","last_fullsized":"2024-04-26T07:52:18.551935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:18.551602+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:18.551602+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.551602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:19.194908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'44","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.508286+0000","last_change":"2024-04-26T07:52:18.508286+0000","last_active":"2024-04-26T07:52:18.508286+0000","last_peered":"2024-04-26T07:52:18.508286+0000","last_clean":"2024-04-26T07:52:18.508286+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:52:18.508286+0000","last_undegraded":"2024-04-26T07:52:18.508286+0000","last_fullsized":"2024-04-26T07:52:18.508286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:18.508026+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:18.508026+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.508026+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:11.571289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.246156+0000","last_change":"2024-04-26T07:52:17.246156+0000","last_active":"2024-04-26T07:52:17.246156+0000","last_peered":"2024-04-26T07:52:17.246156+0000","last_clean":"2024-04-26T07:52:17.246156+0000","last_became_active":"2024-04-26T07:51:40.433293+0000","last_became_peered":"2024-04-26T07:51:40.433293+0000","last_unstale":"2024-04-26T07:52:17.246156+0000","last_undegraded":"2024-04-26T07:52:17.246156+0000","last_fullsized":"2024-04-26T07:52:17.246156+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.245909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.245909+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.245909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:34.468197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.874398+0000","last_change":"2024-04-26T07:52:03.874398+0000","last_active":"2024-04-26T07:52:03.874398+0000","last_peered":"2024-04-26T07:52:03.874398+0000","last_clean":"2024-04-26T07:52:03.874398+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:52:03.874398+0000","last_undegraded":"2024-04-26T07:52:03.874398+0000","last_fullsized":"2024-04-26T07:52:03.874398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.874164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.874164+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.874164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:34.208516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"109'22","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.478807+0000","last_change":"2024-04-26T07:52:21.478807+0000","last_active":"2024-04-26T07:52:21.478807+0000","last_peered":"2024-04-26T07:52:21.478807+0000","last_clean":"2024-04-26T07:52:21.478807+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:52:21.478807+0000","last_undegraded":"2024-04-26T07:52:21.478807+0000","last_fullsized":"2024-04-26T07:52:21.478807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'22","last_scrub_stamp":"2024-04-26T07:52:21.478520+0000","last_deep_scrub":"109'22","last_deep_scrub_stamp":"2024-04-26T07:52:21.478520+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.478520+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:51.800489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"109'138","reported_seq":393,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.182627+0000","last_change":"2024-04-26T07:52:05.182627+0000","last_active":"2024-04-26T07:52:05.182627+0000","last_peered":"2024-04-26T07:52:05.182627+0000","last_clean":"2024-04-26T07:52:05.182627+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:52:05.182627+0000","last_undegraded":"2024-04-26T07:52:05.182627+0000","last_fullsized":"2024-04-26T07:52:05.182627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:05.182189+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:05.182189+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.182189+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:45.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.394412+0000","last_change":"2024-04-26T07:48:31.758568+0000","last_active":"2024-04-26T07:51:40.394412+0000","last_peered":"2024-04-26T07:51:40.394412+0000","last_clean":"2024-04-26T07:51:40.394412+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:51:40.394412+0000","last_undegraded":"2024-04-26T07:51:40.394412+0000","last_fullsized":"2024-04-26T07:51:40.394412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.826299+0000","last_change":"2024-04-26T07:52:17.826299+0000","last_active":"2024-04-26T07:52:17.826299+0000","last_peered":"2024-04-26T07:52:17.826299+0000","last_clean":"2024-04-26T07:52:17.826299+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:52:17.826299+0000","last_undegraded":"2024-04-26T07:52:17.826299+0000","last_fullsized":"2024-04-26T07:52:17.826299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:17.825908+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:17.825908+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.825908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:20.716480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'38","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.834921+0000","last_change":"2024-04-26T07:52:34.834986+0000","last_active":"2024-04-26T07:52:34.834921+0000","last_peered":"2024-04-26T07:52:34.834921+0000","last_clean":"2024-04-26T07:52:34.834921+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:52:34.834921+0000","last_undegraded":"2024-04-26T07:52:34.834921+0000","last_fullsized":"2024-04-26T07:52:34.834921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:34.834721+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:34.834721+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.834721+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:18:19.623462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.541968+0000","last_change":"2024-04-26T07:52:13.541968+0000","last_active":"2024-04-26T07:52:13.541968+0000","last_peered":"2024-04-26T07:52:13.541968+0000","last_clean":"2024-04-26T07:52:13.541968+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:52:13.541968+0000","last_undegraded":"2024-04-26T07:52:13.541968+0000","last_fullsized":"2024-04-26T07:52:13.541968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.541642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.541642+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.541642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:17.963815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.342571+0000","last_change":"2024-04-26T07:52:20.342571+0000","last_active":"2024-04-26T07:52:20.342571+0000","last_peered":"2024-04-26T07:52:20.342571+0000","last_clean":"2024-04-26T07:52:20.342571+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:52:20.342571+0000","last_undegraded":"2024-04-26T07:52:20.342571+0000","last_fullsized":"2024-04-26T07:52:20.342571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:20.342310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:20.342310+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.342310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:42.299274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.460523+0000","last_change":"2024-04-26T07:52:05.460523+0000","last_active":"2024-04-26T07:52:05.460523+0000","last_peered":"2024-04-26T07:52:05.460523+0000","last_clean":"2024-04-26T07:52:05.460523+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:52:05.460523+0000","last_undegraded":"2024-04-26T07:52:05.460523+0000","last_fullsized":"2024-04-26T07:52:05.460523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:05.460261+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:05.460261+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.460261+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:16.586612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"109'138","reported_seq":365,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.843830+0000","last_change":"2024-04-26T07:52:09.843830+0000","last_active":"2024-04-26T07:52:09.843830+0000","last_peered":"2024-04-26T07:52:09.843830+0000","last_clean":"2024-04-26T07:52:09.843830+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:52:09.843830+0000","last_undegraded":"2024-04-26T07:52:09.843830+0000","last_fullsized":"2024-04-26T07:52:09.843830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:09.843553+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:09.843553+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.843553+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:33.665682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"109'4","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.662403+0000","last_change":"2024-04-26T07:52:34.662477+0000","last_active":"2024-04-26T07:52:34.662403+0000","last_peered":"2024-04-26T07:52:34.662403+0000","last_clean":"2024-04-26T07:52:34.662403+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:52:34.662403+0000","last_undegraded":"2024-04-26T07:52:34.662403+0000","last_fullsized":"2024-04-26T07:52:34.662403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'4","last_scrub_stamp":"2024-04-26T07:52:34.662209+0000","last_deep_scrub":"109'4","last_deep_scrub_stamp":"2024-04-26T07:52:34.662209+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.662209+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.132903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.399953+0000","last_change":"2024-04-26T07:52:27.399953+0000","last_active":"2024-04-26T07:52:27.399953+0000","last_peered":"2024-04-26T07:52:27.399953+0000","last_clean":"2024-04-26T07:52:27.399953+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:52:27.399953+0000","last_undegraded":"2024-04-26T07:52:27.399953+0000","last_fullsized":"2024-04-26T07:52:27.399953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'14","last_scrub_stamp":"2024-04-26T07:52:27.399672+0000","last_deep_scrub":"59'14","last_deep_scrub_stamp":"2024-04-26T07:52:27.399672+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.399672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:22.697483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.546431+0000","last_change":"2024-04-26T07:52:26.546500+0000","last_active":"2024-04-26T07:52:26.546431+0000","last_peered":"2024-04-26T07:52:26.546431+0000","last_clean":"2024-04-26T07:52:26.546431+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:52:26.546431+0000","last_undegraded":"2024-04-26T07:52:26.546431+0000","last_fullsized":"2024-04-26T07:52:26.546431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:26.546234+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:26.546234+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.546234+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:41.241271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.830671+0000","last_change":"2024-04-26T07:52:11.830671+0000","last_active":"2024-04-26T07:52:11.830671+0000","last_peered":"2024-04-26T07:52:11.830671+0000","last_clean":"2024-04-26T07:52:11.830671+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:52:11.830671+0000","last_undegraded":"2024-04-26T07:52:11.830671+0000","last_fullsized":"2024-04-26T07:52:11.830671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.830410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.830410+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.830410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:08.945514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"109'2","reported_seq":288,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.791701+0000","last_change":"2024-04-26T07:52:21.791701+0000","last_active":"2024-04-26T07:52:21.791701+0000","last_peered":"2024-04-26T07:52:21.791701+0000","last_clean":"2024-04-26T07:52:21.791701+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:52:21.791701+0000","last_undegraded":"2024-04-26T07:52:21.791701+0000","last_fullsized":"2024-04-26T07:52:21.791701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:21.791394+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:21.791394+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.791394+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:17.546280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"109'59","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.190962+0000","last_change":"2024-04-26T07:52:22.190962+0000","last_active":"2024-04-26T07:52:22.190962+0000","last_peered":"2024-04-26T07:52:22.190962+0000","last_clean":"2024-04-26T07:52:22.190962+0000","last_became_active":"2024-04-26T07:51:40.418680+0000","last_became_peered":"2024-04-26T07:51:40.418680+0000","last_unstale":"2024-04-26T07:52:22.190962+0000","last_undegraded":"2024-04-26T07:52:22.190962+0000","last_fullsized":"2024-04-26T07:52:22.190962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'59","last_scrub_stamp":"2024-04-26T07:52:22.190664+0000","last_deep_scrub":"109'59","last_deep_scrub_stamp":"2024-04-26T07:52:22.190664+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.190664+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:36.885701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":166,"num_write":32,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.864385+0000","last_change":"2024-04-26T07:52:02.864385+0000","last_active":"2024-04-26T07:52:02.864385+0000","last_peered":"2024-04-26T07:52:02.864385+0000","last_clean":"2024-04-26T07:52:02.864385+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:52:02.864385+0000","last_undegraded":"2024-04-26T07:52:02.864385+0000","last_fullsized":"2024-04-26T07:52:02.864385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:02.864165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:02.864165+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.864165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:34.200900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:37.941926+0000","last_change":"2024-04-26T07:52:37.941989+0000","last_active":"2024-04-26T07:52:37.941926+0000","last_peered":"2024-04-26T07:52:37.941926+0000","last_clean":"2024-04-26T07:52:37.941926+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:52:37.941926+0000","last_undegraded":"2024-04-26T07:52:37.941926+0000","last_fullsized":"2024-04-26T07:52:37.941926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:37.941715+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:37.941715+0000","last_clean_scrub_stamp":"2024-04-26T07:52:37.941715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:39.558086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.694488+0000","last_change":"2024-04-26T07:52:35.694541+0000","last_active":"2024-04-26T07:52:35.694488+0000","last_peered":"2024-04-26T07:52:35.694488+0000","last_clean":"2024-04-26T07:52:35.694488+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:52:35.694488+0000","last_undegraded":"2024-04-26T07:52:35.694488+0000","last_fullsized":"2024-04-26T07:52:35.694488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:35.694290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:35.694290+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.694290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:51.155366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.410949+0000","last_change":"2024-04-26T07:52:09.411013+0000","last_active":"2024-04-26T07:52:09.410949+0000","last_peered":"2024-04-26T07:52:09.410949+0000","last_clean":"2024-04-26T07:52:09.410949+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:52:09.410949+0000","last_undegraded":"2024-04-26T07:52:09.410949+0000","last_fullsized":"2024-04-26T07:52:09.410949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'6","last_scrub_stamp":"2024-04-26T07:52:09.410717+0000","last_deep_scrub":"55'6","last_deep_scrub_stamp":"2024-04-26T07:52:09.410717+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.410717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:06.622624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"109'62","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.351595+0000","last_change":"2024-04-26T07:52:26.351658+0000","last_active":"2024-04-26T07:52:26.351595+0000","last_peered":"2024-04-26T07:52:26.351595+0000","last_clean":"2024-04-26T07:52:26.351595+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:52:26.351595+0000","last_undegraded":"2024-04-26T07:52:26.351595+0000","last_fullsized":"2024-04-26T07:52:26.351595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'62","last_scrub_stamp":"2024-04-26T07:52:26.351387+0000","last_deep_scrub":"109'62","last_deep_scrub_stamp":"2024-04-26T07:52:26.351387+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.351387+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.327230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.609035+0000","last_change":"2024-04-26T07:52:01.609059+0000","last_active":"2024-04-26T07:52:01.609035+0000","last_peered":"2024-04-26T07:52:01.609035+0000","last_clean":"2024-04-26T07:52:01.609035+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:52:01.609035+0000","last_undegraded":"2024-04-26T07:52:01.609035+0000","last_fullsized":"2024-04-26T07:52:01.609035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.608926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.608926+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.608926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:17.404013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"109'26","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.842931+0000","last_change":"2024-04-26T07:52:08.843013+0000","last_active":"2024-04-26T07:52:08.842931+0000","last_peered":"2024-04-26T07:52:08.842931+0000","last_clean":"2024-04-26T07:52:08.842931+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:52:08.842931+0000","last_undegraded":"2024-04-26T07:52:08.842931+0000","last_fullsized":"2024-04-26T07:52:08.842931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'26","last_scrub_stamp":"2024-04-26T07:52:08.842689+0000","last_deep_scrub":"109'26","last_deep_scrub_stamp":"2024-04-26T07:52:08.842689+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.842689+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:34.215975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.801116+0000","last_change":"2024-04-26T07:52:05.801172+0000","last_active":"2024-04-26T07:52:05.801116+0000","last_peered":"2024-04-26T07:52:05.801116+0000","last_clean":"2024-04-26T07:52:05.801116+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:52:05.801116+0000","last_undegraded":"2024-04-26T07:52:05.801116+0000","last_fullsized":"2024-04-26T07:52:05.801116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.800909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.800909+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.800909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.438432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:37.768001+0000","last_change":"2024-04-26T07:52:37.768069+0000","last_active":"2024-04-26T07:52:37.768001+0000","last_peered":"2024-04-26T07:52:37.768001+0000","last_clean":"2024-04-26T07:52:37.768001+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:52:37.768001+0000","last_undegraded":"2024-04-26T07:52:37.768001+0000","last_fullsized":"2024-04-26T07:52:37.768001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-04-26T07:52:37.767794+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-04-26T07:52:37.767794+0000","last_clean_scrub_stamp":"2024-04-26T07:52:37.767794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:56.941196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.542531+0000","last_change":"2024-04-26T07:52:04.542583+0000","last_active":"2024-04-26T07:52:04.542531+0000","last_peered":"2024-04-26T07:52:04.542531+0000","last_clean":"2024-04-26T07:52:04.542531+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:52:04.542531+0000","last_undegraded":"2024-04-26T07:52:04.542531+0000","last_fullsized":"2024-04-26T07:52:04.542531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.542332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.542332+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.542332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:50.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"109'36","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.249182+0000","last_change":"2024-04-26T07:52:32.249246+0000","last_active":"2024-04-26T07:52:32.249182+0000","last_peered":"2024-04-26T07:52:32.249182+0000","last_clean":"2024-04-26T07:52:32.249182+0000","last_became_active":"2024-04-26T07:51:40.444446+0000","last_became_peered":"2024-04-26T07:51:40.444446+0000","last_unstale":"2024-04-26T07:52:32.249182+0000","last_undegraded":"2024-04-26T07:52:32.249182+0000","last_fullsized":"2024-04-26T07:52:32.249182+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:32.248958+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:32.248958+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.248958+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:53.203526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"109'2","reported_seq":287,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.787650+0000","last_change":"2024-04-26T07:52:19.787760+0000","last_active":"2024-04-26T07:52:19.787650+0000","last_peered":"2024-04-26T07:52:19.787650+0000","last_clean":"2024-04-26T07:52:19.787650+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:52:19.787650+0000","last_undegraded":"2024-04-26T07:52:19.787650+0000","last_fullsized":"2024-04-26T07:52:19.787650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:19.787423+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:19.787423+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.787423+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:18.505718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"109'13","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.604202+0000","last_change":"2024-04-26T07:52:15.604331+0000","last_active":"2024-04-26T07:52:15.604202+0000","last_peered":"2024-04-26T07:52:15.604202+0000","last_clean":"2024-04-26T07:52:15.604202+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:52:15.604202+0000","last_undegraded":"2024-04-26T07:52:15.604202+0000","last_fullsized":"2024-04-26T07:52:15.604202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'13","last_scrub_stamp":"2024-04-26T07:52:15.603892+0000","last_deep_scrub":"109'13","last_deep_scrub_stamp":"2024-04-26T07:52:15.603892+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.603892+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:39.721417+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.261783+0000","last_change":"2024-04-26T07:52:16.261836+0000","last_active":"2024-04-26T07:52:16.261783+0000","last_peered":"2024-04-26T07:52:16.261783+0000","last_clean":"2024-04-26T07:52:16.261783+0000","last_became_active":"2024-04-26T07:51:40.431762+0000","last_became_peered":"2024-04-26T07:51:40.431762+0000","last_unstale":"2024-04-26T07:52:16.261783+0000","last_undegraded":"2024-04-26T07:52:16.261783+0000","last_fullsized":"2024-04-26T07:52:16.261783+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:16.261572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:16.261572+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.261572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:21.754727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.578145+0000","last_change":"2024-04-26T07:52:32.578200+0000","last_active":"2024-04-26T07:52:32.578145+0000","last_peered":"2024-04-26T07:52:32.578145+0000","last_clean":"2024-04-26T07:52:32.578145+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:52:32.578145+0000","last_undegraded":"2024-04-26T07:52:32.578145+0000","last_fullsized":"2024-04-26T07:52:32.578145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:32.577954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:32.577954+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.577954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:54.651293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.815325+0000","last_change":"2024-04-26T07:52:11.815393+0000","last_active":"2024-04-26T07:52:11.815325+0000","last_peered":"2024-04-26T07:52:11.815325+0000","last_clean":"2024-04-26T07:52:11.815325+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:52:11.815325+0000","last_undegraded":"2024-04-26T07:52:11.815325+0000","last_fullsized":"2024-04-26T07:52:11.815325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:11.815117+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:11.815117+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.815117+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:59.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"109'48","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.110289+0000","last_change":"2024-04-26T07:52:20.110354+0000","last_active":"2024-04-26T07:52:20.110289+0000","last_peered":"2024-04-26T07:52:20.110289+0000","last_clean":"2024-04-26T07:52:20.110289+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:52:20.110289+0000","last_undegraded":"2024-04-26T07:52:20.110289+0000","last_fullsized":"2024-04-26T07:52:20.110289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:20.110061+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:20.110061+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.110061+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:36.586705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.036487+0000","last_change":"2024-04-26T07:52:03.036548+0000","last_active":"2024-04-26T07:52:03.036487+0000","last_peered":"2024-04-26T07:52:03.036487+0000","last_clean":"2024-04-26T07:52:03.036487+0000","last_became_active":"2024-04-26T07:51:40.439845+0000","last_became_peered":"2024-04-26T07:51:40.439845+0000","last_unstale":"2024-04-26T07:52:03.036487+0000","last_undegraded":"2024-04-26T07:52:03.036487+0000","last_fullsized":"2024-04-26T07:52:03.036487+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.036278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.036278+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.036278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:14.765411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"109'27","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.818099+0000","last_change":"2024-04-26T07:52:10.818173+0000","last_active":"2024-04-26T07:52:10.818099+0000","last_peered":"2024-04-26T07:52:10.818099+0000","last_clean":"2024-04-26T07:52:10.818099+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:52:10.818099+0000","last_undegraded":"2024-04-26T07:52:10.818099+0000","last_fullsized":"2024-04-26T07:52:10.818099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'27","last_scrub_stamp":"2024-04-26T07:52:10.817912+0000","last_deep_scrub":"109'27","last_deep_scrub_stamp":"2024-04-26T07:52:10.817912+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.817912+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:51.319828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.855914+0000","last_change":"2024-04-26T07:52:22.855974+0000","last_active":"2024-04-26T07:52:22.855914+0000","last_peered":"2024-04-26T07:52:22.855914+0000","last_clean":"2024-04-26T07:52:22.855914+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:52:22.855914+0000","last_undegraded":"2024-04-26T07:52:22.855914+0000","last_fullsized":"2024-04-26T07:52:22.855914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:22.855672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:22.855672+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.855672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:20.608407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.913302+0000","last_change":"2024-04-26T07:52:35.913442+0000","last_active":"2024-04-26T07:52:35.913302+0000","last_peered":"2024-04-26T07:52:35.913302+0000","last_clean":"2024-04-26T07:52:35.913302+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:52:35.913302+0000","last_undegraded":"2024-04-26T07:52:35.913302+0000","last_fullsized":"2024-04-26T07:52:35.913302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:35.913056+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:35.913056+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.913056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:54.452517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.831172+0000","last_change":"2024-04-26T07:52:14.831324+0000","last_active":"2024-04-26T07:52:14.831172+0000","last_peered":"2024-04-26T07:52:14.831172+0000","last_clean":"2024-04-26T07:52:14.831172+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:52:14.831172+0000","last_undegraded":"2024-04-26T07:52:14.831172+0000","last_fullsized":"2024-04-26T07:52:14.831172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:14.830852+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:14.830852+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.830852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:05.451081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'50","reported_seq":250,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.600145+0000","last_change":"2024-04-26T07:52:29.600210+0000","last_active":"2024-04-26T07:52:29.600145+0000","last_peered":"2024-04-26T07:52:29.600145+0000","last_clean":"2024-04-26T07:52:29.600145+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:52:29.600145+0000","last_undegraded":"2024-04-26T07:52:29.600145+0000","last_fullsized":"2024-04-26T07:52:29.600145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:29.599953+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:29.599953+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.599953+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:48.139414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.775643+0000","last_change":"2024-04-26T07:52:07.775698+0000","last_active":"2024-04-26T07:52:07.775643+0000","last_peered":"2024-04-26T07:52:07.775643+0000","last_clean":"2024-04-26T07:52:07.775643+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:52:07.775643+0000","last_undegraded":"2024-04-26T07:52:07.775643+0000","last_fullsized":"2024-04-26T07:52:07.775643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.775411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.775411+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.775411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:23.570498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"109'24","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.194249+0000","last_change":"2024-04-26T07:52:21.194383+0000","last_active":"2024-04-26T07:52:21.194249+0000","last_peered":"2024-04-26T07:52:21.194249+0000","last_clean":"2024-04-26T07:52:21.194249+0000","last_became_active":"2024-04-26T07:51:40.417916+0000","last_became_peered":"2024-04-26T07:51:40.417916+0000","last_unstale":"2024-04-26T07:52:21.194249+0000","last_undegraded":"2024-04-26T07:52:21.194249+0000","last_fullsized":"2024-04-26T07:52:21.194249+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'24","last_scrub_stamp":"2024-04-26T07:52:21.194026+0000","last_deep_scrub":"109'24","last_deep_scrub_stamp":"2024-04-26T07:52:21.194026+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.194026+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:25.636433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.713395+0000","last_change":"2024-04-26T07:52:01.713436+0000","last_active":"2024-04-26T07:52:01.713395+0000","last_peered":"2024-04-26T07:52:01.713395+0000","last_clean":"2024-04-26T07:52:01.713395+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:52:01.713395+0000","last_undegraded":"2024-04-26T07:52:01.713395+0000","last_fullsized":"2024-04-26T07:52:01.713395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.713273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.713273+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.713273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:06.135446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.827505+0000","last_change":"2024-04-26T07:52:04.827505+0000","last_active":"2024-04-26T07:52:04.827505+0000","last_peered":"2024-04-26T07:52:04.827505+0000","last_clean":"2024-04-26T07:52:04.827505+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:52:04.827505+0000","last_undegraded":"2024-04-26T07:52:04.827505+0000","last_fullsized":"2024-04-26T07:52:04.827505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:04.827246+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:04.827246+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.827246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:51.792004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"109'46","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.750379+0000","last_change":"2024-04-26T07:52:29.750442+0000","last_active":"2024-04-26T07:52:29.750379+0000","last_peered":"2024-04-26T07:52:29.750379+0000","last_clean":"2024-04-26T07:52:29.750379+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:52:29.750379+0000","last_undegraded":"2024-04-26T07:52:29.750379+0000","last_fullsized":"2024-04-26T07:52:29.750379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:29.750175+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:29.750175+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.750175+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:48.289635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.668524+0000","last_change":"2024-04-26T07:52:11.668524+0000","last_active":"2024-04-26T07:52:11.668524+0000","last_peered":"2024-04-26T07:52:11.668524+0000","last_clean":"2024-04-26T07:52:11.668524+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:52:11.668524+0000","last_undegraded":"2024-04-26T07:52:11.668524+0000","last_fullsized":"2024-04-26T07:52:11.668524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.668272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.668272+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.668272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:17.018585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"109'38","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.527131+0000","last_change":"2024-04-26T07:52:11.527291+0000","last_active":"2024-04-26T07:52:11.527131+0000","last_peered":"2024-04-26T07:52:11.527131+0000","last_clean":"2024-04-26T07:52:11.527131+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:52:11.527131+0000","last_undegraded":"2024-04-26T07:52:11.527131+0000","last_fullsized":"2024-04-26T07:52:11.527131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:11.526881+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:11.526881+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.526881+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:40.166851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.006907+0000","last_change":"2024-04-26T07:52:32.006966+0000","last_active":"2024-04-26T07:52:32.006907+0000","last_peered":"2024-04-26T07:52:32.006907+0000","last_clean":"2024-04-26T07:52:32.006907+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:52:32.006907+0000","last_undegraded":"2024-04-26T07:52:32.006907+0000","last_fullsized":"2024-04-26T07:52:32.006907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:32.006711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:32.006711+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.006711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:21.492314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.391816+0000","last_change":"2024-04-26T07:48:31.757653+0000","last_active":"2024-04-26T07:51:40.391816+0000","last_peered":"2024-04-26T07:51:40.391816+0000","last_clean":"2024-04-26T07:51:40.391816+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:51:40.391816+0000","last_undegraded":"2024-04-26T07:51:40.391816+0000","last_fullsized":"2024-04-26T07:51:40.391816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.622332+0000","last_change":"2024-04-26T07:52:07.622332+0000","last_active":"2024-04-26T07:52:07.622332+0000","last_peered":"2024-04-26T07:52:07.622332+0000","last_clean":"2024-04-26T07:52:07.622332+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:52:07.622332+0000","last_undegraded":"2024-04-26T07:52:07.622332+0000","last_fullsized":"2024-04-26T07:52:07.622332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-04-26T07:52:07.621942+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-04-26T07:52:07.621942+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.621942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:57.800288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"109'32","reported_seq":233,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.533271+0000","last_change":"2024-04-26T07:52:17.533339+0000","last_active":"2024-04-26T07:52:17.533271+0000","last_peered":"2024-04-26T07:52:17.533271+0000","last_clean":"2024-04-26T07:52:17.533271+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:52:17.533271+0000","last_undegraded":"2024-04-26T07:52:17.533271+0000","last_fullsized":"2024-04-26T07:52:17.533271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'32","last_scrub_stamp":"2024-04-26T07:52:17.533071+0000","last_deep_scrub":"109'32","last_deep_scrub_stamp":"2024-04-26T07:52:17.533071+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.533071+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:00.497968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.778513+0000","last_change":"2024-04-26T07:52:05.778513+0000","last_active":"2024-04-26T07:52:05.778513+0000","last_peered":"2024-04-26T07:52:05.778513+0000","last_clean":"2024-04-26T07:52:05.778513+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:52:05.778513+0000","last_undegraded":"2024-04-26T07:52:05.778513+0000","last_fullsized":"2024-04-26T07:52:05.778513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.778217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.778217+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.778217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.242490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"109'35","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.190484+0000","last_change":"2024-04-26T07:52:25.190575+0000","last_active":"2024-04-26T07:52:25.190484+0000","last_peered":"2024-04-26T07:52:25.190484+0000","last_clean":"2024-04-26T07:52:25.190484+0000","last_became_active":"2024-04-26T07:51:40.424476+0000","last_became_peered":"2024-04-26T07:51:40.424476+0000","last_unstale":"2024-04-26T07:52:25.190484+0000","last_undegraded":"2024-04-26T07:52:25.190484+0000","last_fullsized":"2024-04-26T07:52:25.190484+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'35","last_scrub_stamp":"2024-04-26T07:52:25.190282+0000","last_deep_scrub":"109'35","last_deep_scrub_stamp":"2024-04-26T07:52:25.190282+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.190282+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:43.729743+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.451897+0000","last_change":"2024-04-26T07:52:23.452045+0000","last_active":"2024-04-26T07:52:23.451897+0000","last_peered":"2024-04-26T07:52:23.451897+0000","last_clean":"2024-04-26T07:52:23.451897+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:52:23.451897+0000","last_undegraded":"2024-04-26T07:52:23.451897+0000","last_fullsized":"2024-04-26T07:52:23.451897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:23.451605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:23.451605+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.451605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:11.226289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.906628+0000","last_change":"2024-04-26T07:52:24.906685+0000","last_active":"2024-04-26T07:52:24.906628+0000","last_peered":"2024-04-26T07:52:24.906628+0000","last_clean":"2024-04-26T07:52:24.906628+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:52:24.906628+0000","last_undegraded":"2024-04-26T07:52:24.906628+0000","last_fullsized":"2024-04-26T07:52:24.906628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:24.906424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:24.906424+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.906424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:17.969687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.783244+0000","last_change":"2024-04-26T07:52:18.783315+0000","last_active":"2024-04-26T07:52:18.783244+0000","last_peered":"2024-04-26T07:52:18.783244+0000","last_clean":"2024-04-26T07:52:18.783244+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:52:18.783244+0000","last_undegraded":"2024-04-26T07:52:18.783244+0000","last_fullsized":"2024-04-26T07:52:18.783244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-26T07:52:18.783017+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-26T07:52:18.783017+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.783017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:19.426323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'62","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.313312+0000","last_change":"2024-04-26T07:52:22.313488+0000","last_active":"2024-04-26T07:52:22.313312+0000","last_peered":"2024-04-26T07:52:22.313312+0000","last_clean":"2024-04-26T07:52:22.313312+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:52:22.313312+0000","last_undegraded":"2024-04-26T07:52:22.313312+0000","last_fullsized":"2024-04-26T07:52:22.313312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'62","last_scrub_stamp":"2024-04-26T07:52:22.313084+0000","last_deep_scrub":"109'62","last_deep_scrub_stamp":"2024-04-26T07:52:22.313084+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.313084+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:38.066481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.367629+0000","last_change":"2024-04-26T07:52:18.367686+0000","last_active":"2024-04-26T07:52:18.367629+0000","last_peered":"2024-04-26T07:52:18.367629+0000","last_clean":"2024-04-26T07:52:18.367629+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:52:18.367629+0000","last_undegraded":"2024-04-26T07:52:18.367629+0000","last_fullsized":"2024-04-26T07:52:18.367629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:18.367438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:18.367438+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.367438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:34.844082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"109'26","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.852009+0000","last_change":"2024-04-26T07:52:03.852009+0000","last_active":"2024-04-26T07:52:03.852009+0000","last_peered":"2024-04-26T07:52:03.852009+0000","last_clean":"2024-04-26T07:52:03.852009+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:52:03.852009+0000","last_undegraded":"2024-04-26T07:52:03.852009+0000","last_fullsized":"2024-04-26T07:52:03.852009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'26","last_scrub_stamp":"2024-04-26T07:52:03.851724+0000","last_deep_scrub":"109'26","last_deep_scrub_stamp":"2024-04-26T07:52:03.851724+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.851724+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:44.785331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.442055+0000","last_change":"2024-04-26T07:52:24.442055+0000","last_active":"2024-04-26T07:52:24.442055+0000","last_peered":"2024-04-26T07:52:24.442055+0000","last_clean":"2024-04-26T07:52:24.442055+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:52:24.442055+0000","last_undegraded":"2024-04-26T07:52:24.442055+0000","last_fullsized":"2024-04-26T07:52:24.442055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:24.441646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:24.441646+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.441646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:34.694275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.929505+0000","last_change":"2024-04-26T07:52:33.929574+0000","last_active":"2024-04-26T07:52:33.929505+0000","last_peered":"2024-04-26T07:52:33.929505+0000","last_clean":"2024-04-26T07:52:33.929505+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:52:33.929505+0000","last_undegraded":"2024-04-26T07:52:33.929505+0000","last_fullsized":"2024-04-26T07:52:33.929505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:33.929225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:33.929225+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.929225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:53.758867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.296636+0000","last_change":"2024-04-26T07:52:10.296697+0000","last_active":"2024-04-26T07:52:10.296636+0000","last_peered":"2024-04-26T07:52:10.296636+0000","last_clean":"2024-04-26T07:52:10.296636+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:52:10.296636+0000","last_undegraded":"2024-04-26T07:52:10.296636+0000","last_fullsized":"2024-04-26T07:52:10.296636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-04-26T07:52:10.296422+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-04-26T07:52:10.296422+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.296422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:34.609000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"109'36","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.558554+0000","last_change":"2024-04-26T07:52:28.558640+0000","last_active":"2024-04-26T07:52:28.558554+0000","last_peered":"2024-04-26T07:52:28.558554+0000","last_clean":"2024-04-26T07:52:28.558554+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:52:28.558554+0000","last_undegraded":"2024-04-26T07:52:28.558554+0000","last_fullsized":"2024-04-26T07:52:28.558554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:28.558333+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:28.558333+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.558333+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.140829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.550280+0000","last_change":"2024-04-26T07:52:05.550332+0000","last_active":"2024-04-26T07:52:05.550280+0000","last_peered":"2024-04-26T07:52:05.550280+0000","last_clean":"2024-04-26T07:52:05.550280+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:52:05.550280+0000","last_undegraded":"2024-04-26T07:52:05.550280+0000","last_fullsized":"2024-04-26T07:52:05.550280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.550072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.550072+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.550072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:02.665176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.465783+0000","last_change":"2024-04-26T07:52:04.465783+0000","last_active":"2024-04-26T07:52:04.465783+0000","last_peered":"2024-04-26T07:52:04.465783+0000","last_clean":"2024-04-26T07:52:04.465783+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:52:04.465783+0000","last_undegraded":"2024-04-26T07:52:04.465783+0000","last_fullsized":"2024-04-26T07:52:04.465783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:04.465500+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:04.465500+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.465500+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:13.082281+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"109'138","reported_seq":442,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.803732+0000","last_change":"2024-04-26T07:52:09.803732+0000","last_active":"2024-04-26T07:52:09.803732+0000","last_peered":"2024-04-26T07:52:09.803732+0000","last_clean":"2024-04-26T07:52:09.803732+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:52:09.803732+0000","last_undegraded":"2024-04-26T07:52:09.803732+0000","last_fullsized":"2024-04-26T07:52:09.803732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:09.803458+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:09.803458+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.803458+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:53.903529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":145,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.122433+0000","last_change":"2024-04-26T07:52:09.122499+0000","last_active":"2024-04-26T07:52:09.122433+0000","last_peered":"2024-04-26T07:52:09.122433+0000","last_clean":"2024-04-26T07:52:09.122433+0000","last_became_active":"2024-04-26T07:51:40.436379+0000","last_became_peered":"2024-04-26T07:51:40.436379+0000","last_unstale":"2024-04-26T07:52:09.122433+0000","last_undegraded":"2024-04-26T07:52:09.122433+0000","last_fullsized":"2024-04-26T07:52:09.122433+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'5","last_scrub_stamp":"2024-04-26T07:52:09.122230+0000","last_deep_scrub":"55'5","last_deep_scrub_stamp":"2024-04-26T07:52:09.122230+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.122230+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:25.598874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.348878+0000","last_change":"2024-04-26T07:52:19.348938+0000","last_active":"2024-04-26T07:52:19.348878+0000","last_peered":"2024-04-26T07:52:19.348878+0000","last_clean":"2024-04-26T07:52:19.348878+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:52:19.348878+0000","last_undegraded":"2024-04-26T07:52:19.348878+0000","last_fullsized":"2024-04-26T07:52:19.348878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-26T07:52:19.348680+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-26T07:52:19.348680+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.348680+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:09.968909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"109'28","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.181602+0000","last_change":"2024-04-26T07:52:19.181776+0000","last_active":"2024-04-26T07:52:19.181602+0000","last_peered":"2024-04-26T07:52:19.181602+0000","last_clean":"2024-04-26T07:52:19.181602+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:52:19.181602+0000","last_undegraded":"2024-04-26T07:52:19.181602+0000","last_fullsized":"2024-04-26T07:52:19.181602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'28","last_scrub_stamp":"2024-04-26T07:52:19.181355+0000","last_deep_scrub":"109'28","last_deep_scrub_stamp":"2024-04-26T07:52:19.181355+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.181355+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:52:26.454123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.209287+0000","last_change":"2024-04-26T07:52:27.209367+0000","last_active":"2024-04-26T07:52:27.209287+0000","last_peered":"2024-04-26T07:52:27.209287+0000","last_clean":"2024-04-26T07:52:27.209287+0000","last_became_active":"2024-04-26T07:51:40.427906+0000","last_became_peered":"2024-04-26T07:51:40.427906+0000","last_unstale":"2024-04-26T07:52:27.209287+0000","last_undegraded":"2024-04-26T07:52:27.209287+0000","last_fullsized":"2024-04-26T07:52:27.209287+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:27.209071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:27.209071+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.209071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:28.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"109'32","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.175930+0000","last_change":"2024-04-26T07:52:03.176073+0000","last_active":"2024-04-26T07:52:03.175930+0000","last_peered":"2024-04-26T07:52:03.175930+0000","last_clean":"2024-04-26T07:52:03.175930+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:52:03.175930+0000","last_undegraded":"2024-04-26T07:52:03.175930+0000","last_fullsized":"2024-04-26T07:52:03.175930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'32","last_scrub_stamp":"2024-04-26T07:52:03.175641+0000","last_deep_scrub":"109'32","last_deep_scrub_stamp":"2024-04-26T07:52:03.175641+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.175641+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:24.733999+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.663317+0000","last_change":"2024-04-26T07:52:06.663476+0000","last_active":"2024-04-26T07:52:06.663317+0000","last_peered":"2024-04-26T07:52:06.663317+0000","last_clean":"2024-04-26T07:52:06.663317+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:52:06.663317+0000","last_undegraded":"2024-04-26T07:52:06.663317+0000","last_fullsized":"2024-04-26T07:52:06.663317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:06.663096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:06.663096+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.663096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.726359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.169457+0000","last_change":"2024-04-26T07:52:10.169518+0000","last_active":"2024-04-26T07:52:10.169457+0000","last_peered":"2024-04-26T07:52:10.169457+0000","last_clean":"2024-04-26T07:52:10.169457+0000","last_became_active":"2024-04-26T07:51:40.432230+0000","last_became_peered":"2024-04-26T07:51:40.432230+0000","last_unstale":"2024-04-26T07:52:10.169457+0000","last_undegraded":"2024-04-26T07:52:10.169457+0000","last_fullsized":"2024-04-26T07:52:10.169457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-04-26T07:52:10.169197+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.169197+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.169197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:29.864550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.431292+0000","last_change":"2024-04-26T07:52:14.431351+0000","last_active":"2024-04-26T07:52:14.431292+0000","last_peered":"2024-04-26T07:52:14.431292+0000","last_clean":"2024-04-26T07:52:14.431292+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:52:14.431292+0000","last_undegraded":"2024-04-26T07:52:14.431292+0000","last_fullsized":"2024-04-26T07:52:14.431292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:14.431047+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:14.431047+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.431047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:38.253176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"109'56","reported_seq":256,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.128328+0000","last_change":"2024-04-26T07:52:18.128389+0000","last_active":"2024-04-26T07:52:18.128328+0000","last_peered":"2024-04-26T07:52:18.128328+0000","last_clean":"2024-04-26T07:52:18.128328+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:52:18.128328+0000","last_undegraded":"2024-04-26T07:52:18.128328+0000","last_fullsized":"2024-04-26T07:52:18.128328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'56","last_scrub_stamp":"2024-04-26T07:52:18.128132+0000","last_deep_scrub":"109'56","last_deep_scrub_stamp":"2024-04-26T07:52:18.128132+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.128132+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:51.014245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.149428+0000","last_change":"2024-04-26T07:52:17.149485+0000","last_active":"2024-04-26T07:52:17.149428+0000","last_peered":"2024-04-26T07:52:17.149428+0000","last_clean":"2024-04-26T07:52:17.149428+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:52:17.149428+0000","last_undegraded":"2024-04-26T07:52:17.149428+0000","last_fullsized":"2024-04-26T07:52:17.149428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.149207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.149207+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.149207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:57.651124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"109'24","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.549539+0000","last_change":"2024-04-26T07:52:19.549613+0000","last_active":"2024-04-26T07:52:19.549539+0000","last_peered":"2024-04-26T07:52:19.549539+0000","last_clean":"2024-04-26T07:52:19.549539+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:52:19.549539+0000","last_undegraded":"2024-04-26T07:52:19.549539+0000","last_fullsized":"2024-04-26T07:52:19.549539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'24","last_scrub_stamp":"2024-04-26T07:52:19.549336+0000","last_deep_scrub":"109'24","last_deep_scrub_stamp":"2024-04-26T07:52:19.549336+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.549336+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:18.267631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.839783+0000","last_change":"2024-04-26T07:52:21.839893+0000","last_active":"2024-04-26T07:52:21.839783+0000","last_peered":"2024-04-26T07:52:21.839783+0000","last_clean":"2024-04-26T07:52:21.839783+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:52:21.839783+0000","last_undegraded":"2024-04-26T07:52:21.839783+0000","last_fullsized":"2024-04-26T07:52:21.839783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:21.839488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:21.839488+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.839488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:02.773095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:40.393806+0000","last_change":"2024-04-26T07:48:31.759540+0000","last_active":"2024-04-26T07:51:40.393806+0000","last_peered":"2024-04-26T07:51:40.393806+0000","last_clean":"2024-04-26T07:51:40.393806+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:51:40.393806+0000","last_undegraded":"2024-04-26T07:51:40.393806+0000","last_fullsized":"2024-04-26T07:51:40.393806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:48:30.551424+0000","last_clean_scrub_stamp":"2024-04-26T07:48:30.551424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.776875+0000","last_change":"2024-04-26T07:52:22.776940+0000","last_active":"2024-04-26T07:52:22.776875+0000","last_peered":"2024-04-26T07:52:22.776875+0000","last_clean":"2024-04-26T07:52:22.776875+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:52:22.776875+0000","last_undegraded":"2024-04-26T07:52:22.776875+0000","last_fullsized":"2024-04-26T07:52:22.776875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:22.776639+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:22.776639+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.776639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:58.942466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"109'52","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.219981+0000","last_change":"2024-04-26T07:52:18.220125+0000","last_active":"2024-04-26T07:52:18.219981+0000","last_peered":"2024-04-26T07:52:18.219981+0000","last_clean":"2024-04-26T07:52:18.219981+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:52:18.219981+0000","last_undegraded":"2024-04-26T07:52:18.219981+0000","last_fullsized":"2024-04-26T07:52:18.219981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:18.219694+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:18.219694+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.219694+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:18.955859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.348016+0000","last_change":"2024-04-26T07:52:30.348070+0000","last_active":"2024-04-26T07:52:30.348016+0000","last_peered":"2024-04-26T07:52:30.348016+0000","last_clean":"2024-04-26T07:52:30.348016+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:52:30.348016+0000","last_undegraded":"2024-04-26T07:52:30.348016+0000","last_fullsized":"2024-04-26T07:52:30.348016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:30.347828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:30.347828+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.347828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:45.042865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"109'17","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.877700+0000","last_change":"2024-04-26T07:52:07.877769+0000","last_active":"2024-04-26T07:52:07.877700+0000","last_peered":"2024-04-26T07:52:07.877700+0000","last_clean":"2024-04-26T07:52:07.877700+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:52:07.877700+0000","last_undegraded":"2024-04-26T07:52:07.877700+0000","last_fullsized":"2024-04-26T07:52:07.877700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'17","last_scrub_stamp":"2024-04-26T07:52:07.877498+0000","last_deep_scrub":"109'17","last_deep_scrub_stamp":"2024-04-26T07:52:07.877498+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.877498+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:19.606631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.299330+0000","last_change":"2024-04-26T07:52:31.299388+0000","last_active":"2024-04-26T07:52:31.299330+0000","last_peered":"2024-04-26T07:52:31.299330+0000","last_clean":"2024-04-26T07:52:31.299330+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:52:31.299330+0000","last_undegraded":"2024-04-26T07:52:31.299330+0000","last_fullsized":"2024-04-26T07:52:31.299330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:31.299105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:31.299105+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.299105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:51.128748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":137,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.212030+0000","last_change":"2024-04-26T07:52:31.212086+0000","last_active":"2024-04-26T07:52:31.212030+0000","last_peered":"2024-04-26T07:52:31.212030+0000","last_clean":"2024-04-26T07:52:31.212030+0000","last_became_active":"2024-04-26T07:51:40.440377+0000","last_became_peered":"2024-04-26T07:51:40.440377+0000","last_unstale":"2024-04-26T07:52:31.212030+0000","last_undegraded":"2024-04-26T07:52:31.212030+0000","last_fullsized":"2024-04-26T07:52:31.212030+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:31.211832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:31.211832+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.211832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:46.672908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.345522+0000","last_change":"2024-04-26T07:52:29.345580+0000","last_active":"2024-04-26T07:52:29.345522+0000","last_peered":"2024-04-26T07:52:29.345522+0000","last_clean":"2024-04-26T07:52:29.345522+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:52:29.345522+0000","last_undegraded":"2024-04-26T07:52:29.345522+0000","last_fullsized":"2024-04-26T07:52:29.345522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'16","last_scrub_stamp":"2024-04-26T07:52:29.345291+0000","last_deep_scrub":"80'16","last_deep_scrub_stamp":"2024-04-26T07:52:29.345291+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.345291+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:18.830895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"109'50","reported_seq":256,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:38.631321+0000","last_change":"2024-04-26T07:52:38.631509+0000","last_active":"2024-04-26T07:52:38.631321+0000","last_peered":"2024-04-26T07:52:38.631321+0000","last_clean":"2024-04-26T07:52:38.631321+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:52:38.631321+0000","last_undegraded":"2024-04-26T07:52:38.631321+0000","last_fullsized":"2024-04-26T07:52:38.631321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:38.631086+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:38.631086+0000","last_clean_scrub_stamp":"2024-04-26T07:52:38.631086+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:20.695785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"109'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.588924+0000","last_change":"2024-04-26T07:52:03.588987+0000","last_active":"2024-04-26T07:52:03.588924+0000","last_peered":"2024-04-26T07:52:03.588924+0000","last_clean":"2024-04-26T07:52:03.588924+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:52:03.588924+0000","last_undegraded":"2024-04-26T07:52:03.588924+0000","last_fullsized":"2024-04-26T07:52:03.588924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:03.588732+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:03.588732+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.588732+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:47.688802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"109'23","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.495785+0000","last_change":"2024-04-26T07:52:02.495868+0000","last_active":"2024-04-26T07:52:02.495785+0000","last_peered":"2024-04-26T07:52:02.495785+0000","last_clean":"2024-04-26T07:52:02.495785+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:52:02.495785+0000","last_undegraded":"2024-04-26T07:52:02.495785+0000","last_fullsized":"2024-04-26T07:52:02.495785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'23","last_scrub_stamp":"2024-04-26T07:52:02.495366+0000","last_deep_scrub":"109'23","last_deep_scrub_stamp":"2024-04-26T07:52:02.495366+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.495366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:24.053723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:59.667741+0000","last_change":"2024-04-26T07:51:59.667797+0000","last_active":"2024-04-26T07:51:59.667741+0000","last_peered":"2024-04-26T07:51:59.667741+0000","last_clean":"2024-04-26T07:51:59.667741+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:59.667741+0000","last_undegraded":"2024-04-26T07:51:59.667741+0000","last_fullsized":"2024-04-26T07:51:59.667741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:51:59.667623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:51:59.667623+0000","last_clean_scrub_stamp":"2024-04-26T07:51:59.667623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:10.793974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.357238+0000","last_change":"2024-04-26T07:52:35.357300+0000","last_active":"2024-04-26T07:52:35.357238+0000","last_peered":"2024-04-26T07:52:35.357238+0000","last_clean":"2024-04-26T07:52:35.357238+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:52:35.357238+0000","last_undegraded":"2024-04-26T07:52:35.357238+0000","last_fullsized":"2024-04-26T07:52:35.357238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:35.357031+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:35.357031+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.357031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:36.973402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":238,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.582987+0000","last_change":"2024-04-26T07:52:02.583013+0000","last_active":"2024-04-26T07:52:02.582987+0000","last_peered":"2024-04-26T07:52:02.582987+0000","last_clean":"2024-04-26T07:52:02.582987+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:52:02.582987+0000","last_undegraded":"2024-04-26T07:52:02.582987+0000","last_fullsized":"2024-04-26T07:52:02.582987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'10","last_scrub_stamp":"2024-04-26T07:52:02.582912+0000","last_deep_scrub":"90'10","last_deep_scrub_stamp":"2024-04-26T07:52:02.582912+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.582912+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:19.402059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"109'42","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.910349+0000","last_change":"2024-04-26T07:52:13.910349+0000","last_active":"2024-04-26T07:52:13.910349+0000","last_peered":"2024-04-26T07:52:13.910349+0000","last_clean":"2024-04-26T07:52:13.910349+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:52:13.910349+0000","last_undegraded":"2024-04-26T07:52:13.910349+0000","last_fullsized":"2024-04-26T07:52:13.910349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:13.910108+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:13.910108+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.910108+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:18.858812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.548514+0000","last_change":"2024-04-26T07:52:10.548575+0000","last_active":"2024-04-26T07:52:10.548514+0000","last_peered":"2024-04-26T07:52:10.548514+0000","last_clean":"2024-04-26T07:52:10.548514+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:52:10.548514+0000","last_undegraded":"2024-04-26T07:52:10.548514+0000","last_fullsized":"2024-04-26T07:52:10.548514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:10.548310+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.548310+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.548310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:19.165091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"109'52","reported_seq":255,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.288845+0000","last_change":"2024-04-26T07:52:07.288845+0000","last_active":"2024-04-26T07:52:07.288845+0000","last_peered":"2024-04-26T07:52:07.288845+0000","last_clean":"2024-04-26T07:52:07.288845+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:52:07.288845+0000","last_undegraded":"2024-04-26T07:52:07.288845+0000","last_fullsized":"2024-04-26T07:52:07.288845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:07.288594+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:07.288594+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.288594+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:27.311783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.191215+0000","last_change":"2024-04-26T07:52:09.191274+0000","last_active":"2024-04-26T07:52:09.191215+0000","last_peered":"2024-04-26T07:52:09.191215+0000","last_clean":"2024-04-26T07:52:09.191215+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:52:09.191215+0000","last_undegraded":"2024-04-26T07:52:09.191215+0000","last_fullsized":"2024-04-26T07:52:09.191215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:09.190998+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:09.190998+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.190998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:40.527734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"109'36","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.041761+0000","last_change":"2024-04-26T07:52:30.041761+0000","last_active":"2024-04-26T07:52:30.041761+0000","last_peered":"2024-04-26T07:52:30.041761+0000","last_clean":"2024-04-26T07:52:30.041761+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:52:30.041761+0000","last_undegraded":"2024-04-26T07:52:30.041761+0000","last_fullsized":"2024-04-26T07:52:30.041761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:30.041510+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:30.041510+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.041510+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:49.618526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.652915+0000","last_change":"2024-04-26T07:52:00.652938+0000","last_active":"2024-04-26T07:52:00.652915+0000","last_peered":"2024-04-26T07:52:00.652915+0000","last_clean":"2024-04-26T07:52:00.652915+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:52:00.652915+0000","last_undegraded":"2024-04-26T07:52:00.652915+0000","last_fullsized":"2024-04-26T07:52:00.652915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T07:52:00.652831+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T07:52:00.652831+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.652831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:24.965409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"109'46","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.542192+0000","last_change":"2024-04-26T07:52:25.542192+0000","last_active":"2024-04-26T07:52:25.542192+0000","last_peered":"2024-04-26T07:52:25.542192+0000","last_clean":"2024-04-26T07:52:25.542192+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:52:25.542192+0000","last_undegraded":"2024-04-26T07:52:25.542192+0000","last_fullsized":"2024-04-26T07:52:25.542192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:25.541907+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:25.541907+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.541907+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:15.027511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.794652+0000","last_change":"2024-04-26T07:52:13.794652+0000","last_active":"2024-04-26T07:52:13.794652+0000","last_peered":"2024-04-26T07:52:13.794652+0000","last_clean":"2024-04-26T07:52:13.794652+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:52:13.794652+0000","last_undegraded":"2024-04-26T07:52:13.794652+0000","last_fullsized":"2024-04-26T07:52:13.794652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.794365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.794365+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.794365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:23.937209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"109'64","reported_seq":266,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.752532+0000","last_change":"2024-04-26T07:52:27.752602+0000","last_active":"2024-04-26T07:52:27.752532+0000","last_peered":"2024-04-26T07:52:27.752532+0000","last_clean":"2024-04-26T07:52:27.752532+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:52:27.752532+0000","last_undegraded":"2024-04-26T07:52:27.752532+0000","last_fullsized":"2024-04-26T07:52:27.752532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'64","last_scrub_stamp":"2024-04-26T07:52:27.752316+0000","last_deep_scrub":"109'64","last_deep_scrub_stamp":"2024-04-26T07:52:27.752316+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.752316+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:47.581959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.469047+0000","last_change":"2024-04-26T07:52:13.469047+0000","last_active":"2024-04-26T07:52:13.469047+0000","last_peered":"2024-04-26T07:52:13.469047+0000","last_clean":"2024-04-26T07:52:13.469047+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:52:13.469047+0000","last_undegraded":"2024-04-26T07:52:13.469047+0000","last_fullsized":"2024-04-26T07:52:13.469047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:13.468781+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:13.468781+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.468781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:38.842066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"109'70","reported_seq":271,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.468055+0000","last_change":"2024-04-26T07:52:19.468114+0000","last_active":"2024-04-26T07:52:19.468055+0000","last_peered":"2024-04-26T07:52:19.468055+0000","last_clean":"2024-04-26T07:52:19.468055+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:52:19.468055+0000","last_undegraded":"2024-04-26T07:52:19.468055+0000","last_fullsized":"2024-04-26T07:52:19.468055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'70","last_scrub_stamp":"2024-04-26T07:52:19.467859+0000","last_deep_scrub":"109'70","last_deep_scrub_stamp":"2024-04-26T07:52:19.467859+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.467859+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:09.646205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.807221+0000","last_change":"2024-04-26T07:52:16.807221+0000","last_active":"2024-04-26T07:52:16.807221+0000","last_peered":"2024-04-26T07:52:16.807221+0000","last_clean":"2024-04-26T07:52:16.807221+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:52:16.807221+0000","last_undegraded":"2024-04-26T07:52:16.807221+0000","last_fullsized":"2024-04-26T07:52:16.807221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-04-26T07:52:16.806813+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-04-26T07:52:16.806813+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.806813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:25.470700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"109'46","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.940293+0000","last_change":"2024-04-26T07:52:17.940350+0000","last_active":"2024-04-26T07:52:17.940293+0000","last_peered":"2024-04-26T07:52:17.940293+0000","last_clean":"2024-04-26T07:52:17.940293+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:52:17.940293+0000","last_undegraded":"2024-04-26T07:52:17.940293+0000","last_fullsized":"2024-04-26T07:52:17.940293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:17.940091+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:17.940091+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.940091+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:46.580061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.822917+0000","last_change":"2024-04-26T07:52:10.822917+0000","last_active":"2024-04-26T07:52:10.822917+0000","last_peered":"2024-04-26T07:52:10.822917+0000","last_clean":"2024-04-26T07:52:10.822917+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:52:10.822917+0000","last_undegraded":"2024-04-26T07:52:10.822917+0000","last_fullsized":"2024-04-26T07:52:10.822917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:10.822644+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.822644+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.822644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:57.248404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"109'58","reported_seq":260,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.812170+0000","last_change":"2024-04-26T07:52:33.812235+0000","last_active":"2024-04-26T07:52:33.812170+0000","last_peered":"2024-04-26T07:52:33.812170+0000","last_clean":"2024-04-26T07:52:33.812170+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:52:33.812170+0000","last_undegraded":"2024-04-26T07:52:33.812170+0000","last_fullsized":"2024-04-26T07:52:33.812170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:33.811940+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:33.811940+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.811940+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:01.378414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.654716+0000","last_change":"2024-04-26T07:52:08.654810+0000","last_active":"2024-04-26T07:52:08.654716+0000","last_peered":"2024-04-26T07:52:08.654716+0000","last_clean":"2024-04-26T07:52:08.654716+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:52:08.654716+0000","last_undegraded":"2024-04-26T07:52:08.654716+0000","last_fullsized":"2024-04-26T07:52:08.654716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:08.654501+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:08.654501+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.654501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:34:27.598040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"109'48","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.030032+0000","last_change":"2024-04-26T07:52:25.030096+0000","last_active":"2024-04-26T07:52:25.030032+0000","last_peered":"2024-04-26T07:52:25.030032+0000","last_clean":"2024-04-26T07:52:25.030032+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:52:25.030032+0000","last_undegraded":"2024-04-26T07:52:25.030032+0000","last_fullsized":"2024-04-26T07:52:25.030032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:25.029844+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:25.029844+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.029844+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:40.783241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.365149+0000","last_change":"2024-04-26T07:52:17.365274+0000","last_active":"2024-04-26T07:52:17.365149+0000","last_peered":"2024-04-26T07:52:17.365149+0000","last_clean":"2024-04-26T07:52:17.365149+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:52:17.365149+0000","last_undegraded":"2024-04-26T07:52:17.365149+0000","last_fullsized":"2024-04-26T07:52:17.365149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:17.364889+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:17.364889+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.364889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.867784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"109'42","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.716407+0000","last_change":"2024-04-26T07:52:26.716597+0000","last_active":"2024-04-26T07:52:26.716407+0000","last_peered":"2024-04-26T07:52:26.716407+0000","last_clean":"2024-04-26T07:52:26.716407+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:52:26.716407+0000","last_undegraded":"2024-04-26T07:52:26.716407+0000","last_fullsized":"2024-04-26T07:52:26.716407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:26.716177+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:26.716177+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.716177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:41.411214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":220,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.281613+0000","last_change":"2024-04-26T07:52:12.281677+0000","last_active":"2024-04-26T07:52:12.281613+0000","last_peered":"2024-04-26T07:52:12.281613+0000","last_clean":"2024-04-26T07:52:12.281613+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:52:12.281613+0000","last_undegraded":"2024-04-26T07:52:12.281613+0000","last_fullsized":"2024-04-26T07:52:12.281613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-26T07:52:12.281168+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-26T07:52:12.281168+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.281168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:29.100315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"109'28","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.176086+0000","last_change":"2024-04-26T07:52:14.176145+0000","last_active":"2024-04-26T07:52:14.176086+0000","last_peered":"2024-04-26T07:52:14.176086+0000","last_clean":"2024-04-26T07:52:14.176086+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:52:14.176086+0000","last_undegraded":"2024-04-26T07:52:14.176086+0000","last_fullsized":"2024-04-26T07:52:14.176086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'28","last_scrub_stamp":"2024-04-26T07:52:14.175886+0000","last_deep_scrub":"109'28","last_deep_scrub_stamp":"2024-04-26T07:52:14.175886+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.175886+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:25.905019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.482704+0000","last_change":"2024-04-26T07:52:07.482768+0000","last_active":"2024-04-26T07:52:07.482704+0000","last_peered":"2024-04-26T07:52:07.482704+0000","last_clean":"2024-04-26T07:52:07.482704+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:52:07.482704+0000","last_undegraded":"2024-04-26T07:52:07.482704+0000","last_fullsized":"2024-04-26T07:52:07.482704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:07.482485+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:07.482485+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.482485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:38.819221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"109'52","reported_seq":253,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.636187+0000","last_change":"2024-04-26T07:52:30.636253+0000","last_active":"2024-04-26T07:52:30.636187+0000","last_peered":"2024-04-26T07:52:30.636187+0000","last_clean":"2024-04-26T07:52:30.636187+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:52:30.636187+0000","last_undegraded":"2024-04-26T07:52:30.636187+0000","last_fullsized":"2024-04-26T07:52:30.636187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:30.635982+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:30.635982+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.635982+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:46.032427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.222395+0000","last_change":"2024-04-26T07:52:26.222530+0000","last_active":"2024-04-26T07:52:26.222395+0000","last_peered":"2024-04-26T07:52:26.222395+0000","last_clean":"2024-04-26T07:52:26.222395+0000","last_became_active":"2024-04-26T07:51:40.427193+0000","last_became_peered":"2024-04-26T07:51:40.427193+0000","last_unstale":"2024-04-26T07:52:26.222395+0000","last_undegraded":"2024-04-26T07:52:26.222395+0000","last_fullsized":"2024-04-26T07:52:26.222395+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:26.222165+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:26.222165+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.222165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:41.618610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.905270+0000","last_change":"2024-04-26T07:52:18.905403+0000","last_active":"2024-04-26T07:52:18.905270+0000","last_peered":"2024-04-26T07:52:18.905270+0000","last_clean":"2024-04-26T07:52:18.905270+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:52:18.905270+0000","last_undegraded":"2024-04-26T07:52:18.905270+0000","last_fullsized":"2024-04-26T07:52:18.905270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:18.904991+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:18.904991+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.904991+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:53.048575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.552115+0000","last_change":"2024-04-26T07:52:16.552177+0000","last_active":"2024-04-26T07:52:16.552115+0000","last_peered":"2024-04-26T07:52:16.552115+0000","last_clean":"2024-04-26T07:52:16.552115+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:52:16.552115+0000","last_undegraded":"2024-04-26T07:52:16.552115+0000","last_fullsized":"2024-04-26T07:52:16.552115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:16.551883+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:16.551883+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.551883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:25.215770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'54","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.240996+0000","last_change":"2024-04-26T07:52:36.241060+0000","last_active":"2024-04-26T07:52:36.240996+0000","last_peered":"2024-04-26T07:52:36.240996+0000","last_clean":"2024-04-26T07:52:36.240996+0000","last_became_active":"2024-04-26T07:51:40.445977+0000","last_became_peered":"2024-04-26T07:51:40.445977+0000","last_unstale":"2024-04-26T07:52:36.240996+0000","last_undegraded":"2024-04-26T07:52:36.240996+0000","last_fullsized":"2024-04-26T07:52:36.240996+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'54","last_scrub_stamp":"2024-04-26T07:52:36.240769+0000","last_deep_scrub":"109'54","last_deep_scrub_stamp":"2024-04-26T07:52:36.240769+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.240769+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:33.000505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.801426+0000","last_change":"2024-04-26T07:52:12.801497+0000","last_active":"2024-04-26T07:52:12.801426+0000","last_peered":"2024-04-26T07:52:12.801426+0000","last_clean":"2024-04-26T07:52:12.801426+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:52:12.801426+0000","last_undegraded":"2024-04-26T07:52:12.801426+0000","last_fullsized":"2024-04-26T07:52:12.801426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T07:52:12.801171+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.801171+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.801171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:54.304065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"109'64","reported_seq":266,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.315131+0000","last_change":"2024-04-26T07:52:06.315193+0000","last_active":"2024-04-26T07:52:06.315131+0000","last_peered":"2024-04-26T07:52:06.315131+0000","last_clean":"2024-04-26T07:52:06.315131+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:52:06.315131+0000","last_undegraded":"2024-04-26T07:52:06.315131+0000","last_fullsized":"2024-04-26T07:52:06.315131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'64","last_scrub_stamp":"2024-04-26T07:52:06.314920+0000","last_deep_scrub":"109'64","last_deep_scrub_stamp":"2024-04-26T07:52:06.314920+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.314920+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:21.520117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.066500+0000","last_change":"2024-04-26T07:52:05.066559+0000","last_active":"2024-04-26T07:52:05.066500+0000","last_peered":"2024-04-26T07:52:05.066500+0000","last_clean":"2024-04-26T07:52:05.066500+0000","last_became_active":"2024-04-26T07:51:40.433471+0000","last_became_peered":"2024-04-26T07:51:40.433471+0000","last_unstale":"2024-04-26T07:52:05.066500+0000","last_undegraded":"2024-04-26T07:52:05.066500+0000","last_fullsized":"2024-04-26T07:52:05.066500+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-04-26T07:52:05.066305+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-04-26T07:52:05.066305+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.066305+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.388274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.044070+0000","last_change":"2024-04-26T07:52:22.044138+0000","last_active":"2024-04-26T07:52:22.044070+0000","last_peered":"2024-04-26T07:52:22.044070+0000","last_clean":"2024-04-26T07:52:22.044070+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:52:22.044070+0000","last_undegraded":"2024-04-26T07:52:22.044070+0000","last_fullsized":"2024-04-26T07:52:22.044070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:22.043835+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:22.043835+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.043835+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:49.290922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"109'42","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.008131+0000","last_change":"2024-04-26T07:52:29.008191+0000","last_active":"2024-04-26T07:52:29.008131+0000","last_peered":"2024-04-26T07:52:29.008131+0000","last_clean":"2024-04-26T07:52:29.008131+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:52:29.008131+0000","last_undegraded":"2024-04-26T07:52:29.008131+0000","last_fullsized":"2024-04-26T07:52:29.008131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:29.007933+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:29.007933+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.007933+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:53.983775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.684401+0000","last_change":"2024-04-26T07:52:10.684452+0000","last_active":"2024-04-26T07:52:10.684401+0000","last_peered":"2024-04-26T07:52:10.684401+0000","last_clean":"2024-04-26T07:52:10.684401+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:52:10.684401+0000","last_undegraded":"2024-04-26T07:52:10.684401+0000","last_fullsized":"2024-04-26T07:52:10.684401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:10.684218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:10.684218+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.684218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:35.242533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"109'58","reported_seq":259,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.523509+0000","last_change":"2024-04-26T07:52:15.523580+0000","last_active":"2024-04-26T07:52:15.523509+0000","last_peered":"2024-04-26T07:52:15.523509+0000","last_clean":"2024-04-26T07:52:15.523509+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:52:15.523509+0000","last_undegraded":"2024-04-26T07:52:15.523509+0000","last_fullsized":"2024-04-26T07:52:15.523509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:15.523309+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:15.523309+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.523309+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:56.456917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.227504+0000","last_change":"2024-04-26T07:52:07.227564+0000","last_active":"2024-04-26T07:52:07.227504+0000","last_peered":"2024-04-26T07:52:07.227504+0000","last_clean":"2024-04-26T07:52:07.227504+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:52:07.227504+0000","last_undegraded":"2024-04-26T07:52:07.227504+0000","last_fullsized":"2024-04-26T07:52:07.227504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-26T07:52:07.227294+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-26T07:52:07.227294+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.227294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:16.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1107,"ondisk_log_size":1107,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1065,"num_read_kb":1546,"num_write":541,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1014,"ondisk_log_size":1014,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1446,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":1945600,"data_stored":1357749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36632,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335208,"statfs":{"total":96636764160,"available":96599252992,"internally_reserved":0,"allocated":1327104,"data_stored":766721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":1372160,"data_stored":767549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335220,"statfs":{"total":96636764160,"available":96599265280,"internally_reserved":0,"allocated":1314816,"data_stored":766219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40824,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331016,"statfs":{"total":96636764160,"available":96594960384,"internally_reserved":0,"allocated":1359872,"data_stored":768949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335220,"statfs":{"total":96636764160,"available":96599265280,"internally_reserved":0,"allocated":1314816,"data_stored":766283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40816,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331024,"statfs":{"total":96636764160,"available":96594968576,"internally_reserved":0,"allocated":1351680,"data_stored":767799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41384,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330456,"statfs":{"total":96636764160,"available":96594386944,"internally_reserved":0,"allocated":1933312,"data_stored":1358159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:52:44.049 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T07:48:22.491812+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=22, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:44.049 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:44.050 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:44.051 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T07:48:30.551424+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=48, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=7, tm_min=51, tm_sec=58, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T07:52:44.051 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T07:53:04.052 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T07:53:04.419 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-26T07:53:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-26T07:53:04.434 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-04-26T07:53:03.891126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620002,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":5012,"num_read_kb":3913,"num_write":4425,"num_write_kb":6187918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5697,"ondisk_log_size":5697,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":306808,"kb_used_data":11640,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667912,"statfs":{"total":773094113280,"available":772779941888,"internally_reserved":0,"allocated":11919360,"data_stored":7319428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006453"},"pg_stats":[{"pgid":"3.3f","version":"109'54","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.209508+0000","last_change":"2024-04-26T07:52:23.209508+0000","last_active":"2024-04-26T07:52:23.209508+0000","last_peered":"2024-04-26T07:52:23.209508+0000","last_clean":"2024-04-26T07:52:23.209508+0000","last_became_active":"2024-04-26T07:51:40.418691+0000","last_became_peered":"2024-04-26T07:51:40.418691+0000","last_unstale":"2024-04-26T07:52:23.209508+0000","last_undegraded":"2024-04-26T07:52:23.209508+0000","last_fullsized":"2024-04-26T07:52:23.209508+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'54","last_scrub_stamp":"2024-04-26T07:52:23.209215+0000","last_deep_scrub":"109'54","last_deep_scrub_stamp":"2024-04-26T07:52:23.209215+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.209215+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:43.038857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"72'10","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.213429+0000","last_change":"2024-04-26T07:52:08.213487+0000","last_active":"2024-04-26T07:52:08.213429+0000","last_peered":"2024-04-26T07:52:08.213429+0000","last_clean":"2024-04-26T07:52:08.213429+0000","last_became_active":"2024-04-26T07:48:23.531921+0000","last_became_peered":"2024-04-26T07:48:23.531921+0000","last_unstale":"2024-04-26T07:52:08.213429+0000","last_undegraded":"2024-04-26T07:52:08.213429+0000","last_fullsized":"2024-04-26T07:52:08.213429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'10","last_scrub_stamp":"2024-04-26T07:52:08.213207+0000","last_deep_scrub":"72'10","last_deep_scrub_stamp":"2024-04-26T07:52:08.213207+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.213207+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:25.317450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"109'52","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.522139+0000","last_change":"2024-04-26T07:52:16.522139+0000","last_active":"2024-04-26T07:52:16.522139+0000","last_peered":"2024-04-26T07:52:16.522139+0000","last_clean":"2024-04-26T07:52:16.522139+0000","last_became_active":"2024-04-26T07:48:21.491188+0000","last_became_peered":"2024-04-26T07:48:21.491188+0000","last_unstale":"2024-04-26T07:52:16.522139+0000","last_undegraded":"2024-04-26T07:52:16.522139+0000","last_fullsized":"2024-04-26T07:52:16.522139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:16.521885+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:16.521885+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.521885+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:14.274620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":153,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.163478+0000","last_change":"2024-04-26T07:52:13.163536+0000","last_active":"2024-04-26T07:52:13.163478+0000","last_peered":"2024-04-26T07:52:13.163478+0000","last_clean":"2024-04-26T07:52:13.163478+0000","last_became_active":"2024-04-26T07:51:40.437448+0000","last_became_peered":"2024-04-26T07:51:40.437448+0000","last_unstale":"2024-04-26T07:52:13.163478+0000","last_undegraded":"2024-04-26T07:52:13.163478+0000","last_fullsized":"2024-04-26T07:52:13.163478+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.163252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.163252+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.163252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:16.053824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.570106+0000","last_change":"2024-04-26T07:52:24.570106+0000","last_active":"2024-04-26T07:52:24.570106+0000","last_peered":"2024-04-26T07:52:24.570106+0000","last_clean":"2024-04-26T07:52:24.570106+0000","last_became_active":"2024-04-26T07:48:21.497305+0000","last_became_peered":"2024-04-26T07:48:21.497305+0000","last_unstale":"2024-04-26T07:52:24.570106+0000","last_undegraded":"2024-04-26T07:52:24.570106+0000","last_fullsized":"2024-04-26T07:52:24.570106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:24.569841+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:24.569841+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.569841+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:52.753746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"90'12","reported_seq":235,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.454006+0000","last_change":"2024-04-26T07:52:06.454066+0000","last_active":"2024-04-26T07:52:06.454006+0000","last_peered":"2024-04-26T07:52:06.454006+0000","last_clean":"2024-04-26T07:52:06.454006+0000","last_became_active":"2024-04-26T07:48:23.539807+0000","last_became_peered":"2024-04-26T07:48:23.539807+0000","last_unstale":"2024-04-26T07:52:06.454006+0000","last_undegraded":"2024-04-26T07:52:06.454006+0000","last_fullsized":"2024-04-26T07:52:06.454006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-04-26T07:52:06.453798+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-04-26T07:52:06.453798+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.453798+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:15.896501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"109'44","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.024457+0000","last_change":"2024-04-26T07:52:27.024516+0000","last_active":"2024-04-26T07:52:27.024457+0000","last_peered":"2024-04-26T07:52:27.024457+0000","last_clean":"2024-04-26T07:52:27.024457+0000","last_became_active":"2024-04-26T07:48:21.504005+0000","last_became_peered":"2024-04-26T07:48:21.504005+0000","last_unstale":"2024-04-26T07:52:27.024457+0000","last_undegraded":"2024-04-26T07:52:27.024457+0000","last_fullsized":"2024-04-26T07:52:27.024457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:27.024268+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:27.024268+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.024268+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:32.517423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"54'4","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:37.646931+0000","last_change":"2024-04-26T07:52:37.647066+0000","last_active":"2024-04-26T07:52:37.646931+0000","last_peered":"2024-04-26T07:52:37.646931+0000","last_clean":"2024-04-26T07:52:37.646931+0000","last_became_active":"2024-04-26T07:49:08.939472+0000","last_became_peered":"2024-04-26T07:49:08.939472+0000","last_unstale":"2024-04-26T07:52:37.646931+0000","last_undegraded":"2024-04-26T07:52:37.646931+0000","last_fullsized":"2024-04-26T07:52:37.646931+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:37.646673+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:37.646673+0000","last_clean_scrub_stamp":"2024-04-26T07:52:37.646673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:56.820075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"109'46","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.064569+0000","last_change":"2024-04-26T07:52:06.064633+0000","last_active":"2024-04-26T07:52:06.064569+0000","last_peered":"2024-04-26T07:52:06.064569+0000","last_clean":"2024-04-26T07:52:06.064569+0000","last_became_active":"2024-04-26T07:51:40.433215+0000","last_became_peered":"2024-04-26T07:51:40.433215+0000","last_unstale":"2024-04-26T07:52:06.064569+0000","last_undegraded":"2024-04-26T07:52:06.064569+0000","last_fullsized":"2024-04-26T07:52:06.064569+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:06.064366+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:06.064366+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.064366+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:30.622681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"54'8","reported_seq":220,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.748822+0000","last_change":"2024-04-26T07:52:06.748822+0000","last_active":"2024-04-26T07:52:06.748822+0000","last_peered":"2024-04-26T07:52:06.748822+0000","last_clean":"2024-04-26T07:52:06.748822+0000","last_became_active":"2024-04-26T07:48:23.542915+0000","last_became_peered":"2024-04-26T07:48:23.542915+0000","last_unstale":"2024-04-26T07:52:06.748822+0000","last_undegraded":"2024-04-26T07:52:06.748822+0000","last_fullsized":"2024-04-26T07:52:06.748822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-26T07:52:06.748541+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-26T07:52:06.748541+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.748541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:31.061119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"109'44","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.164476+0000","last_change":"2024-04-26T07:52:16.164636+0000","last_active":"2024-04-26T07:52:16.164476+0000","last_peered":"2024-04-26T07:52:16.164476+0000","last_clean":"2024-04-26T07:52:16.164476+0000","last_became_active":"2024-04-26T07:48:21.521419+0000","last_became_peered":"2024-04-26T07:48:21.521419+0000","last_unstale":"2024-04-26T07:52:16.164476+0000","last_undegraded":"2024-04-26T07:52:16.164476+0000","last_fullsized":"2024-04-26T07:52:16.164476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:16.164249+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:16.164249+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.164249+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:39.986378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"53'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.500006+0000","last_change":"2024-04-26T07:52:12.500006+0000","last_active":"2024-04-26T07:52:12.500006+0000","last_peered":"2024-04-26T07:52:12.500006+0000","last_clean":"2024-04-26T07:52:12.500006+0000","last_became_active":"2024-04-26T07:48:23.543471+0000","last_became_peered":"2024-04-26T07:48:23.543471+0000","last_unstale":"2024-04-26T07:52:12.500006+0000","last_undegraded":"2024-04-26T07:52:12.500006+0000","last_fullsized":"2024-04-26T07:52:12.500006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-26T07:52:12.499701+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.499701+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.499701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:13.383983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"109'36","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.260172+0000","last_change":"2024-04-26T07:52:28.260232+0000","last_active":"2024-04-26T07:52:28.260172+0000","last_peered":"2024-04-26T07:52:28.260172+0000","last_clean":"2024-04-26T07:52:28.260172+0000","last_became_active":"2024-04-26T07:51:40.428267+0000","last_became_peered":"2024-04-26T07:51:40.428267+0000","last_unstale":"2024-04-26T07:52:28.260172+0000","last_undegraded":"2024-04-26T07:52:28.260172+0000","last_fullsized":"2024-04-26T07:52:28.260172+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:28.259968+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:28.259968+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.259968+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:50.333307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":46,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"90'6","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.240714+0000","last_change":"2024-04-26T07:52:10.240714+0000","last_active":"2024-04-26T07:52:10.240714+0000","last_peered":"2024-04-26T07:52:10.240714+0000","last_clean":"2024-04-26T07:52:10.240714+0000","last_became_active":"2024-04-26T07:48:23.528624+0000","last_became_peered":"2024-04-26T07:48:23.528624+0000","last_unstale":"2024-04-26T07:52:10.240714+0000","last_undegraded":"2024-04-26T07:52:10.240714+0000","last_fullsized":"2024-04-26T07:52:10.240714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:10.240434+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:10.240434+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.240434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:51.174041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"109'46","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.777459+0000","last_change":"2024-04-26T07:52:32.777522+0000","last_active":"2024-04-26T07:52:32.777459+0000","last_peered":"2024-04-26T07:52:32.777459+0000","last_clean":"2024-04-26T07:52:32.777459+0000","last_became_active":"2024-04-26T07:48:21.505609+0000","last_became_peered":"2024-04-26T07:48:21.505609+0000","last_unstale":"2024-04-26T07:52:32.777459+0000","last_undegraded":"2024-04-26T07:52:32.777459+0000","last_fullsized":"2024-04-26T07:52:32.777459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:32.777259+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:32.777259+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.777259+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:46.906907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"72'2","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.261323+0000","last_change":"2024-04-26T07:52:09.261323+0000","last_active":"2024-04-26T07:52:09.261323+0000","last_peered":"2024-04-26T07:52:09.261323+0000","last_clean":"2024-04-26T07:52:09.261323+0000","last_became_active":"2024-04-26T07:48:23.523875+0000","last_became_peered":"2024-04-26T07:48:23.523875+0000","last_unstale":"2024-04-26T07:52:09.261323+0000","last_undegraded":"2024-04-26T07:52:09.261323+0000","last_fullsized":"2024-04-26T07:52:09.261323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-26T07:52:09.261030+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-26T07:52:09.261030+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.261030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.240500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'10","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.451283+0000","last_change":"2024-04-26T07:52:08.451346+0000","last_active":"2024-04-26T07:52:08.451283+0000","last_peered":"2024-04-26T07:52:08.451283+0000","last_clean":"2024-04-26T07:52:08.451283+0000","last_became_active":"2024-04-26T07:48:23.540127+0000","last_became_peered":"2024-04-26T07:48:23.540127+0000","last_unstale":"2024-04-26T07:52:08.451283+0000","last_undegraded":"2024-04-26T07:52:08.451283+0000","last_fullsized":"2024-04-26T07:52:08.451283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2024-04-26T07:52:08.451067+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2024-04-26T07:52:08.451067+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.451067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:01.222132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"109'50","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.221522+0000","last_change":"2024-04-26T07:52:20.221589+0000","last_active":"2024-04-26T07:52:20.221522+0000","last_peered":"2024-04-26T07:52:20.221522+0000","last_clean":"2024-04-26T07:52:20.221522+0000","last_became_active":"2024-04-26T07:51:40.428461+0000","last_became_peered":"2024-04-26T07:51:40.428461+0000","last_unstale":"2024-04-26T07:52:20.221522+0000","last_undegraded":"2024-04-26T07:52:20.221522+0000","last_fullsized":"2024-04-26T07:52:20.221522+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:20.221290+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:20.221290+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.221290+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:36.889013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"90'6","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.122718+0000","last_change":"2024-04-26T07:52:11.122718+0000","last_active":"2024-04-26T07:52:11.122718+0000","last_peered":"2024-04-26T07:52:11.122718+0000","last_clean":"2024-04-26T07:52:11.122718+0000","last_became_active":"2024-04-26T07:51:40.435585+0000","last_became_peered":"2024-04-26T07:51:40.435585+0000","last_unstale":"2024-04-26T07:52:11.122718+0000","last_undegraded":"2024-04-26T07:52:11.122718+0000","last_fullsized":"2024-04-26T07:52:11.122718+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:11.122301+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:11.122301+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.122301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.239827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"109'60","reported_seq":262,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.923151+0000","last_change":"2024-04-26T07:52:14.923212+0000","last_active":"2024-04-26T07:52:14.923151+0000","last_peered":"2024-04-26T07:52:14.923151+0000","last_clean":"2024-04-26T07:52:14.923151+0000","last_became_active":"2024-04-26T07:48:21.505358+0000","last_became_peered":"2024-04-26T07:48:21.505358+0000","last_unstale":"2024-04-26T07:52:14.923151+0000","last_undegraded":"2024-04-26T07:52:14.923151+0000","last_fullsized":"2024-04-26T07:52:14.923151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'60","last_scrub_stamp":"2024-04-26T07:52:14.922953+0000","last_deep_scrub":"109'60","last_deep_scrub_stamp":"2024-04-26T07:52:14.922953+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.922953+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:15.659118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":70,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"80'4","reported_seq":212,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.232920+0000","last_change":"2024-04-26T07:52:12.232987+0000","last_active":"2024-04-26T07:52:12.232920+0000","last_peered":"2024-04-26T07:52:12.232920+0000","last_clean":"2024-04-26T07:52:12.232920+0000","last_became_active":"2024-04-26T07:48:23.523590+0000","last_became_peered":"2024-04-26T07:48:23.523590+0000","last_unstale":"2024-04-26T07:52:12.232920+0000","last_undegraded":"2024-04-26T07:52:12.232920+0000","last_fullsized":"2024-04-26T07:52:12.232920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:12.232704+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:12.232704+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.232704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:18.870226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.865735+0000","last_change":"2024-04-26T07:52:12.865876+0000","last_active":"2024-04-26T07:52:12.865735+0000","last_peered":"2024-04-26T07:52:12.865735+0000","last_clean":"2024-04-26T07:52:12.865735+0000","last_became_active":"2024-04-26T07:48:21.503713+0000","last_became_peered":"2024-04-26T07:48:21.503713+0000","last_unstale":"2024-04-26T07:52:12.865735+0000","last_undegraded":"2024-04-26T07:52:12.865735+0000","last_fullsized":"2024-04-26T07:52:12.865735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:12.865444+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:12.865444+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.865444+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:20.079871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"90'12","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.247276+0000","last_change":"2024-04-26T07:52:08.247416+0000","last_active":"2024-04-26T07:52:08.247276+0000","last_peered":"2024-04-26T07:52:08.247276+0000","last_clean":"2024-04-26T07:52:08.247276+0000","last_became_active":"2024-04-26T07:48:23.523783+0000","last_became_peered":"2024-04-26T07:48:23.523783+0000","last_unstale":"2024-04-26T07:52:08.247276+0000","last_undegraded":"2024-04-26T07:52:08.247276+0000","last_fullsized":"2024-04-26T07:52:08.247276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-04-26T07:52:08.246988+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-04-26T07:52:08.246988+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.246988+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:03:31.264202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"109'48","reported_seq":249,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.328511+0000","last_change":"2024-04-26T07:52:25.328578+0000","last_active":"2024-04-26T07:52:25.328511+0000","last_peered":"2024-04-26T07:52:25.328511+0000","last_clean":"2024-04-26T07:52:25.328511+0000","last_became_active":"2024-04-26T07:48:21.503098+0000","last_became_peered":"2024-04-26T07:48:21.503098+0000","last_unstale":"2024-04-26T07:52:25.328511+0000","last_undegraded":"2024-04-26T07:52:25.328511+0000","last_fullsized":"2024-04-26T07:52:25.328511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:25.328282+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:25.328282+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.328282+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:09:24.930839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.282867+0000","last_change":"2024-04-26T07:52:11.282934+0000","last_active":"2024-04-26T07:52:11.282867+0000","last_peered":"2024-04-26T07:52:11.282867+0000","last_clean":"2024-04-26T07:52:11.282867+0000","last_became_active":"2024-04-26T07:48:23.544146+0000","last_became_peered":"2024-04-26T07:48:23.544146+0000","last_unstale":"2024-04-26T07:52:11.282867+0000","last_undegraded":"2024-04-26T07:52:11.282867+0000","last_fullsized":"2024-04-26T07:52:11.282867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:11.282644+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:11.282644+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.282644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:27.077731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"109'42","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.790621+0000","last_change":"2024-04-26T07:52:31.790682+0000","last_active":"2024-04-26T07:52:31.790621+0000","last_peered":"2024-04-26T07:52:31.790621+0000","last_clean":"2024-04-26T07:52:31.790621+0000","last_became_active":"2024-04-26T07:48:21.503226+0000","last_became_peered":"2024-04-26T07:48:21.503226+0000","last_unstale":"2024-04-26T07:52:31.790621+0000","last_undegraded":"2024-04-26T07:52:31.790621+0000","last_fullsized":"2024-04-26T07:52:31.790621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:31.790421+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:31.790421+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.790421+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:33.406793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.452305+0000","last_change":"2024-04-26T07:52:10.452417+0000","last_active":"2024-04-26T07:52:10.452305+0000","last_peered":"2024-04-26T07:52:10.452305+0000","last_clean":"2024-04-26T07:52:10.452305+0000","last_became_active":"2024-04-26T07:48:23.541115+0000","last_became_peered":"2024-04-26T07:48:23.541115+0000","last_unstale":"2024-04-26T07:52:10.452305+0000","last_undegraded":"2024-04-26T07:52:10.452305+0000","last_fullsized":"2024-04-26T07:52:10.452305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:10.452068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:10.452068+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.452068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:08.204803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"109'46","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.574531+0000","last_change":"2024-04-26T07:52:27.574591+0000","last_active":"2024-04-26T07:52:27.574531+0000","last_peered":"2024-04-26T07:52:27.574531+0000","last_clean":"2024-04-26T07:52:27.574531+0000","last_became_active":"2024-04-26T07:48:21.501957+0000","last_became_peered":"2024-04-26T07:48:21.501957+0000","last_unstale":"2024-04-26T07:52:27.574531+0000","last_undegraded":"2024-04-26T07:52:27.574531+0000","last_fullsized":"2024-04-26T07:52:27.574531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:27.574340+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:27.574340+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.574340+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:47.403983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.396774+0000","last_change":"2024-04-26T07:52:36.396834+0000","last_active":"2024-04-26T07:52:36.396774+0000","last_peered":"2024-04-26T07:52:36.396774+0000","last_clean":"2024-04-26T07:52:36.396774+0000","last_became_active":"2024-04-26T07:48:31.593806+0000","last_became_peered":"2024-04-26T07:48:31.593806+0000","last_unstale":"2024-04-26T07:52:36.396774+0000","last_undegraded":"2024-04-26T07:52:36.396774+0000","last_fullsized":"2024-04-26T07:52:36.396774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:36.396577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:36.396577+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.396577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:50.526225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.792860+0000","last_change":"2024-04-26T07:52:20.792914+0000","last_active":"2024-04-26T07:52:20.792860+0000","last_peered":"2024-04-26T07:52:20.792860+0000","last_clean":"2024-04-26T07:52:20.792860+0000","last_became_active":"2024-04-26T07:48:23.533955+0000","last_became_peered":"2024-04-26T07:48:23.533955+0000","last_unstale":"2024-04-26T07:52:20.792860+0000","last_undegraded":"2024-04-26T07:52:20.792860+0000","last_fullsized":"2024-04-26T07:52:20.792860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:20.792663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:20.792663+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.792663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:09:20.395220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"109'38","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.208432+0000","last_change":"2024-04-26T07:52:20.208570+0000","last_active":"2024-04-26T07:52:20.208432+0000","last_peered":"2024-04-26T07:52:20.208432+0000","last_clean":"2024-04-26T07:52:20.208432+0000","last_became_active":"2024-04-26T07:49:08.973772+0000","last_became_peered":"2024-04-26T07:49:08.973772+0000","last_unstale":"2024-04-26T07:52:20.208432+0000","last_undegraded":"2024-04-26T07:52:20.208432+0000","last_fullsized":"2024-04-26T07:52:20.208432+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:20.208184+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:20.208184+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.208184+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:28.824965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.064095+0000","last_change":"2024-04-26T07:52:21.064149+0000","last_active":"2024-04-26T07:52:21.064095+0000","last_peered":"2024-04-26T07:52:21.064095+0000","last_clean":"2024-04-26T07:52:21.064095+0000","last_became_active":"2024-04-26T07:48:25.559301+0000","last_became_peered":"2024-04-26T07:48:25.559301+0000","last_unstale":"2024-04-26T07:52:21.064095+0000","last_undegraded":"2024-04-26T07:52:21.064095+0000","last_fullsized":"2024-04-26T07:52:21.064095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:21.063889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:21.063889+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.063889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:40.759242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"109'23","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.553495+0000","last_change":"2024-04-26T07:52:21.553579+0000","last_active":"2024-04-26T07:52:21.553495+0000","last_peered":"2024-04-26T07:52:21.553495+0000","last_clean":"2024-04-26T07:52:21.553495+0000","last_became_active":"2024-04-26T07:48:27.581033+0000","last_became_peered":"2024-04-26T07:48:27.581033+0000","last_unstale":"2024-04-26T07:52:21.553495+0000","last_undegraded":"2024-04-26T07:52:21.553495+0000","last_fullsized":"2024-04-26T07:52:21.553495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'23","last_scrub_stamp":"2024-04-26T07:52:21.553289+0000","last_deep_scrub":"109'23","last_deep_scrub_stamp":"2024-04-26T07:52:21.553289+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.553289+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:38.775577+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.200022+0000","last_change":"2024-04-26T07:52:24.200075+0000","last_active":"2024-04-26T07:52:24.200022+0000","last_peered":"2024-04-26T07:52:24.200022+0000","last_clean":"2024-04-26T07:52:24.200022+0000","last_became_active":"2024-04-26T07:51:40.424563+0000","last_became_peered":"2024-04-26T07:51:40.424563+0000","last_unstale":"2024-04-26T07:52:24.200022+0000","last_undegraded":"2024-04-26T07:52:24.200022+0000","last_fullsized":"2024-04-26T07:52:24.200022+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:24.199830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:24.199830+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.199830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:12:11.276539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"109'52","reported_seq":252,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.958842+0000","last_change":"2024-04-26T07:52:36.958915+0000","last_active":"2024-04-26T07:52:36.958842+0000","last_peered":"2024-04-26T07:52:36.958842+0000","last_clean":"2024-04-26T07:52:36.958842+0000","last_became_active":"2024-04-26T07:48:31.600482+0000","last_became_peered":"2024-04-26T07:48:31.600482+0000","last_unstale":"2024-04-26T07:52:36.958842+0000","last_undegraded":"2024-04-26T07:52:36.958842+0000","last_fullsized":"2024-04-26T07:52:36.958842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:36.958644+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:36.958644+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.958644+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:52.355089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":105,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"59'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.201772+0000","last_change":"2024-04-26T07:52:13.201839+0000","last_active":"2024-04-26T07:52:13.201772+0000","last_peered":"2024-04-26T07:52:13.201772+0000","last_clean":"2024-04-26T07:52:13.201772+0000","last_became_active":"2024-04-26T07:48:23.557412+0000","last_became_peered":"2024-04-26T07:48:23.557412+0000","last_unstale":"2024-04-26T07:52:13.201772+0000","last_undegraded":"2024-04-26T07:52:13.201772+0000","last_fullsized":"2024-04-26T07:52:13.201772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-04-26T07:52:13.201566+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-04-26T07:52:13.201566+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.201566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:18.051414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"109'40","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.589082+0000","last_change":"2024-04-26T07:52:22.589145+0000","last_active":"2024-04-26T07:52:22.589082+0000","last_peered":"2024-04-26T07:52:22.589082+0000","last_clean":"2024-04-26T07:52:22.589082+0000","last_became_active":"2024-04-26T07:48:21.523504+0000","last_became_peered":"2024-04-26T07:48:21.523504+0000","last_unstale":"2024-04-26T07:52:22.589082+0000","last_undegraded":"2024-04-26T07:52:22.589082+0000","last_fullsized":"2024-04-26T07:52:22.589082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'40","last_scrub_stamp":"2024-04-26T07:52:22.588888+0000","last_deep_scrub":"109'40","last_deep_scrub_stamp":"2024-04-26T07:52:22.588888+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.588888+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:47.564730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.698716+0000","last_change":"2024-04-26T07:52:25.698776+0000","last_active":"2024-04-26T07:52:25.698716+0000","last_peered":"2024-04-26T07:52:25.698716+0000","last_clean":"2024-04-26T07:52:25.698716+0000","last_became_active":"2024-04-26T07:48:25.575276+0000","last_became_peered":"2024-04-26T07:48:25.575276+0000","last_unstale":"2024-04-26T07:52:25.698716+0000","last_undegraded":"2024-04-26T07:52:25.698716+0000","last_fullsized":"2024-04-26T07:52:25.698716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:25.698497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:25.698497+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.698497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:15.184101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"109'10","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.492370+0000","last_change":"2024-04-26T07:52:03.492498+0000","last_active":"2024-04-26T07:52:03.492370+0000","last_peered":"2024-04-26T07:52:03.492370+0000","last_clean":"2024-04-26T07:52:03.492370+0000","last_became_active":"2024-04-26T07:48:27.563213+0000","last_became_peered":"2024-04-26T07:48:27.563213+0000","last_unstale":"2024-04-26T07:52:03.492370+0000","last_undegraded":"2024-04-26T07:52:03.492370+0000","last_fullsized":"2024-04-26T07:52:03.492370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'10","last_scrub_stamp":"2024-04-26T07:52:03.492141+0000","last_deep_scrub":"109'10","last_deep_scrub_stamp":"2024-04-26T07:52:03.492141+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.492141+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:06.056305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.385794+0000","last_change":"2024-04-26T07:52:33.385843+0000","last_active":"2024-04-26T07:52:33.385794+0000","last_peered":"2024-04-26T07:52:33.385794+0000","last_clean":"2024-04-26T07:52:33.385794+0000","last_became_active":"2024-04-26T07:48:29.593936+0000","last_became_peered":"2024-04-26T07:48:29.593936+0000","last_unstale":"2024-04-26T07:52:33.385794+0000","last_undegraded":"2024-04-26T07:52:33.385794+0000","last_fullsized":"2024-04-26T07:52:33.385794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:33.385603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:33.385603+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.385603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:51.925063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.664126+0000","last_change":"2024-04-26T07:52:05.664179+0000","last_active":"2024-04-26T07:52:05.664126+0000","last_peered":"2024-04-26T07:52:05.664126+0000","last_clean":"2024-04-26T07:52:05.664126+0000","last_became_active":"2024-04-26T07:48:31.593102+0000","last_became_peered":"2024-04-26T07:48:31.593102+0000","last_unstale":"2024-04-26T07:52:05.664126+0000","last_undegraded":"2024-04-26T07:52:05.664126+0000","last_fullsized":"2024-04-26T07:52:05.664126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.663918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.663918+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.663918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:48.628816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"54'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.633760+0000","last_change":"2024-04-26T07:52:12.633822+0000","last_active":"2024-04-26T07:52:12.633760+0000","last_peered":"2024-04-26T07:52:12.633760+0000","last_clean":"2024-04-26T07:52:12.633760+0000","last_became_active":"2024-04-26T07:48:23.551851+0000","last_became_peered":"2024-04-26T07:48:23.551851+0000","last_unstale":"2024-04-26T07:52:12.633760+0000","last_undegraded":"2024-04-26T07:52:12.633760+0000","last_fullsized":"2024-04-26T07:52:12.633760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:12.633562+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.633562+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.633562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:22.886192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"109'44","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.259589+0000","last_change":"2024-04-26T07:52:19.259589+0000","last_active":"2024-04-26T07:52:19.259589+0000","last_peered":"2024-04-26T07:52:19.259589+0000","last_clean":"2024-04-26T07:52:19.259589+0000","last_became_active":"2024-04-26T07:51:40.440255+0000","last_became_peered":"2024-04-26T07:51:40.440255+0000","last_unstale":"2024-04-26T07:52:19.259589+0000","last_undegraded":"2024-04-26T07:52:19.259589+0000","last_fullsized":"2024-04-26T07:52:19.259589+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:19.259340+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:19.259340+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.259340+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:38.836356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.758888+0000","last_change":"2024-04-26T07:52:23.758946+0000","last_active":"2024-04-26T07:52:23.758888+0000","last_peered":"2024-04-26T07:52:23.758888+0000","last_clean":"2024-04-26T07:52:23.758888+0000","last_became_active":"2024-04-26T07:48:25.574292+0000","last_became_peered":"2024-04-26T07:48:25.574292+0000","last_unstale":"2024-04-26T07:52:23.758888+0000","last_undegraded":"2024-04-26T07:52:23.758888+0000","last_fullsized":"2024-04-26T07:52:23.758888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:23.758701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:23.758701+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.758701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:40.426424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.277823+0000","last_change":"2024-04-26T07:52:14.277902+0000","last_active":"2024-04-26T07:52:14.277823+0000","last_peered":"2024-04-26T07:52:14.277823+0000","last_clean":"2024-04-26T07:52:14.277823+0000","last_became_active":"2024-04-26T07:48:27.557395+0000","last_became_peered":"2024-04-26T07:48:27.557395+0000","last_unstale":"2024-04-26T07:52:14.277823+0000","last_undegraded":"2024-04-26T07:52:14.277823+0000","last_fullsized":"2024-04-26T07:52:14.277823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:14.277616+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:14.277616+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.277616+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:00.703376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"109'141","reported_seq":324,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.210904+0000","last_change":"2024-04-26T07:52:30.210979+0000","last_active":"2024-04-26T07:52:30.210904+0000","last_peered":"2024-04-26T07:52:30.210904+0000","last_clean":"2024-04-26T07:52:30.210904+0000","last_became_active":"2024-04-26T07:51:40.439601+0000","last_became_peered":"2024-04-26T07:51:40.439601+0000","last_unstale":"2024-04-26T07:52:30.210904+0000","last_undegraded":"2024-04-26T07:52:30.210904+0000","last_fullsized":"2024-04-26T07:52:30.210904+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'141","last_scrub_stamp":"2024-04-26T07:52:30.210715+0000","last_deep_scrub":"109'141","last_deep_scrub_stamp":"2024-04-26T07:52:30.210715+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.210715+0000","objects_scrubbed":1,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:59.681409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:37.370436+0000","last_change":"2024-04-26T07:52:37.370491+0000","last_active":"2024-04-26T07:52:37.370436+0000","last_peered":"2024-04-26T07:52:37.370436+0000","last_clean":"2024-04-26T07:52:37.370436+0000","last_became_active":"2024-04-26T07:48:31.754854+0000","last_became_peered":"2024-04-26T07:48:31.754854+0000","last_unstale":"2024-04-26T07:52:37.370436+0000","last_undegraded":"2024-04-26T07:52:37.370436+0000","last_fullsized":"2024-04-26T07:52:37.370436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:37.370234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:37.370234+0000","last_clean_scrub_stamp":"2024-04-26T07:52:37.370234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:04.936707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.805342+0000","last_change":"2024-04-26T07:52:15.805420+0000","last_active":"2024-04-26T07:52:15.805342+0000","last_peered":"2024-04-26T07:52:15.805342+0000","last_clean":"2024-04-26T07:52:15.805342+0000","last_became_active":"2024-04-26T07:48:23.551036+0000","last_became_peered":"2024-04-26T07:48:23.551036+0000","last_unstale":"2024-04-26T07:52:15.805342+0000","last_undegraded":"2024-04-26T07:52:15.805342+0000","last_fullsized":"2024-04-26T07:52:15.805342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T07:52:15.805087+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T07:52:15.805087+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.805087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:39.922613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"109'34","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.938439+0000","last_change":"2024-04-26T07:52:15.938439+0000","last_active":"2024-04-26T07:52:15.938439+0000","last_peered":"2024-04-26T07:52:15.938439+0000","last_clean":"2024-04-26T07:52:15.938439+0000","last_became_active":"2024-04-26T07:48:21.506210+0000","last_became_peered":"2024-04-26T07:48:21.506210+0000","last_unstale":"2024-04-26T07:52:15.938439+0000","last_undegraded":"2024-04-26T07:52:15.938439+0000","last_fullsized":"2024-04-26T07:52:15.938439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'34","last_scrub_stamp":"2024-04-26T07:52:15.938189+0000","last_deep_scrub":"109'34","last_deep_scrub_stamp":"2024-04-26T07:52:15.938189+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.938189+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:52:23.210957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.089778+0000","last_change":"2024-04-26T07:52:19.089839+0000","last_active":"2024-04-26T07:52:19.089778+0000","last_peered":"2024-04-26T07:52:19.089778+0000","last_clean":"2024-04-26T07:52:19.089778+0000","last_became_active":"2024-04-26T07:48:25.556078+0000","last_became_peered":"2024-04-26T07:48:25.556078+0000","last_unstale":"2024-04-26T07:52:19.089778+0000","last_undegraded":"2024-04-26T07:52:19.089778+0000","last_fullsized":"2024-04-26T07:52:19.089778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:19.089577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:19.089577+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.089577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:00.592471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"109'24","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.209422+0000","last_change":"2024-04-26T07:52:33.209613+0000","last_active":"2024-04-26T07:52:33.209422+0000","last_peered":"2024-04-26T07:52:33.209422+0000","last_clean":"2024-04-26T07:52:33.209422+0000","last_became_active":"2024-04-26T07:51:40.441381+0000","last_became_peered":"2024-04-26T07:51:40.441381+0000","last_unstale":"2024-04-26T07:52:33.209422+0000","last_undegraded":"2024-04-26T07:52:33.209422+0000","last_fullsized":"2024-04-26T07:52:33.209422+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'24","last_scrub_stamp":"2024-04-26T07:52:33.209187+0000","last_deep_scrub":"109'24","last_deep_scrub_stamp":"2024-04-26T07:52:33.209187+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.209187+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:22.953535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"109'138","reported_seq":364,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.878275+0000","last_change":"2024-04-26T07:52:01.878315+0000","last_active":"2024-04-26T07:52:01.878275+0000","last_peered":"2024-04-26T07:52:01.878275+0000","last_clean":"2024-04-26T07:52:01.878275+0000","last_became_active":"2024-04-26T07:48:29.581266+0000","last_became_peered":"2024-04-26T07:48:29.581266+0000","last_unstale":"2024-04-26T07:52:01.878275+0000","last_undegraded":"2024-04-26T07:52:01.878275+0000","last_fullsized":"2024-04-26T07:52:01.878275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:01.878187+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:01.878187+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.878187+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:18.982430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.207035+0000","last_change":"2024-04-26T07:52:11.207035+0000","last_active":"2024-04-26T07:52:11.207035+0000","last_peered":"2024-04-26T07:52:11.207035+0000","last_clean":"2024-04-26T07:52:11.207035+0000","last_became_active":"2024-04-26T07:48:23.556950+0000","last_became_peered":"2024-04-26T07:48:23.556950+0000","last_unstale":"2024-04-26T07:52:11.207035+0000","last_undegraded":"2024-04-26T07:52:11.207035+0000","last_fullsized":"2024-04-26T07:52:11.207035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.206632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.206632+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.206632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:10.071458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"109'54","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.158189+0000","last_change":"2024-04-26T07:52:12.158189+0000","last_active":"2024-04-26T07:52:12.158189+0000","last_peered":"2024-04-26T07:52:12.158189+0000","last_clean":"2024-04-26T07:52:12.158189+0000","last_became_active":"2024-04-26T07:51:40.432352+0000","last_became_peered":"2024-04-26T07:51:40.432352+0000","last_unstale":"2024-04-26T07:52:12.158189+0000","last_undegraded":"2024-04-26T07:52:12.158189+0000","last_fullsized":"2024-04-26T07:52:12.158189+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'54","last_scrub_stamp":"2024-04-26T07:52:12.157906+0000","last_deep_scrub":"109'54","last_deep_scrub_stamp":"2024-04-26T07:52:12.157906+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.157906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:20.821794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":150,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.081269+0000","last_change":"2024-04-26T07:52:07.081269+0000","last_active":"2024-04-26T07:52:07.081269+0000","last_peered":"2024-04-26T07:52:07.081269+0000","last_clean":"2024-04-26T07:52:07.081269+0000","last_became_active":"2024-04-26T07:51:40.432366+0000","last_became_peered":"2024-04-26T07:51:40.432366+0000","last_unstale":"2024-04-26T07:52:07.081269+0000","last_undegraded":"2024-04-26T07:52:07.081269+0000","last_fullsized":"2024-04-26T07:52:07.081269+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.081009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.081009+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.081009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:54.855694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"109'38","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.201272+0000","last_change":"2024-04-26T07:52:02.201272+0000","last_active":"2024-04-26T07:52:02.201272+0000","last_peered":"2024-04-26T07:52:02.201272+0000","last_clean":"2024-04-26T07:52:02.201272+0000","last_became_active":"2024-04-26T07:48:27.651237+0000","last_became_peered":"2024-04-26T07:48:27.651237+0000","last_unstale":"2024-04-26T07:52:02.201272+0000","last_undegraded":"2024-04-26T07:52:02.201272+0000","last_fullsized":"2024-04-26T07:52:02.201272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:02.200966+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:02.200966+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.200966+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:09.415392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.461085+0000","last_change":"2024-04-26T07:52:22.461085+0000","last_active":"2024-04-26T07:52:22.461085+0000","last_peered":"2024-04-26T07:52:22.461085+0000","last_clean":"2024-04-26T07:52:22.461085+0000","last_became_active":"2024-04-26T07:48:29.575992+0000","last_became_peered":"2024-04-26T07:48:29.575992+0000","last_unstale":"2024-04-26T07:52:22.461085+0000","last_undegraded":"2024-04-26T07:52:22.461085+0000","last_fullsized":"2024-04-26T07:52:22.461085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:22.460796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:22.460796+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.460796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:47.019111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"54'6","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.971088+0000","last_change":"2024-04-26T07:52:32.971088+0000","last_active":"2024-04-26T07:52:32.971088+0000","last_peered":"2024-04-26T07:52:32.971088+0000","last_clean":"2024-04-26T07:52:32.971088+0000","last_became_active":"2024-04-26T07:48:31.600239+0000","last_became_peered":"2024-04-26T07:48:31.600239+0000","last_unstale":"2024-04-26T07:52:32.971088+0000","last_undegraded":"2024-04-26T07:52:32.971088+0000","last_fullsized":"2024-04-26T07:52:32.971088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-26T07:52:32.970790+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-26T07:52:32.970790+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.970790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:47.665827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"55'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.392753+0000","last_change":"2024-04-26T07:52:15.392753+0000","last_active":"2024-04-26T07:52:15.392753+0000","last_peered":"2024-04-26T07:52:15.392753+0000","last_clean":"2024-04-26T07:52:15.392753+0000","last_became_active":"2024-04-26T07:48:23.530644+0000","last_became_peered":"2024-04-26T07:48:23.530644+0000","last_unstale":"2024-04-26T07:52:15.392753+0000","last_undegraded":"2024-04-26T07:52:15.392753+0000","last_fullsized":"2024-04-26T07:52:15.392753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:15.392452+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:15.392452+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.392452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.950767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"109'48","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.196735+0000","last_change":"2024-04-26T07:52:14.196735+0000","last_active":"2024-04-26T07:52:14.196735+0000","last_peered":"2024-04-26T07:52:14.196735+0000","last_clean":"2024-04-26T07:52:14.196735+0000","last_became_active":"2024-04-26T07:51:40.431661+0000","last_became_peered":"2024-04-26T07:51:40.431661+0000","last_unstale":"2024-04-26T07:52:14.196735+0000","last_undegraded":"2024-04-26T07:52:14.196735+0000","last_fullsized":"2024-04-26T07:52:14.196735+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:14.196452+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:14.196452+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.196452+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:29.949849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.302694+0000","last_change":"2024-04-26T07:52:03.302694+0000","last_active":"2024-04-26T07:52:03.302694+0000","last_peered":"2024-04-26T07:52:03.302694+0000","last_clean":"2024-04-26T07:52:03.302694+0000","last_became_active":"2024-04-26T07:48:25.564472+0000","last_became_peered":"2024-04-26T07:48:25.564472+0000","last_unstale":"2024-04-26T07:52:03.302694+0000","last_undegraded":"2024-04-26T07:52:03.302694+0000","last_fullsized":"2024-04-26T07:52:03.302694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.302295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.302295+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.302295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:39.830995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"109'23","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.834194+0000","last_change":"2024-04-26T07:52:06.834194+0000","last_active":"2024-04-26T07:52:06.834194+0000","last_peered":"2024-04-26T07:52:06.834194+0000","last_clean":"2024-04-26T07:52:06.834194+0000","last_became_active":"2024-04-26T07:48:27.581726+0000","last_became_peered":"2024-04-26T07:48:27.581726+0000","last_unstale":"2024-04-26T07:52:06.834194+0000","last_undegraded":"2024-04-26T07:52:06.834194+0000","last_fullsized":"2024-04-26T07:52:06.834194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'23","last_scrub_stamp":"2024-04-26T07:52:06.833802+0000","last_deep_scrub":"109'23","last_deep_scrub_stamp":"2024-04-26T07:52:06.833802+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.833802+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:11.683650+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.897979+0000","last_change":"2024-04-26T07:52:00.897979+0000","last_active":"2024-04-26T07:52:00.897979+0000","last_peered":"2024-04-26T07:52:00.897979+0000","last_clean":"2024-04-26T07:52:00.897979+0000","last_became_active":"2024-04-26T07:48:29.581134+0000","last_became_peered":"2024-04-26T07:48:29.581134+0000","last_unstale":"2024-04-26T07:52:00.897979+0000","last_undegraded":"2024-04-26T07:52:00.897979+0000","last_fullsized":"2024-04-26T07:52:00.897979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:00.897847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:00.897847+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.897847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:10.340550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.882148+0000","last_change":"2024-04-26T07:52:25.882148+0000","last_active":"2024-04-26T07:52:25.882148+0000","last_peered":"2024-04-26T07:52:25.882148+0000","last_clean":"2024-04-26T07:52:25.882148+0000","last_became_active":"2024-04-26T07:48:31.588484+0000","last_became_peered":"2024-04-26T07:48:31.588484+0000","last_unstale":"2024-04-26T07:52:25.882148+0000","last_undegraded":"2024-04-26T07:52:25.882148+0000","last_fullsized":"2024-04-26T07:52:25.882148+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:25.881800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:25.881800+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.881800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:16.060146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.793723+0000","last_change":"2024-04-26T07:52:08.793723+0000","last_active":"2024-04-26T07:52:08.793723+0000","last_peered":"2024-04-26T07:52:08.793723+0000","last_clean":"2024-04-26T07:52:08.793723+0000","last_became_active":"2024-04-26T07:48:23.532747+0000","last_became_peered":"2024-04-26T07:48:23.532747+0000","last_unstale":"2024-04-26T07:52:08.793723+0000","last_undegraded":"2024-04-26T07:52:08.793723+0000","last_fullsized":"2024-04-26T07:52:08.793723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:08.793455+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:08.793455+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.793455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:25.612602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"109'50","reported_seq":218,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.175525+0000","last_change":"2024-04-26T07:52:34.175525+0000","last_active":"2024-04-26T07:52:34.175525+0000","last_peered":"2024-04-26T07:52:34.175525+0000","last_clean":"2024-04-26T07:52:34.175525+0000","last_became_active":"2024-04-26T07:51:40.444713+0000","last_became_peered":"2024-04-26T07:51:40.444713+0000","last_unstale":"2024-04-26T07:52:34.175525+0000","last_undegraded":"2024-04-26T07:52:34.175525+0000","last_fullsized":"2024-04-26T07:52:34.175525+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:34.175267+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:34.175267+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.175267+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:52.103499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.244670+0000","last_change":"2024-04-26T07:52:01.244670+0000","last_active":"2024-04-26T07:52:01.244670+0000","last_peered":"2024-04-26T07:52:01.244670+0000","last_clean":"2024-04-26T07:52:01.244670+0000","last_became_active":"2024-04-26T07:48:25.560462+0000","last_became_peered":"2024-04-26T07:48:25.560462+0000","last_unstale":"2024-04-26T07:52:01.244670+0000","last_undegraded":"2024-04-26T07:52:01.244670+0000","last_fullsized":"2024-04-26T07:52:01.244670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.244437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.244437+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.244437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:35.063751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"109'35","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.046087+0000","last_change":"2024-04-26T07:52:04.046087+0000","last_active":"2024-04-26T07:52:04.046087+0000","last_peered":"2024-04-26T07:52:04.046087+0000","last_clean":"2024-04-26T07:52:04.046087+0000","last_became_active":"2024-04-26T07:51:40.438940+0000","last_became_peered":"2024-04-26T07:51:40.438940+0000","last_unstale":"2024-04-26T07:52:04.046087+0000","last_undegraded":"2024-04-26T07:52:04.046087+0000","last_fullsized":"2024-04-26T07:52:04.046087+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'35","last_scrub_stamp":"2024-04-26T07:52:04.045815+0000","last_deep_scrub":"109'35","last_deep_scrub_stamp":"2024-04-26T07:52:04.045815+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.045815+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:29.419100+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":153,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"109'138","reported_seq":363,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.662851+0000","last_change":"2024-04-26T07:52:00.662851+0000","last_active":"2024-04-26T07:52:00.662851+0000","last_peered":"2024-04-26T07:52:00.662851+0000","last_clean":"2024-04-26T07:52:00.662851+0000","last_became_active":"2024-04-26T07:48:29.600269+0000","last_became_peered":"2024-04-26T07:48:29.600269+0000","last_unstale":"2024-04-26T07:52:00.662851+0000","last_undegraded":"2024-04-26T07:52:00.662851+0000","last_fullsized":"2024-04-26T07:52:00.662851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:00.662728+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:00.662728+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.662728+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:34.806313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"54'4","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.616117+0000","last_change":"2024-04-26T07:52:33.616117+0000","last_active":"2024-04-26T07:52:33.616117+0000","last_peered":"2024-04-26T07:52:33.616117+0000","last_clean":"2024-04-26T07:52:33.616117+0000","last_became_active":"2024-04-26T07:48:31.595401+0000","last_became_peered":"2024-04-26T07:48:31.595401+0000","last_unstale":"2024-04-26T07:52:33.616117+0000","last_undegraded":"2024-04-26T07:52:33.616117+0000","last_fullsized":"2024-04-26T07:52:33.616117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:33.615826+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:33.615826+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.615826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:01.182300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.525270+0000","last_change":"2024-04-26T07:52:20.525270+0000","last_active":"2024-04-26T07:52:20.525270+0000","last_peered":"2024-04-26T07:52:20.525270+0000","last_clean":"2024-04-26T07:52:20.525270+0000","last_became_active":"2024-04-26T07:48:23.539728+0000","last_became_peered":"2024-04-26T07:48:23.539728+0000","last_unstale":"2024-04-26T07:52:20.525270+0000","last_undegraded":"2024-04-26T07:52:20.525270+0000","last_fullsized":"2024-04-26T07:52:20.525270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:20.525011+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:20.525011+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.525011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:26.101551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"109'48","reported_seq":249,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.997233+0000","last_change":"2024-04-26T07:52:27.997233+0000","last_active":"2024-04-26T07:52:27.997233+0000","last_peered":"2024-04-26T07:52:27.997233+0000","last_clean":"2024-04-26T07:52:27.997233+0000","last_became_active":"2024-04-26T07:48:21.504424+0000","last_became_peered":"2024-04-26T07:48:21.504424+0000","last_unstale":"2024-04-26T07:52:27.997233+0000","last_undegraded":"2024-04-26T07:52:27.997233+0000","last_fullsized":"2024-04-26T07:52:27.997233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:27.996948+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:27.996948+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.996948+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:09:27.599505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.310901+0000","last_change":"2024-04-26T07:52:04.310901+0000","last_active":"2024-04-26T07:52:04.310901+0000","last_peered":"2024-04-26T07:52:04.310901+0000","last_clean":"2024-04-26T07:52:04.310901+0000","last_became_active":"2024-04-26T07:48:25.551055+0000","last_became_peered":"2024-04-26T07:48:25.551055+0000","last_unstale":"2024-04-26T07:52:04.310901+0000","last_undegraded":"2024-04-26T07:52:04.310901+0000","last_fullsized":"2024-04-26T07:52:04.310901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.310639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.310639+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.310639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:31.403021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'40","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.606902+0000","last_change":"2024-04-26T07:52:31.606902+0000","last_active":"2024-04-26T07:52:31.606902+0000","last_peered":"2024-04-26T07:52:31.606902+0000","last_clean":"2024-04-26T07:52:31.606902+0000","last_became_active":"2024-04-26T07:48:27.583068+0000","last_became_peered":"2024-04-26T07:48:27.583068+0000","last_unstale":"2024-04-26T07:52:31.606902+0000","last_undegraded":"2024-04-26T07:52:31.606902+0000","last_fullsized":"2024-04-26T07:52:31.606902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'40","last_scrub_stamp":"2024-04-26T07:52:31.606501+0000","last_deep_scrub":"109'40","last_deep_scrub_stamp":"2024-04-26T07:52:31.606501+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.606501+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:33.222872+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.228596+0000","last_change":"2024-04-26T07:52:17.228596+0000","last_active":"2024-04-26T07:52:17.228596+0000","last_peered":"2024-04-26T07:52:17.228596+0000","last_clean":"2024-04-26T07:52:17.228596+0000","last_became_active":"2024-04-26T07:48:29.586378+0000","last_became_peered":"2024-04-26T07:48:29.586378+0000","last_unstale":"2024-04-26T07:52:17.228596+0000","last_undegraded":"2024-04-26T07:52:17.228596+0000","last_fullsized":"2024-04-26T07:52:17.228596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.228351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.228351+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.228351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:22.177055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"109'6","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.479203+0000","last_change":"2024-04-26T07:52:26.479203+0000","last_active":"2024-04-26T07:52:26.479203+0000","last_peered":"2024-04-26T07:52:26.479203+0000","last_clean":"2024-04-26T07:52:26.479203+0000","last_became_active":"2024-04-26T07:48:31.597211+0000","last_became_peered":"2024-04-26T07:48:31.597211+0000","last_unstale":"2024-04-26T07:52:26.479203+0000","last_undegraded":"2024-04-26T07:52:26.479203+0000","last_fullsized":"2024-04-26T07:52:26.479203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'6","last_scrub_stamp":"2024-04-26T07:52:26.478934+0000","last_deep_scrub":"109'6","last_deep_scrub_stamp":"2024-04-26T07:52:26.478934+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.478934+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:17.099163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"90'16","reported_seq":252,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.379387+0000","last_change":"2024-04-26T07:52:28.379387+0000","last_active":"2024-04-26T07:52:28.379387+0000","last_peered":"2024-04-26T07:52:28.379387+0000","last_clean":"2024-04-26T07:52:28.379387+0000","last_became_active":"2024-04-26T07:48:23.521588+0000","last_became_peered":"2024-04-26T07:48:23.521588+0000","last_unstale":"2024-04-26T07:52:28.379387+0000","last_undegraded":"2024-04-26T07:52:28.379387+0000","last_fullsized":"2024-04-26T07:52:28.379387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'16","last_scrub_stamp":"2024-04-26T07:52:28.378996+0000","last_deep_scrub":"90'16","last_deep_scrub_stamp":"2024-04-26T07:52:28.378996+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.378996+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:56.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"109'58","reported_seq":261,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.738658+0000","last_change":"2024-04-26T07:52:28.738658+0000","last_active":"2024-04-26T07:52:28.738658+0000","last_peered":"2024-04-26T07:52:28.738658+0000","last_clean":"2024-04-26T07:52:28.738658+0000","last_became_active":"2024-04-26T07:48:21.499267+0000","last_became_peered":"2024-04-26T07:48:21.499267+0000","last_unstale":"2024-04-26T07:52:28.738658+0000","last_undegraded":"2024-04-26T07:52:28.738658+0000","last_fullsized":"2024-04-26T07:52:28.738658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:28.738244+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:28.738244+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.738244+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.320740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.256290+0000","last_change":"2024-04-26T07:52:13.256290+0000","last_active":"2024-04-26T07:52:13.256290+0000","last_peered":"2024-04-26T07:52:13.256290+0000","last_clean":"2024-04-26T07:52:13.256290+0000","last_became_active":"2024-04-26T07:48:25.576131+0000","last_became_peered":"2024-04-26T07:48:25.576131+0000","last_unstale":"2024-04-26T07:52:13.256290+0000","last_undegraded":"2024-04-26T07:52:13.256290+0000","last_fullsized":"2024-04-26T07:52:13.256290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.256011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.256011+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.256011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:57.356082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"109'27","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.488414+0000","last_change":"2024-04-26T07:52:01.488414+0000","last_active":"2024-04-26T07:52:01.488414+0000","last_peered":"2024-04-26T07:52:01.488414+0000","last_clean":"2024-04-26T07:52:01.488414+0000","last_became_active":"2024-04-26T07:48:27.572749+0000","last_became_peered":"2024-04-26T07:48:27.572749+0000","last_unstale":"2024-04-26T07:52:01.488414+0000","last_undegraded":"2024-04-26T07:52:01.488414+0000","last_fullsized":"2024-04-26T07:52:01.488414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'27","last_scrub_stamp":"2024-04-26T07:52:01.488121+0000","last_deep_scrub":"109'27","last_deep_scrub_stamp":"2024-04-26T07:52:01.488121+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.488121+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:08.702547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.616379+0000","last_change":"2024-04-26T07:52:04.616379+0000","last_active":"2024-04-26T07:52:04.616379+0000","last_peered":"2024-04-26T07:52:04.616379+0000","last_clean":"2024-04-26T07:52:04.616379+0000","last_became_active":"2024-04-26T07:48:29.595526+0000","last_became_peered":"2024-04-26T07:48:29.595526+0000","last_unstale":"2024-04-26T07:52:04.616379+0000","last_undegraded":"2024-04-26T07:52:04.616379+0000","last_fullsized":"2024-04-26T07:52:04.616379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.616119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.616119+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.616119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:02.368854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:38.809853+0000","last_change":"2024-04-26T07:52:38.809913+0000","last_active":"2024-04-26T07:52:38.809853+0000","last_peered":"2024-04-26T07:52:38.809853+0000","last_clean":"2024-04-26T07:52:38.809853+0000","last_became_active":"2024-04-26T07:48:31.609532+0000","last_became_peered":"2024-04-26T07:48:31.609532+0000","last_unstale":"2024-04-26T07:52:38.809853+0000","last_undegraded":"2024-04-26T07:52:38.809853+0000","last_fullsized":"2024-04-26T07:52:38.809853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:38.809616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:38.809616+0000","last_clean_scrub_stamp":"2024-04-26T07:52:38.809616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:20.874315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"55'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.306811+0000","last_change":"2024-04-26T07:52:21.306811+0000","last_active":"2024-04-26T07:52:21.306811+0000","last_peered":"2024-04-26T07:52:21.306811+0000","last_clean":"2024-04-26T07:52:21.306811+0000","last_became_active":"2024-04-26T07:48:23.526434+0000","last_became_peered":"2024-04-26T07:48:23.526434+0000","last_unstale":"2024-04-26T07:52:21.306811+0000","last_undegraded":"2024-04-26T07:52:21.306811+0000","last_fullsized":"2024-04-26T07:52:21.306811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:21.306456+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:21.306456+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.306456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:24.197027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"109'50","reported_seq":252,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.965742+0000","last_change":"2024-04-26T07:52:16.965742+0000","last_active":"2024-04-26T07:52:16.965742+0000","last_peered":"2024-04-26T07:52:16.965742+0000","last_clean":"2024-04-26T07:52:16.965742+0000","last_became_active":"2024-04-26T07:48:21.513247+0000","last_became_peered":"2024-04-26T07:48:21.513247+0000","last_unstale":"2024-04-26T07:52:16.965742+0000","last_undegraded":"2024-04-26T07:52:16.965742+0000","last_fullsized":"2024-04-26T07:52:16.965742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:16.965395+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:16.965395+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.965395+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:25.582176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.533606+0000","last_change":"2024-04-26T07:52:07.533606+0000","last_active":"2024-04-26T07:52:07.533606+0000","last_peered":"2024-04-26T07:52:07.533606+0000","last_clean":"2024-04-26T07:52:07.533606+0000","last_became_active":"2024-04-26T07:48:25.569159+0000","last_became_peered":"2024-04-26T07:48:25.569159+0000","last_unstale":"2024-04-26T07:52:07.533606+0000","last_undegraded":"2024-04-26T07:52:07.533606+0000","last_fullsized":"2024-04-26T07:52:07.533606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.533355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.533355+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.533355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:12.482059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"109'33","reported_seq":238,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.241989+0000","last_change":"2024-04-26T07:52:15.241989+0000","last_active":"2024-04-26T07:52:15.241989+0000","last_peered":"2024-04-26T07:52:15.241989+0000","last_clean":"2024-04-26T07:52:15.241989+0000","last_became_active":"2024-04-26T07:48:27.574040+0000","last_became_peered":"2024-04-26T07:48:27.574040+0000","last_unstale":"2024-04-26T07:52:15.241989+0000","last_undegraded":"2024-04-26T07:52:15.241989+0000","last_fullsized":"2024-04-26T07:52:15.241989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'33","last_scrub_stamp":"2024-04-26T07:52:15.241568+0000","last_deep_scrub":"109'33","last_deep_scrub_stamp":"2024-04-26T07:52:15.241568+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.241568+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:12.356672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"109'138","reported_seq":380,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.220376+0000","last_change":"2024-04-26T07:52:16.220376+0000","last_active":"2024-04-26T07:52:16.220376+0000","last_peered":"2024-04-26T07:52:16.220376+0000","last_clean":"2024-04-26T07:52:16.220376+0000","last_became_active":"2024-04-26T07:48:29.570953+0000","last_became_peered":"2024-04-26T07:48:29.570953+0000","last_unstale":"2024-04-26T07:52:16.220376+0000","last_undegraded":"2024-04-26T07:52:16.220376+0000","last_fullsized":"2024-04-26T07:52:16.220376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:16.220114+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:16.220114+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.220114+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:23.434541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.481241+0000","last_change":"2024-04-26T07:52:25.481241+0000","last_active":"2024-04-26T07:52:25.481241+0000","last_peered":"2024-04-26T07:52:25.481241+0000","last_clean":"2024-04-26T07:52:25.481241+0000","last_became_active":"2024-04-26T07:48:31.590216+0000","last_became_peered":"2024-04-26T07:48:31.590216+0000","last_unstale":"2024-04-26T07:52:25.481241+0000","last_undegraded":"2024-04-26T07:52:25.481241+0000","last_fullsized":"2024-04-26T07:52:25.481241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:25.480977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:25.480977+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.480977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.623821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.474410+0000","last_change":"2024-04-26T07:52:11.474410+0000","last_active":"2024-04-26T07:52:11.474410+0000","last_peered":"2024-04-26T07:52:11.474410+0000","last_clean":"2024-04-26T07:52:11.474410+0000","last_became_active":"2024-04-26T07:48:23.538615+0000","last_became_peered":"2024-04-26T07:48:23.538615+0000","last_unstale":"2024-04-26T07:52:11.474410+0000","last_undegraded":"2024-04-26T07:52:11.474410+0000","last_fullsized":"2024-04-26T07:52:11.474410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:11.474096+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:11.474096+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.474096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:16.323944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"109'60","reported_seq":262,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.363495+0000","last_change":"2024-04-26T07:52:24.363495+0000","last_active":"2024-04-26T07:52:24.363495+0000","last_peered":"2024-04-26T07:52:24.363495+0000","last_clean":"2024-04-26T07:52:24.363495+0000","last_became_active":"2024-04-26T07:48:21.498366+0000","last_became_peered":"2024-04-26T07:48:21.498366+0000","last_unstale":"2024-04-26T07:52:24.363495+0000","last_undegraded":"2024-04-26T07:52:24.363495+0000","last_fullsized":"2024-04-26T07:52:24.363495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'60","last_scrub_stamp":"2024-04-26T07:52:24.363229+0000","last_deep_scrub":"109'60","last_deep_scrub_stamp":"2024-04-26T07:52:24.363229+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.363229+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:29.856384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"109'4","reported_seq":379,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.152502+0000","last_change":"2024-04-26T07:52:15.152502+0000","last_active":"2024-04-26T07:52:15.152502+0000","last_peered":"2024-04-26T07:52:15.152502+0000","last_clean":"2024-04-26T07:52:15.152502+0000","last_became_active":"2024-04-26T07:48:25.552369+0000","last_became_peered":"2024-04-26T07:48:25.552369+0000","last_unstale":"2024-04-26T07:52:15.152502+0000","last_undegraded":"2024-04-26T07:52:15.152502+0000","last_fullsized":"2024-04-26T07:52:15.152502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'4","last_scrub_stamp":"2024-04-26T07:52:15.152246+0000","last_deep_scrub":"109'4","last_deep_scrub_stamp":"2024-04-26T07:52:15.152246+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.152246+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:40.525531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"109'15","reported_seq":211,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.839233+0000","last_change":"2024-04-26T07:52:04.839233+0000","last_active":"2024-04-26T07:52:04.839233+0000","last_peered":"2024-04-26T07:52:04.839233+0000","last_clean":"2024-04-26T07:52:04.839233+0000","last_became_active":"2024-04-26T07:48:27.653738+0000","last_became_peered":"2024-04-26T07:48:27.653738+0000","last_unstale":"2024-04-26T07:52:04.839233+0000","last_undegraded":"2024-04-26T07:52:04.839233+0000","last_fullsized":"2024-04-26T07:52:04.839233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:04.838959+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:04.838959+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.838959+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:03.703786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"109'138","reported_seq":415,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.930602+0000","last_change":"2024-04-26T07:52:19.930602+0000","last_active":"2024-04-26T07:52:19.930602+0000","last_peered":"2024-04-26T07:52:19.930602+0000","last_clean":"2024-04-26T07:52:19.930602+0000","last_became_active":"2024-04-26T07:48:29.574018+0000","last_became_peered":"2024-04-26T07:48:29.574018+0000","last_unstale":"2024-04-26T07:52:19.930602+0000","last_undegraded":"2024-04-26T07:52:19.930602+0000","last_fullsized":"2024-04-26T07:52:19.930602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:19.930341+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:19.930341+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.930341+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:24.352514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"54'4","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.383818+0000","last_change":"2024-04-26T07:52:34.383818+0000","last_active":"2024-04-26T07:52:34.383818+0000","last_peered":"2024-04-26T07:52:34.383818+0000","last_clean":"2024-04-26T07:52:34.383818+0000","last_became_active":"2024-04-26T07:48:31.579437+0000","last_became_peered":"2024-04-26T07:48:31.579437+0000","last_unstale":"2024-04-26T07:52:34.383818+0000","last_undegraded":"2024-04-26T07:52:34.383818+0000","last_fullsized":"2024-04-26T07:52:34.383818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:34.383543+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:34.383543+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.383543+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:49.779988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"55'4","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:42.749007+0000","last_change":"2024-04-26T07:52:42.749204+0000","last_active":"2024-04-26T07:52:42.749007+0000","last_peered":"2024-04-26T07:52:42.749007+0000","last_clean":"2024-04-26T07:52:42.749007+0000","last_became_active":"2024-04-26T07:48:53.778738+0000","last_became_peered":"2024-04-26T07:48:53.778738+0000","last_unstale":"2024-04-26T07:52:42.749007+0000","last_undegraded":"2024-04-26T07:52:42.749007+0000","last_fullsized":"2024-04-26T07:52:42.749007+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:42.748769+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:42.748769+0000","last_clean_scrub_stamp":"2024-04-26T07:52:42.748769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:12.406768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"109'58","reported_seq":261,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.792403+0000","last_change":"2024-04-26T07:52:30.792403+0000","last_active":"2024-04-26T07:52:30.792403+0000","last_peered":"2024-04-26T07:52:30.792403+0000","last_clean":"2024-04-26T07:52:30.792403+0000","last_became_active":"2024-04-26T07:48:21.502225+0000","last_became_peered":"2024-04-26T07:48:21.502225+0000","last_unstale":"2024-04-26T07:52:30.792403+0000","last_undegraded":"2024-04-26T07:52:30.792403+0000","last_fullsized":"2024-04-26T07:52:30.792403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:30.792060+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:30.792060+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.792060+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:46.188505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.360510+0000","last_change":"2024-04-26T07:52:16.360510+0000","last_active":"2024-04-26T07:52:16.360510+0000","last_peered":"2024-04-26T07:52:16.360510+0000","last_clean":"2024-04-26T07:52:16.360510+0000","last_became_active":"2024-04-26T07:48:25.552079+0000","last_became_peered":"2024-04-26T07:48:25.552079+0000","last_unstale":"2024-04-26T07:52:16.360510+0000","last_undegraded":"2024-04-26T07:52:16.360510+0000","last_fullsized":"2024-04-26T07:52:16.360510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:16.360269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:16.360269+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.360269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:04.134953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"109'36","reported_seq":240,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.208140+0000","last_change":"2024-04-26T07:52:04.208140+0000","last_active":"2024-04-26T07:52:04.208140+0000","last_peered":"2024-04-26T07:52:04.208140+0000","last_clean":"2024-04-26T07:52:04.208140+0000","last_became_active":"2024-04-26T07:48:27.575482+0000","last_became_peered":"2024-04-26T07:48:27.575482+0000","last_unstale":"2024-04-26T07:52:04.208140+0000","last_undegraded":"2024-04-26T07:52:04.208140+0000","last_fullsized":"2024-04-26T07:52:04.208140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:04.207861+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:04.207861+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.207861+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:06.772025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.888704+0000","last_change":"2024-04-26T07:52:20.888704+0000","last_active":"2024-04-26T07:52:20.888704+0000","last_peered":"2024-04-26T07:52:20.888704+0000","last_clean":"2024-04-26T07:52:20.888704+0000","last_became_active":"2024-04-26T07:48:29.578732+0000","last_became_peered":"2024-04-26T07:48:29.578732+0000","last_unstale":"2024-04-26T07:52:20.888704+0000","last_undegraded":"2024-04-26T07:52:20.888704+0000","last_fullsized":"2024-04-26T07:52:20.888704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:20.888449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:20.888449+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.888449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:02.305270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.496242+0000","last_change":"2024-04-26T07:52:27.496242+0000","last_active":"2024-04-26T07:52:27.496242+0000","last_peered":"2024-04-26T07:52:27.496242+0000","last_clean":"2024-04-26T07:52:27.496242+0000","last_became_active":"2024-04-26T07:48:31.609478+0000","last_became_peered":"2024-04-26T07:48:31.609478+0000","last_unstale":"2024-04-26T07:52:27.496242+0000","last_undegraded":"2024-04-26T07:52:27.496242+0000","last_fullsized":"2024-04-26T07:52:27.496242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:27.495948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:27.495948+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.495948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:51.613474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"72'6","reported_seq":225,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.868761+0000","last_change":"2024-04-26T07:52:02.868761+0000","last_active":"2024-04-26T07:52:02.868761+0000","last_peered":"2024-04-26T07:52:02.868761+0000","last_clean":"2024-04-26T07:52:02.868761+0000","last_became_active":"2024-04-26T07:48:23.547403+0000","last_became_peered":"2024-04-26T07:48:23.547403+0000","last_unstale":"2024-04-26T07:52:02.868761+0000","last_undegraded":"2024-04-26T07:52:02.868761+0000","last_fullsized":"2024-04-26T07:52:02.868761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-26T07:52:02.868394+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-26T07:52:02.868394+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.868394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:08.921031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"109'119","reported_seq":316,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.111271+0000","last_change":"2024-04-26T07:52:08.111271+0000","last_active":"2024-04-26T07:52:08.111271+0000","last_peered":"2024-04-26T07:52:08.111271+0000","last_clean":"2024-04-26T07:52:08.111271+0000","last_became_active":"2024-04-26T07:51:40.429475+0000","last_became_peered":"2024-04-26T07:51:40.429475+0000","last_unstale":"2024-04-26T07:52:08.111271+0000","last_undegraded":"2024-04-26T07:52:08.111271+0000","last_fullsized":"2024-04-26T07:52:08.111271+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'119","last_scrub_stamp":"2024-04-26T07:52:08.110978+0000","last_deep_scrub":"109'119","last_deep_scrub_stamp":"2024-04-26T07:52:08.110978+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.110978+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:49.613873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.042139+0000","last_change":"2024-04-26T07:52:23.042139+0000","last_active":"2024-04-26T07:52:23.042139+0000","last_peered":"2024-04-26T07:52:23.042139+0000","last_clean":"2024-04-26T07:52:23.042139+0000","last_became_active":"2024-04-26T07:48:15.448406+0000","last_became_peered":"2024-04-26T07:48:15.448406+0000","last_unstale":"2024-04-26T07:52:23.042139+0000","last_undegraded":"2024-04-26T07:52:23.042139+0000","last_fullsized":"2024-04-26T07:52:23.042139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:23.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:23.041869+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:44.998833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"109'42","reported_seq":245,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.721411+0000","last_change":"2024-04-26T07:52:24.721411+0000","last_active":"2024-04-26T07:52:24.721411+0000","last_peered":"2024-04-26T07:52:24.721411+0000","last_clean":"2024-04-26T07:52:24.721411+0000","last_became_active":"2024-04-26T07:48:21.528620+0000","last_became_peered":"2024-04-26T07:48:21.528620+0000","last_unstale":"2024-04-26T07:52:24.721411+0000","last_undegraded":"2024-04-26T07:52:24.721411+0000","last_fullsized":"2024-04-26T07:52:24.721411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:24.721015+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:24.721015+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.721015+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:52.904920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":150,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.283711+0000","last_change":"2024-04-26T07:52:18.283711+0000","last_active":"2024-04-26T07:52:18.283711+0000","last_peered":"2024-04-26T07:52:18.283711+0000","last_clean":"2024-04-26T07:52:18.283711+0000","last_became_active":"2024-04-26T07:51:40.428641+0000","last_became_peered":"2024-04-26T07:51:40.428641+0000","last_unstale":"2024-04-26T07:52:18.283711+0000","last_undegraded":"2024-04-26T07:52:18.283711+0000","last_fullsized":"2024-04-26T07:52:18.283711+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:18.283431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:18.283431+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.283431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:43.259274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"109'51","reported_seq":266,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.190110+0000","last_change":"2024-04-26T07:52:06.190110+0000","last_active":"2024-04-26T07:52:06.190110+0000","last_peered":"2024-04-26T07:52:06.190110+0000","last_clean":"2024-04-26T07:52:06.190110+0000","last_became_active":"2024-04-26T07:48:27.573125+0000","last_became_peered":"2024-04-26T07:48:27.573125+0000","last_unstale":"2024-04-26T07:52:06.190110+0000","last_undegraded":"2024-04-26T07:52:06.190110+0000","last_fullsized":"2024-04-26T07:52:06.190110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'51","last_scrub_stamp":"2024-04-26T07:52:06.189827+0000","last_deep_scrub":"109'51","last_deep_scrub_stamp":"2024-04-26T07:52:06.189827+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.189827+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:17.316177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":274,"num_write":26,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.682623+0000","last_change":"2024-04-26T07:52:02.682623+0000","last_active":"2024-04-26T07:52:02.682623+0000","last_peered":"2024-04-26T07:52:02.682623+0000","last_clean":"2024-04-26T07:52:02.682623+0000","last_became_active":"2024-04-26T07:48:29.596568+0000","last_became_peered":"2024-04-26T07:48:29.596568+0000","last_unstale":"2024-04-26T07:52:02.682623+0000","last_undegraded":"2024-04-26T07:52:02.682623+0000","last_fullsized":"2024-04-26T07:52:02.682623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:02.682386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:02.682386+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.682386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:44.099207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"90'6","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.844554+0000","last_change":"2024-04-26T07:52:26.844554+0000","last_active":"2024-04-26T07:52:26.844554+0000","last_peered":"2024-04-26T07:52:26.844554+0000","last_clean":"2024-04-26T07:52:26.844554+0000","last_became_active":"2024-04-26T07:48:31.604700+0000","last_became_peered":"2024-04-26T07:48:31.604700+0000","last_unstale":"2024-04-26T07:52:26.844554+0000","last_undegraded":"2024-04-26T07:52:26.844554+0000","last_fullsized":"2024-04-26T07:52:26.844554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:26.844280+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:26.844280+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.844280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:34:45.787818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"72'10","reported_seq":241,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.639787+0000","last_change":"2024-04-26T07:52:14.639787+0000","last_active":"2024-04-26T07:52:14.639787+0000","last_peered":"2024-04-26T07:52:14.639787+0000","last_clean":"2024-04-26T07:52:14.639787+0000","last_became_active":"2024-04-26T07:48:23.546377+0000","last_became_peered":"2024-04-26T07:48:23.546377+0000","last_unstale":"2024-04-26T07:52:14.639787+0000","last_undegraded":"2024-04-26T07:52:14.639787+0000","last_fullsized":"2024-04-26T07:52:14.639787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'10","last_scrub_stamp":"2024-04-26T07:52:14.639493+0000","last_deep_scrub":"72'10","last_deep_scrub_stamp":"2024-04-26T07:52:14.639493+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.639493+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:05.259721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.212344+0000","last_change":"2024-04-26T07:52:15.212344+0000","last_active":"2024-04-26T07:52:15.212344+0000","last_peered":"2024-04-26T07:52:15.212344+0000","last_clean":"2024-04-26T07:52:15.212344+0000","last_became_active":"2024-04-26T07:51:40.437582+0000","last_became_peered":"2024-04-26T07:51:40.437582+0000","last_unstale":"2024-04-26T07:52:15.212344+0000","last_undegraded":"2024-04-26T07:52:15.212344+0000","last_fullsized":"2024-04-26T07:52:15.212344+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:15.212060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:15.212060+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.212060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:27.725357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"109'40","reported_seq":241,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.564876+0000","last_change":"2024-04-26T07:52:23.564876+0000","last_active":"2024-04-26T07:52:23.564876+0000","last_peered":"2024-04-26T07:52:23.564876+0000","last_clean":"2024-04-26T07:52:23.564876+0000","last_became_active":"2024-04-26T07:48:21.492727+0000","last_became_peered":"2024-04-26T07:48:21.492727+0000","last_unstale":"2024-04-26T07:52:23.564876+0000","last_undegraded":"2024-04-26T07:52:23.564876+0000","last_fullsized":"2024-04-26T07:52:23.564876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'40","last_scrub_stamp":"2024-04-26T07:52:23.564708+0000","last_deep_scrub":"109'40","last_deep_scrub_stamp":"2024-04-26T07:52:23.564708+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.564708+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:40.232431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.014807+0000","last_change":"2024-04-26T07:52:31.014807+0000","last_active":"2024-04-26T07:52:31.014807+0000","last_peered":"2024-04-26T07:52:31.014807+0000","last_clean":"2024-04-26T07:52:31.014807+0000","last_became_active":"2024-04-26T07:48:25.567373+0000","last_became_peered":"2024-04-26T07:48:25.567373+0000","last_unstale":"2024-04-26T07:52:31.014807+0000","last_undegraded":"2024-04-26T07:52:31.014807+0000","last_fullsized":"2024-04-26T07:52:31.014807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:31.014549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:31.014549+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.014549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:16:15.149860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"109'156","reported_seq":461,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.547470+0000","last_change":"2024-04-26T07:52:09.547470+0000","last_active":"2024-04-26T07:52:09.547470+0000","last_peered":"2024-04-26T07:52:09.547470+0000","last_clean":"2024-04-26T07:52:09.547470+0000","last_became_active":"2024-04-26T07:48:27.577665+0000","last_became_peered":"2024-04-26T07:48:27.577665+0000","last_unstale":"2024-04-26T07:52:09.547470+0000","last_undegraded":"2024-04-26T07:52:09.547470+0000","last_fullsized":"2024-04-26T07:52:09.547470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'156","last_scrub_stamp":"2024-04-26T07:52:09.547197+0000","last_deep_scrub":"109'156","last_deep_scrub_stamp":"2024-04-26T07:52:09.547197+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.547197+0000","objects_scrubbed":10,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:52:16.819965+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":424,"num_write":38,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":142,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.241931+0000","last_change":"2024-04-26T07:52:29.241931+0000","last_active":"2024-04-26T07:52:29.241931+0000","last_peered":"2024-04-26T07:52:29.241931+0000","last_clean":"2024-04-26T07:52:29.241931+0000","last_became_active":"2024-04-26T07:51:40.439356+0000","last_became_peered":"2024-04-26T07:51:40.439356+0000","last_unstale":"2024-04-26T07:52:29.241931+0000","last_undegraded":"2024-04-26T07:52:29.241931+0000","last_fullsized":"2024-04-26T07:52:29.241931+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:29.241579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:29.241579+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.241579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:56.808053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"55'3","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.500858+0000","last_change":"2024-04-26T07:52:28.500858+0000","last_active":"2024-04-26T07:52:28.500858+0000","last_peered":"2024-04-26T07:52:28.500858+0000","last_clean":"2024-04-26T07:52:28.500858+0000","last_became_active":"2024-04-26T07:48:31.757088+0000","last_became_peered":"2024-04-26T07:48:31.757088+0000","last_unstale":"2024-04-26T07:52:28.500858+0000","last_undegraded":"2024-04-26T07:52:28.500858+0000","last_fullsized":"2024-04-26T07:52:28.500858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3","last_scrub_stamp":"2024-04-26T07:52:28.500442+0000","last_deep_scrub":"55'3","last_deep_scrub_stamp":"2024-04-26T07:52:28.500442+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.500442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:37.164330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.573026+0000","last_change":"2024-04-26T07:52:06.573026+0000","last_active":"2024-04-26T07:52:06.573026+0000","last_peered":"2024-04-26T07:52:06.573026+0000","last_clean":"2024-04-26T07:52:06.573026+0000","last_became_active":"2024-04-26T07:48:23.538699+0000","last_became_peered":"2024-04-26T07:48:23.538699+0000","last_unstale":"2024-04-26T07:52:06.573026+0000","last_undegraded":"2024-04-26T07:52:06.573026+0000","last_fullsized":"2024-04-26T07:52:06.573026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:06.572770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:06.572770+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.572770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:13.787197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.359784+0000","last_change":"2024-04-26T07:52:05.359784+0000","last_active":"2024-04-26T07:52:05.359784+0000","last_peered":"2024-04-26T07:52:05.359784+0000","last_clean":"2024-04-26T07:52:05.359784+0000","last_became_active":"2024-04-26T07:48:15.447530+0000","last_became_peered":"2024-04-26T07:48:15.447530+0000","last_unstale":"2024-04-26T07:52:05.359784+0000","last_undegraded":"2024-04-26T07:52:05.359784+0000","last_fullsized":"2024-04-26T07:52:05.359784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.359508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.359508+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.359508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:45.415341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"109'52","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.480204+0000","last_change":"2024-04-26T07:52:20.480204+0000","last_active":"2024-04-26T07:52:20.480204+0000","last_peered":"2024-04-26T07:52:20.480204+0000","last_clean":"2024-04-26T07:52:20.480204+0000","last_became_active":"2024-04-26T07:48:21.500221+0000","last_became_peered":"2024-04-26T07:48:21.500221+0000","last_unstale":"2024-04-26T07:52:20.480204+0000","last_undegraded":"2024-04-26T07:52:20.480204+0000","last_fullsized":"2024-04-26T07:52:20.480204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:20.479934+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:20.479934+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.479934+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:34:39.423473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"109'2","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.288828+0000","last_change":"2024-04-26T07:52:02.288828+0000","last_active":"2024-04-26T07:52:02.288828+0000","last_peered":"2024-04-26T07:52:02.288828+0000","last_clean":"2024-04-26T07:52:02.288828+0000","last_became_active":"2024-04-26T07:48:25.555813+0000","last_became_peered":"2024-04-26T07:48:25.555813+0000","last_unstale":"2024-04-26T07:52:02.288828+0000","last_undegraded":"2024-04-26T07:52:02.288828+0000","last_fullsized":"2024-04-26T07:52:02.288828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:02.288582+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:02.288582+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.288582+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:12.977945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"109'26","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.211440+0000","last_change":"2024-04-26T07:52:35.211440+0000","last_active":"2024-04-26T07:52:35.211440+0000","last_peered":"2024-04-26T07:52:35.211440+0000","last_clean":"2024-04-26T07:52:35.211440+0000","last_became_active":"2024-04-26T07:51:40.445444+0000","last_became_peered":"2024-04-26T07:51:40.445444+0000","last_unstale":"2024-04-26T07:52:35.211440+0000","last_undegraded":"2024-04-26T07:52:35.211440+0000","last_fullsized":"2024-04-26T07:52:35.211440+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'26","last_scrub_stamp":"2024-04-26T07:52:35.211175+0000","last_deep_scrub":"109'26","last_deep_scrub_stamp":"2024-04-26T07:52:35.211175+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.211175+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:43.870202+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.659273+0000","last_change":"2024-04-26T07:52:03.659273+0000","last_active":"2024-04-26T07:52:03.659273+0000","last_peered":"2024-04-26T07:52:03.659273+0000","last_clean":"2024-04-26T07:52:03.659273+0000","last_became_active":"2024-04-26T07:48:29.595986+0000","last_became_peered":"2024-04-26T07:48:29.595986+0000","last_unstale":"2024-04-26T07:52:03.659273+0000","last_undegraded":"2024-04-26T07:52:03.659273+0000","last_fullsized":"2024-04-26T07:52:03.659273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.659029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.659029+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.659029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.870936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"55'6","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.778037+0000","last_change":"2024-04-26T07:52:36.778097+0000","last_active":"2024-04-26T07:52:36.778037+0000","last_peered":"2024-04-26T07:52:36.778037+0000","last_clean":"2024-04-26T07:52:36.778037+0000","last_became_active":"2024-04-26T07:48:31.584171+0000","last_became_peered":"2024-04-26T07:48:31.584171+0000","last_unstale":"2024-04-26T07:52:36.778037+0000","last_undegraded":"2024-04-26T07:52:36.778037+0000","last_fullsized":"2024-04-26T07:52:36.778037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'6","last_scrub_stamp":"2024-04-26T07:52:36.777844+0000","last_deep_scrub":"55'6","last_deep_scrub_stamp":"2024-04-26T07:52:36.777844+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.777844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:26.522191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"72'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.562346+0000","last_change":"2024-04-26T07:52:12.562346+0000","last_active":"2024-04-26T07:52:12.562346+0000","last_peered":"2024-04-26T07:52:12.562346+0000","last_clean":"2024-04-26T07:52:12.562346+0000","last_became_active":"2024-04-26T07:48:23.533993+0000","last_became_peered":"2024-04-26T07:48:23.533993+0000","last_unstale":"2024-04-26T07:52:12.562346+0000","last_undegraded":"2024-04-26T07:52:12.562346+0000","last_fullsized":"2024-04-26T07:52:12.562346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-04-26T07:52:12.562055+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.562055+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.562055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:46.705639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.015497+0000","last_change":"2024-04-26T07:52:24.015549+0000","last_active":"2024-04-26T07:52:24.015497+0000","last_peered":"2024-04-26T07:52:24.015497+0000","last_clean":"2024-04-26T07:52:24.015497+0000","last_became_active":"2024-04-26T07:48:15.453078+0000","last_became_peered":"2024-04-26T07:48:15.453078+0000","last_unstale":"2024-04-26T07:52:24.015497+0000","last_undegraded":"2024-04-26T07:52:24.015497+0000","last_fullsized":"2024-04-26T07:52:24.015497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:24.015293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:24.015293+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.015293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:26.905864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"109'40","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.351273+0000","last_change":"2024-04-26T07:52:23.351273+0000","last_active":"2024-04-26T07:52:23.351273+0000","last_peered":"2024-04-26T07:52:23.351273+0000","last_clean":"2024-04-26T07:52:23.351273+0000","last_became_active":"2024-04-26T07:48:21.494623+0000","last_became_peered":"2024-04-26T07:48:21.494623+0000","last_unstale":"2024-04-26T07:52:23.351273+0000","last_undegraded":"2024-04-26T07:52:23.351273+0000","last_fullsized":"2024-04-26T07:52:23.351273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'40","last_scrub_stamp":"2024-04-26T07:52:23.350914+0000","last_deep_scrub":"109'40","last_deep_scrub_stamp":"2024-04-26T07:52:23.350914+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.350914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:35.864211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.634380+0000","last_change":"2024-04-26T07:52:09.634380+0000","last_active":"2024-04-26T07:52:09.634380+0000","last_peered":"2024-04-26T07:52:09.634380+0000","last_clean":"2024-04-26T07:52:09.634380+0000","last_became_active":"2024-04-26T07:48:25.561697+0000","last_became_peered":"2024-04-26T07:48:25.561697+0000","last_unstale":"2024-04-26T07:52:09.634380+0000","last_undegraded":"2024-04-26T07:52:09.634380+0000","last_fullsized":"2024-04-26T07:52:09.634380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:09.634025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:09.634025+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.634025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:39.955994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"109'18","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.830487+0000","last_change":"2024-04-26T07:52:35.830487+0000","last_active":"2024-04-26T07:52:35.830487+0000","last_peered":"2024-04-26T07:52:35.830487+0000","last_clean":"2024-04-26T07:52:35.830487+0000","last_became_active":"2024-04-26T07:48:27.556677+0000","last_became_peered":"2024-04-26T07:48:27.556677+0000","last_unstale":"2024-04-26T07:52:35.830487+0000","last_undegraded":"2024-04-26T07:52:35.830487+0000","last_fullsized":"2024-04-26T07:52:35.830487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'18","last_scrub_stamp":"2024-04-26T07:52:35.830215+0000","last_deep_scrub":"109'18","last_deep_scrub_stamp":"2024-04-26T07:52:35.830215+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.830215+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:30.276751+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.873565+0000","last_change":"2024-04-26T07:52:23.873565+0000","last_active":"2024-04-26T07:52:23.873565+0000","last_peered":"2024-04-26T07:52:23.873565+0000","last_clean":"2024-04-26T07:52:23.873565+0000","last_became_active":"2024-04-26T07:48:29.601998+0000","last_became_peered":"2024-04-26T07:48:29.601998+0000","last_unstale":"2024-04-26T07:52:23.873565+0000","last_undegraded":"2024-04-26T07:52:23.873565+0000","last_fullsized":"2024-04-26T07:52:23.873565+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:23.873186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:23.873186+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.873186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:06.838084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.917692+0000","last_change":"2024-04-26T07:52:34.917692+0000","last_active":"2024-04-26T07:52:34.917692+0000","last_peered":"2024-04-26T07:52:34.917692+0000","last_clean":"2024-04-26T07:52:34.917692+0000","last_became_active":"2024-04-26T07:48:31.600522+0000","last_became_peered":"2024-04-26T07:48:31.600522+0000","last_unstale":"2024-04-26T07:52:34.917692+0000","last_undegraded":"2024-04-26T07:52:34.917692+0000","last_fullsized":"2024-04-26T07:52:34.917692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:34.917289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:34.917289+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.917289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:12:21.993998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.539589+0000","last_change":"2024-04-26T07:52:08.539589+0000","last_active":"2024-04-26T07:52:08.539589+0000","last_peered":"2024-04-26T07:52:08.539589+0000","last_clean":"2024-04-26T07:52:08.539589+0000","last_became_active":"2024-04-26T07:48:23.535757+0000","last_became_peered":"2024-04-26T07:48:23.535757+0000","last_unstale":"2024-04-26T07:52:08.539589+0000","last_undegraded":"2024-04-26T07:52:08.539589+0000","last_fullsized":"2024-04-26T07:52:08.539589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:08.539328+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:08.539328+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.539328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:09.275493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"109'48","reported_seq":249,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.025384+0000","last_change":"2024-04-26T07:52:26.025384+0000","last_active":"2024-04-26T07:52:26.025384+0000","last_peered":"2024-04-26T07:52:26.025384+0000","last_clean":"2024-04-26T07:52:26.025384+0000","last_became_active":"2024-04-26T07:48:21.503376+0000","last_became_peered":"2024-04-26T07:48:21.503376+0000","last_unstale":"2024-04-26T07:52:26.025384+0000","last_undegraded":"2024-04-26T07:52:26.025384+0000","last_fullsized":"2024-04-26T07:52:26.025384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:26.025085+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:26.025085+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.025085+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:38.538383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.553963+0000","last_change":"2024-04-26T07:52:14.553963+0000","last_active":"2024-04-26T07:52:14.553963+0000","last_peered":"2024-04-26T07:52:14.553963+0000","last_clean":"2024-04-26T07:52:14.553963+0000","last_became_active":"2024-04-26T07:48:15.518996+0000","last_became_peered":"2024-04-26T07:48:15.518996+0000","last_unstale":"2024-04-26T07:52:14.553963+0000","last_undegraded":"2024-04-26T07:52:14.553963+0000","last_fullsized":"2024-04-26T07:52:14.553963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:14.553682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:14.553682+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.553682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:55.970503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.626371+0000","last_change":"2024-04-26T07:52:13.626371+0000","last_active":"2024-04-26T07:52:13.626371+0000","last_peered":"2024-04-26T07:52:13.626371+0000","last_clean":"2024-04-26T07:52:13.626371+0000","last_became_active":"2024-04-26T07:48:25.581806+0000","last_became_peered":"2024-04-26T07:48:25.581806+0000","last_unstale":"2024-04-26T07:52:13.626371+0000","last_undegraded":"2024-04-26T07:52:13.626371+0000","last_fullsized":"2024-04-26T07:52:13.626371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.626121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.626121+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.626121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:23.768965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"109'48","reported_seq":259,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.592928+0000","last_change":"2024-04-26T07:52:17.592928+0000","last_active":"2024-04-26T07:52:17.592928+0000","last_peered":"2024-04-26T07:52:17.592928+0000","last_clean":"2024-04-26T07:52:17.592928+0000","last_became_active":"2024-04-26T07:48:27.574354+0000","last_became_peered":"2024-04-26T07:48:27.574354+0000","last_unstale":"2024-04-26T07:52:17.592928+0000","last_undegraded":"2024-04-26T07:52:17.592928+0000","last_fullsized":"2024-04-26T07:52:17.592928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:17.592612+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:17.592612+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.592612+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:23.468407+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":45,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.342336+0000","last_change":"2024-04-26T07:52:32.342336+0000","last_active":"2024-04-26T07:52:32.342336+0000","last_peered":"2024-04-26T07:52:32.342336+0000","last_clean":"2024-04-26T07:52:32.342336+0000","last_became_active":"2024-04-26T07:48:29.576341+0000","last_became_peered":"2024-04-26T07:48:29.576341+0000","last_unstale":"2024-04-26T07:52:32.342336+0000","last_undegraded":"2024-04-26T07:52:32.342336+0000","last_fullsized":"2024-04-26T07:52:32.342336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:32.342088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:32.342088+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.342088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:28.924584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'12","reported_seq":198,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.663689+0000","last_change":"2024-04-26T07:52:36.663833+0000","last_active":"2024-04-26T07:52:36.663689+0000","last_peered":"2024-04-26T07:52:36.663689+0000","last_clean":"2024-04-26T07:52:36.663689+0000","last_became_active":"2024-04-26T07:48:31.757780+0000","last_became_peered":"2024-04-26T07:48:31.757780+0000","last_unstale":"2024-04-26T07:52:36.663689+0000","last_undegraded":"2024-04-26T07:52:36.663689+0000","last_fullsized":"2024-04-26T07:52:36.663689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2024-04-26T07:52:36.663424+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2024-04-26T07:52:36.663424+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.663424+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:57.617993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":30,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'2","reported_seq":205,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.551935+0000","last_change":"2024-04-26T07:52:18.551935+0000","last_active":"2024-04-26T07:52:18.551935+0000","last_peered":"2024-04-26T07:52:18.551935+0000","last_clean":"2024-04-26T07:52:18.551935+0000","last_became_active":"2024-04-26T07:48:23.540228+0000","last_became_peered":"2024-04-26T07:48:23.540228+0000","last_unstale":"2024-04-26T07:52:18.551935+0000","last_undegraded":"2024-04-26T07:52:18.551935+0000","last_fullsized":"2024-04-26T07:52:18.551935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:18.551602+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:18.551602+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.551602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:19.194908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"109'44","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.508286+0000","last_change":"2024-04-26T07:52:18.508286+0000","last_active":"2024-04-26T07:52:18.508286+0000","last_peered":"2024-04-26T07:52:18.508286+0000","last_clean":"2024-04-26T07:52:18.508286+0000","last_became_active":"2024-04-26T07:48:21.497742+0000","last_became_peered":"2024-04-26T07:48:21.497742+0000","last_unstale":"2024-04-26T07:52:18.508286+0000","last_undegraded":"2024-04-26T07:52:18.508286+0000","last_fullsized":"2024-04-26T07:52:18.508286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'44","last_scrub_stamp":"2024-04-26T07:52:18.508026+0000","last_deep_scrub":"109'44","last_deep_scrub_stamp":"2024-04-26T07:52:18.508026+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.508026+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:11.571289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.246156+0000","last_change":"2024-04-26T07:52:17.246156+0000","last_active":"2024-04-26T07:52:17.246156+0000","last_peered":"2024-04-26T07:52:17.246156+0000","last_clean":"2024-04-26T07:52:17.246156+0000","last_became_active":"2024-04-26T07:51:40.433293+0000","last_became_peered":"2024-04-26T07:51:40.433293+0000","last_unstale":"2024-04-26T07:52:17.246156+0000","last_undegraded":"2024-04-26T07:52:17.246156+0000","last_fullsized":"2024-04-26T07:52:17.246156+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.245909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.245909+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.245909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:34.468197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.874398+0000","last_change":"2024-04-26T07:52:03.874398+0000","last_active":"2024-04-26T07:52:03.874398+0000","last_peered":"2024-04-26T07:52:03.874398+0000","last_clean":"2024-04-26T07:52:03.874398+0000","last_became_active":"2024-04-26T07:48:25.568860+0000","last_became_peered":"2024-04-26T07:48:25.568860+0000","last_unstale":"2024-04-26T07:52:03.874398+0000","last_undegraded":"2024-04-26T07:52:03.874398+0000","last_fullsized":"2024-04-26T07:52:03.874398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.874164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.874164+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.874164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:34.208516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"109'22","reported_seq":219,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.478807+0000","last_change":"2024-04-26T07:52:21.478807+0000","last_active":"2024-04-26T07:52:21.478807+0000","last_peered":"2024-04-26T07:52:21.478807+0000","last_clean":"2024-04-26T07:52:21.478807+0000","last_became_active":"2024-04-26T07:48:27.653614+0000","last_became_peered":"2024-04-26T07:48:27.653614+0000","last_unstale":"2024-04-26T07:52:21.478807+0000","last_undegraded":"2024-04-26T07:52:21.478807+0000","last_fullsized":"2024-04-26T07:52:21.478807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'22","last_scrub_stamp":"2024-04-26T07:52:21.478520+0000","last_deep_scrub":"109'22","last_deep_scrub_stamp":"2024-04-26T07:52:21.478520+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.478520+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:51.800489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"109'138","reported_seq":393,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.182627+0000","last_change":"2024-04-26T07:52:05.182627+0000","last_active":"2024-04-26T07:52:05.182627+0000","last_peered":"2024-04-26T07:52:05.182627+0000","last_clean":"2024-04-26T07:52:05.182627+0000","last_became_active":"2024-04-26T07:48:29.574033+0000","last_became_peered":"2024-04-26T07:48:29.574033+0000","last_unstale":"2024-04-26T07:52:05.182627+0000","last_undegraded":"2024-04-26T07:52:05.182627+0000","last_fullsized":"2024-04-26T07:52:05.182627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:05.182189+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:05.182189+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.182189+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:53:45.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:40.745219+0000","last_change":"2024-04-26T07:52:40.745331+0000","last_active":"2024-04-26T07:52:40.745219+0000","last_peered":"2024-04-26T07:52:40.745219+0000","last_clean":"2024-04-26T07:52:40.745219+0000","last_became_active":"2024-04-26T07:48:31.757801+0000","last_became_peered":"2024-04-26T07:48:31.757801+0000","last_unstale":"2024-04-26T07:52:40.745219+0000","last_undegraded":"2024-04-26T07:52:40.745219+0000","last_fullsized":"2024-04-26T07:52:40.745219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:40.744986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:40.744986+0000","last_clean_scrub_stamp":"2024-04-26T07:52:40.744986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:12:55.366260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.826299+0000","last_change":"2024-04-26T07:52:17.826299+0000","last_active":"2024-04-26T07:52:17.826299+0000","last_peered":"2024-04-26T07:52:17.826299+0000","last_clean":"2024-04-26T07:52:17.826299+0000","last_became_active":"2024-04-26T07:48:23.558309+0000","last_became_peered":"2024-04-26T07:48:23.558309+0000","last_unstale":"2024-04-26T07:52:17.826299+0000","last_undegraded":"2024-04-26T07:52:17.826299+0000","last_fullsized":"2024-04-26T07:52:17.826299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:17.825908+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:17.825908+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.825908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:20.716480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"109'38","reported_seq":241,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.834986+0000","last_change":"2024-04-26T07:52:34.834986+0000","last_active":"2024-04-26T07:52:34.834986+0000","last_peered":"2024-04-26T07:52:34.834986+0000","last_clean":"2024-04-26T07:52:34.834986+0000","last_became_active":"2024-04-26T07:48:21.519214+0000","last_became_peered":"2024-04-26T07:48:21.519214+0000","last_unstale":"2024-04-26T07:52:34.834986+0000","last_undegraded":"2024-04-26T07:52:34.834986+0000","last_fullsized":"2024-04-26T07:52:34.834986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:34.834721+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:34.834721+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.834721+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:18:19.623462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.541968+0000","last_change":"2024-04-26T07:52:13.541968+0000","last_active":"2024-04-26T07:52:13.541968+0000","last_peered":"2024-04-26T07:52:13.541968+0000","last_clean":"2024-04-26T07:52:13.541968+0000","last_became_active":"2024-04-26T07:48:15.453760+0000","last_became_peered":"2024-04-26T07:48:15.453760+0000","last_unstale":"2024-04-26T07:52:13.541968+0000","last_undegraded":"2024-04-26T07:52:13.541968+0000","last_fullsized":"2024-04-26T07:52:13.541968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.541642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.541642+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.541642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:17.963815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.342571+0000","last_change":"2024-04-26T07:52:20.342571+0000","last_active":"2024-04-26T07:52:20.342571+0000","last_peered":"2024-04-26T07:52:20.342571+0000","last_clean":"2024-04-26T07:52:20.342571+0000","last_became_active":"2024-04-26T07:48:25.553096+0000","last_became_peered":"2024-04-26T07:48:25.553096+0000","last_unstale":"2024-04-26T07:52:20.342571+0000","last_undegraded":"2024-04-26T07:52:20.342571+0000","last_fullsized":"2024-04-26T07:52:20.342571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:20.342310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:20.342310+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.342310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:42.299274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.460523+0000","last_change":"2024-04-26T07:52:05.460523+0000","last_active":"2024-04-26T07:52:05.460523+0000","last_peered":"2024-04-26T07:52:05.460523+0000","last_clean":"2024-04-26T07:52:05.460523+0000","last_became_active":"2024-04-26T07:48:27.554660+0000","last_became_peered":"2024-04-26T07:48:27.554660+0000","last_unstale":"2024-04-26T07:52:05.460523+0000","last_undegraded":"2024-04-26T07:52:05.460523+0000","last_fullsized":"2024-04-26T07:52:05.460523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:05.460261+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:05.460261+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.460261+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:16.586612+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"109'138","reported_seq":365,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.843830+0000","last_change":"2024-04-26T07:52:09.843830+0000","last_active":"2024-04-26T07:52:09.843830+0000","last_peered":"2024-04-26T07:52:09.843830+0000","last_clean":"2024-04-26T07:52:09.843830+0000","last_became_active":"2024-04-26T07:48:29.584266+0000","last_became_peered":"2024-04-26T07:48:29.584266+0000","last_unstale":"2024-04-26T07:52:09.843830+0000","last_undegraded":"2024-04-26T07:52:09.843830+0000","last_fullsized":"2024-04-26T07:52:09.843830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:09.843553+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:09.843553+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.843553+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:33.665682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"109'4","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:34.662403+0000","last_change":"2024-04-26T07:52:34.662477+0000","last_active":"2024-04-26T07:52:34.662403+0000","last_peered":"2024-04-26T07:52:34.662403+0000","last_clean":"2024-04-26T07:52:34.662403+0000","last_became_active":"2024-04-26T07:48:31.597889+0000","last_became_peered":"2024-04-26T07:48:31.597889+0000","last_unstale":"2024-04-26T07:52:34.662403+0000","last_undegraded":"2024-04-26T07:52:34.662403+0000","last_fullsized":"2024-04-26T07:52:34.662403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'4","last_scrub_stamp":"2024-04-26T07:52:34.662209+0000","last_deep_scrub":"109'4","last_deep_scrub_stamp":"2024-04-26T07:52:34.662209+0000","last_clean_scrub_stamp":"2024-04-26T07:52:34.662209+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.132903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"59'14","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.399953+0000","last_change":"2024-04-26T07:52:27.399953+0000","last_active":"2024-04-26T07:52:27.399953+0000","last_peered":"2024-04-26T07:52:27.399953+0000","last_clean":"2024-04-26T07:52:27.399953+0000","last_became_active":"2024-04-26T07:48:23.520771+0000","last_became_peered":"2024-04-26T07:48:23.520771+0000","last_unstale":"2024-04-26T07:52:27.399953+0000","last_undegraded":"2024-04-26T07:52:27.399953+0000","last_fullsized":"2024-04-26T07:52:27.399953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'14","last_scrub_stamp":"2024-04-26T07:52:27.399672+0000","last_deep_scrub":"59'14","last_deep_scrub_stamp":"2024-04-26T07:52:27.399672+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.399672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:22.697483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"109'42","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.546500+0000","last_change":"2024-04-26T07:52:26.546500+0000","last_active":"2024-04-26T07:52:26.546500+0000","last_peered":"2024-04-26T07:52:26.546500+0000","last_clean":"2024-04-26T07:52:26.546500+0000","last_became_active":"2024-04-26T07:48:21.501889+0000","last_became_peered":"2024-04-26T07:48:21.501889+0000","last_unstale":"2024-04-26T07:52:26.546500+0000","last_undegraded":"2024-04-26T07:52:26.546500+0000","last_fullsized":"2024-04-26T07:52:26.546500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:26.546234+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:26.546234+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.546234+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:41.241271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.830671+0000","last_change":"2024-04-26T07:52:11.830671+0000","last_active":"2024-04-26T07:52:11.830671+0000","last_peered":"2024-04-26T07:52:11.830671+0000","last_clean":"2024-04-26T07:52:11.830671+0000","last_became_active":"2024-04-26T07:48:15.454616+0000","last_became_peered":"2024-04-26T07:48:15.454616+0000","last_unstale":"2024-04-26T07:52:11.830671+0000","last_undegraded":"2024-04-26T07:52:11.830671+0000","last_fullsized":"2024-04-26T07:52:11.830671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.830410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.830410+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.830410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:08.945514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"109'2","reported_seq":288,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.791701+0000","last_change":"2024-04-26T07:52:21.791701+0000","last_active":"2024-04-26T07:52:21.791701+0000","last_peered":"2024-04-26T07:52:21.791701+0000","last_clean":"2024-04-26T07:52:21.791701+0000","last_became_active":"2024-04-26T07:48:25.562712+0000","last_became_peered":"2024-04-26T07:48:25.562712+0000","last_unstale":"2024-04-26T07:52:21.791701+0000","last_undegraded":"2024-04-26T07:52:21.791701+0000","last_fullsized":"2024-04-26T07:52:21.791701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:21.791394+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:21.791394+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.791394+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:17.546280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"109'59","reported_seq":231,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.190962+0000","last_change":"2024-04-26T07:52:22.190962+0000","last_active":"2024-04-26T07:52:22.190962+0000","last_peered":"2024-04-26T07:52:22.190962+0000","last_clean":"2024-04-26T07:52:22.190962+0000","last_became_active":"2024-04-26T07:51:40.418680+0000","last_became_peered":"2024-04-26T07:51:40.418680+0000","last_unstale":"2024-04-26T07:52:22.190962+0000","last_undegraded":"2024-04-26T07:52:22.190962+0000","last_fullsized":"2024-04-26T07:52:22.190962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'59","last_scrub_stamp":"2024-04-26T07:52:22.190664+0000","last_deep_scrub":"109'59","last_deep_scrub_stamp":"2024-04-26T07:52:22.190664+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.190664+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:36.885701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":166,"num_write":32,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.864385+0000","last_change":"2024-04-26T07:52:02.864385+0000","last_active":"2024-04-26T07:52:02.864385+0000","last_peered":"2024-04-26T07:52:02.864385+0000","last_clean":"2024-04-26T07:52:02.864385+0000","last_became_active":"2024-04-26T07:48:29.576020+0000","last_became_peered":"2024-04-26T07:48:29.576020+0000","last_unstale":"2024-04-26T07:52:02.864385+0000","last_undegraded":"2024-04-26T07:52:02.864385+0000","last_fullsized":"2024-04-26T07:52:02.864385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:02.864165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:02.864165+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.864165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:34.200900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"80'4","reported_seq":188,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:37.941926+0000","last_change":"2024-04-26T07:52:37.941989+0000","last_active":"2024-04-26T07:52:37.941926+0000","last_peered":"2024-04-26T07:52:37.941926+0000","last_clean":"2024-04-26T07:52:37.941926+0000","last_became_active":"2024-04-26T07:48:31.595445+0000","last_became_peered":"2024-04-26T07:48:31.595445+0000","last_unstale":"2024-04-26T07:52:37.941926+0000","last_undegraded":"2024-04-26T07:52:37.941926+0000","last_fullsized":"2024-04-26T07:52:37.941926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:37.941715+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:37.941715+0000","last_clean_scrub_stamp":"2024-04-26T07:52:37.941715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:39.558086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.694541+0000","last_change":"2024-04-26T07:52:35.694541+0000","last_active":"2024-04-26T07:52:35.694541+0000","last_peered":"2024-04-26T07:52:35.694541+0000","last_clean":"2024-04-26T07:52:35.694541+0000","last_became_active":"2024-04-26T07:48:31.609603+0000","last_became_peered":"2024-04-26T07:48:31.609603+0000","last_unstale":"2024-04-26T07:52:35.694541+0000","last_undegraded":"2024-04-26T07:52:35.694541+0000","last_fullsized":"2024-04-26T07:52:35.694541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:35.694290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:35.694290+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.694290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:51.155366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'6","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.410949+0000","last_change":"2024-04-26T07:52:09.411013+0000","last_active":"2024-04-26T07:52:09.410949+0000","last_peered":"2024-04-26T07:52:09.410949+0000","last_clean":"2024-04-26T07:52:09.410949+0000","last_became_active":"2024-04-26T07:48:23.538951+0000","last_became_peered":"2024-04-26T07:48:23.538951+0000","last_unstale":"2024-04-26T07:52:09.410949+0000","last_undegraded":"2024-04-26T07:52:09.410949+0000","last_fullsized":"2024-04-26T07:52:09.410949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'6","last_scrub_stamp":"2024-04-26T07:52:09.410717+0000","last_deep_scrub":"55'6","last_deep_scrub_stamp":"2024-04-26T07:52:09.410717+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.410717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:06.622624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"109'62","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.351595+0000","last_change":"2024-04-26T07:52:26.351658+0000","last_active":"2024-04-26T07:52:26.351595+0000","last_peered":"2024-04-26T07:52:26.351595+0000","last_clean":"2024-04-26T07:52:26.351595+0000","last_became_active":"2024-04-26T07:48:21.525818+0000","last_became_peered":"2024-04-26T07:48:21.525818+0000","last_unstale":"2024-04-26T07:52:26.351595+0000","last_undegraded":"2024-04-26T07:52:26.351595+0000","last_fullsized":"2024-04-26T07:52:26.351595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'62","last_scrub_stamp":"2024-04-26T07:52:26.351387+0000","last_deep_scrub":"109'62","last_deep_scrub_stamp":"2024-04-26T07:52:26.351387+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.351387+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.327230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.609035+0000","last_change":"2024-04-26T07:52:01.609059+0000","last_active":"2024-04-26T07:52:01.609035+0000","last_peered":"2024-04-26T07:52:01.609035+0000","last_clean":"2024-04-26T07:52:01.609035+0000","last_became_active":"2024-04-26T07:48:25.567732+0000","last_became_peered":"2024-04-26T07:48:25.567732+0000","last_unstale":"2024-04-26T07:52:01.609035+0000","last_undegraded":"2024-04-26T07:52:01.609035+0000","last_fullsized":"2024-04-26T07:52:01.609035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.608926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.608926+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.608926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:17.404013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"109'26","reported_seq":228,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.842931+0000","last_change":"2024-04-26T07:52:08.843013+0000","last_active":"2024-04-26T07:52:08.842931+0000","last_peered":"2024-04-26T07:52:08.842931+0000","last_clean":"2024-04-26T07:52:08.842931+0000","last_became_active":"2024-04-26T07:48:27.572714+0000","last_became_peered":"2024-04-26T07:48:27.572714+0000","last_unstale":"2024-04-26T07:52:08.842931+0000","last_undegraded":"2024-04-26T07:52:08.842931+0000","last_fullsized":"2024-04-26T07:52:08.842931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'26","last_scrub_stamp":"2024-04-26T07:52:08.842689+0000","last_deep_scrub":"109'26","last_deep_scrub_stamp":"2024-04-26T07:52:08.842689+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.842689+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:34.215975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.801116+0000","last_change":"2024-04-26T07:52:05.801172+0000","last_active":"2024-04-26T07:52:05.801116+0000","last_peered":"2024-04-26T07:52:05.801116+0000","last_clean":"2024-04-26T07:52:05.801116+0000","last_became_active":"2024-04-26T07:48:29.584310+0000","last_became_peered":"2024-04-26T07:48:29.584310+0000","last_unstale":"2024-04-26T07:52:05.801116+0000","last_undegraded":"2024-04-26T07:52:05.801116+0000","last_fullsized":"2024-04-26T07:52:05.801116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.800909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.800909+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.800909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.438432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"90'4","reported_seq":189,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:37.768001+0000","last_change":"2024-04-26T07:52:37.768069+0000","last_active":"2024-04-26T07:52:37.768001+0000","last_peered":"2024-04-26T07:52:37.768001+0000","last_clean":"2024-04-26T07:52:37.768001+0000","last_became_active":"2024-04-26T07:48:31.592128+0000","last_became_peered":"2024-04-26T07:48:31.592128+0000","last_unstale":"2024-04-26T07:52:37.768001+0000","last_undegraded":"2024-04-26T07:52:37.768001+0000","last_fullsized":"2024-04-26T07:52:37.768001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-04-26T07:52:37.767794+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-04-26T07:52:37.767794+0000","last_clean_scrub_stamp":"2024-04-26T07:52:37.767794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:56.941196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.542531+0000","last_change":"2024-04-26T07:52:04.542583+0000","last_active":"2024-04-26T07:52:04.542531+0000","last_peered":"2024-04-26T07:52:04.542531+0000","last_clean":"2024-04-26T07:52:04.542531+0000","last_became_active":"2024-04-26T07:48:23.552031+0000","last_became_peered":"2024-04-26T07:48:23.552031+0000","last_unstale":"2024-04-26T07:52:04.542531+0000","last_undegraded":"2024-04-26T07:52:04.542531+0000","last_fullsized":"2024-04-26T07:52:04.542531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:04.542332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:04.542332+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.542332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:50.968092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"109'36","reported_seq":202,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.249182+0000","last_change":"2024-04-26T07:52:32.249246+0000","last_active":"2024-04-26T07:52:32.249182+0000","last_peered":"2024-04-26T07:52:32.249182+0000","last_clean":"2024-04-26T07:52:32.249182+0000","last_became_active":"2024-04-26T07:51:40.444446+0000","last_became_peered":"2024-04-26T07:51:40.444446+0000","last_unstale":"2024-04-26T07:52:32.249182+0000","last_undegraded":"2024-04-26T07:52:32.249182+0000","last_fullsized":"2024-04-26T07:52:32.249182+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:32.248958+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:32.248958+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.248958+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:53.203526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"109'2","reported_seq":287,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.787650+0000","last_change":"2024-04-26T07:52:19.787760+0000","last_active":"2024-04-26T07:52:19.787650+0000","last_peered":"2024-04-26T07:52:19.787650+0000","last_clean":"2024-04-26T07:52:19.787650+0000","last_became_active":"2024-04-26T07:48:25.560010+0000","last_became_peered":"2024-04-26T07:48:25.560010+0000","last_unstale":"2024-04-26T07:52:19.787650+0000","last_undegraded":"2024-04-26T07:52:19.787650+0000","last_fullsized":"2024-04-26T07:52:19.787650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:19.787423+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:19.787423+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.787423+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:18.505718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"109'13","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.604202+0000","last_change":"2024-04-26T07:52:15.604331+0000","last_active":"2024-04-26T07:52:15.604202+0000","last_peered":"2024-04-26T07:52:15.604202+0000","last_clean":"2024-04-26T07:52:15.604202+0000","last_became_active":"2024-04-26T07:48:27.570268+0000","last_became_peered":"2024-04-26T07:48:27.570268+0000","last_unstale":"2024-04-26T07:52:15.604202+0000","last_undegraded":"2024-04-26T07:52:15.604202+0000","last_fullsized":"2024-04-26T07:52:15.604202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'13","last_scrub_stamp":"2024-04-26T07:52:15.603892+0000","last_deep_scrub":"109'13","last_deep_scrub_stamp":"2024-04-26T07:52:15.603892+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.603892+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:39.721417+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.261783+0000","last_change":"2024-04-26T07:52:16.261836+0000","last_active":"2024-04-26T07:52:16.261783+0000","last_peered":"2024-04-26T07:52:16.261783+0000","last_clean":"2024-04-26T07:52:16.261783+0000","last_became_active":"2024-04-26T07:51:40.431762+0000","last_became_peered":"2024-04-26T07:51:40.431762+0000","last_unstale":"2024-04-26T07:52:16.261783+0000","last_undegraded":"2024-04-26T07:52:16.261783+0000","last_fullsized":"2024-04-26T07:52:16.261783+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:16.261572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:16.261572+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.261572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:21.754727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.578145+0000","last_change":"2024-04-26T07:52:32.578200+0000","last_active":"2024-04-26T07:52:32.578145+0000","last_peered":"2024-04-26T07:52:32.578145+0000","last_clean":"2024-04-26T07:52:32.578145+0000","last_became_active":"2024-04-26T07:48:31.593468+0000","last_became_peered":"2024-04-26T07:48:31.593468+0000","last_unstale":"2024-04-26T07:52:32.578145+0000","last_undegraded":"2024-04-26T07:52:32.578145+0000","last_fullsized":"2024-04-26T07:52:32.578145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:32.577954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:32.577954+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.577954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:54.651293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"90'6","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.815325+0000","last_change":"2024-04-26T07:52:11.815393+0000","last_active":"2024-04-26T07:52:11.815325+0000","last_peered":"2024-04-26T07:52:11.815325+0000","last_clean":"2024-04-26T07:52:11.815325+0000","last_became_active":"2024-04-26T07:48:23.546632+0000","last_became_peered":"2024-04-26T07:48:23.546632+0000","last_unstale":"2024-04-26T07:52:11.815325+0000","last_undegraded":"2024-04-26T07:52:11.815325+0000","last_fullsized":"2024-04-26T07:52:11.815325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-04-26T07:52:11.815117+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-04-26T07:52:11.815117+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.815117+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:59.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"109'48","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:20.110289+0000","last_change":"2024-04-26T07:52:20.110354+0000","last_active":"2024-04-26T07:52:20.110289+0000","last_peered":"2024-04-26T07:52:20.110289+0000","last_clean":"2024-04-26T07:52:20.110289+0000","last_became_active":"2024-04-26T07:48:21.517302+0000","last_became_peered":"2024-04-26T07:48:21.517302+0000","last_unstale":"2024-04-26T07:52:20.110289+0000","last_undegraded":"2024-04-26T07:52:20.110289+0000","last_fullsized":"2024-04-26T07:52:20.110289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:20.110061+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:20.110061+0000","last_clean_scrub_stamp":"2024-04-26T07:52:20.110061+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:36.586705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.036487+0000","last_change":"2024-04-26T07:52:03.036548+0000","last_active":"2024-04-26T07:52:03.036487+0000","last_peered":"2024-04-26T07:52:03.036487+0000","last_clean":"2024-04-26T07:52:03.036487+0000","last_became_active":"2024-04-26T07:51:40.439845+0000","last_became_peered":"2024-04-26T07:51:40.439845+0000","last_unstale":"2024-04-26T07:52:03.036487+0000","last_undegraded":"2024-04-26T07:52:03.036487+0000","last_fullsized":"2024-04-26T07:52:03.036487+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:03.036278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:03.036278+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.036278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:14.765411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"109'27","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.818099+0000","last_change":"2024-04-26T07:52:10.818173+0000","last_active":"2024-04-26T07:52:10.818099+0000","last_peered":"2024-04-26T07:52:10.818099+0000","last_clean":"2024-04-26T07:52:10.818099+0000","last_became_active":"2024-04-26T07:48:27.572289+0000","last_became_peered":"2024-04-26T07:48:27.572289+0000","last_unstale":"2024-04-26T07:52:10.818099+0000","last_undegraded":"2024-04-26T07:52:10.818099+0000","last_fullsized":"2024-04-26T07:52:10.818099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'27","last_scrub_stamp":"2024-04-26T07:52:10.817912+0000","last_deep_scrub":"109'27","last_deep_scrub_stamp":"2024-04-26T07:52:10.817912+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.817912+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:51.319828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.855914+0000","last_change":"2024-04-26T07:52:22.855974+0000","last_active":"2024-04-26T07:52:22.855914+0000","last_peered":"2024-04-26T07:52:22.855914+0000","last_clean":"2024-04-26T07:52:22.855914+0000","last_became_active":"2024-04-26T07:48:29.598871+0000","last_became_peered":"2024-04-26T07:48:29.598871+0000","last_unstale":"2024-04-26T07:52:22.855914+0000","last_undegraded":"2024-04-26T07:52:22.855914+0000","last_fullsized":"2024-04-26T07:52:22.855914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:22.855672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:22.855672+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.855672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:20.608407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"54'2","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.913302+0000","last_change":"2024-04-26T07:52:35.913442+0000","last_active":"2024-04-26T07:52:35.913302+0000","last_peered":"2024-04-26T07:52:35.913302+0000","last_clean":"2024-04-26T07:52:35.913302+0000","last_became_active":"2024-04-26T07:48:31.595370+0000","last_became_peered":"2024-04-26T07:48:31.595370+0000","last_unstale":"2024-04-26T07:52:35.913302+0000","last_undegraded":"2024-04-26T07:52:35.913302+0000","last_fullsized":"2024-04-26T07:52:35.913302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:35.913056+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:35.913056+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.913056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:54.452517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.831172+0000","last_change":"2024-04-26T07:52:14.831324+0000","last_active":"2024-04-26T07:52:14.831172+0000","last_peered":"2024-04-26T07:52:14.831172+0000","last_clean":"2024-04-26T07:52:14.831172+0000","last_became_active":"2024-04-26T07:48:23.541178+0000","last_became_peered":"2024-04-26T07:48:23.541178+0000","last_unstale":"2024-04-26T07:52:14.831172+0000","last_undegraded":"2024-04-26T07:52:14.831172+0000","last_fullsized":"2024-04-26T07:52:14.831172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:14.830852+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:14.830852+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.830852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:05.451081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"109'50","reported_seq":250,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.600145+0000","last_change":"2024-04-26T07:52:29.600210+0000","last_active":"2024-04-26T07:52:29.600145+0000","last_peered":"2024-04-26T07:52:29.600145+0000","last_clean":"2024-04-26T07:52:29.600145+0000","last_became_active":"2024-04-26T07:48:21.505675+0000","last_became_peered":"2024-04-26T07:48:21.505675+0000","last_unstale":"2024-04-26T07:52:29.600145+0000","last_undegraded":"2024-04-26T07:52:29.600145+0000","last_fullsized":"2024-04-26T07:52:29.600145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:29.599953+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:29.599953+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.599953+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:48.139414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.775643+0000","last_change":"2024-04-26T07:52:07.775698+0000","last_active":"2024-04-26T07:52:07.775643+0000","last_peered":"2024-04-26T07:52:07.775643+0000","last_clean":"2024-04-26T07:52:07.775643+0000","last_became_active":"2024-04-26T07:48:25.572652+0000","last_became_peered":"2024-04-26T07:48:25.572652+0000","last_unstale":"2024-04-26T07:52:07.775643+0000","last_undegraded":"2024-04-26T07:52:07.775643+0000","last_fullsized":"2024-04-26T07:52:07.775643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:07.775411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:07.775411+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.775411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:23.570498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"109'24","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.194249+0000","last_change":"2024-04-26T07:52:21.194383+0000","last_active":"2024-04-26T07:52:21.194249+0000","last_peered":"2024-04-26T07:52:21.194249+0000","last_clean":"2024-04-26T07:52:21.194249+0000","last_became_active":"2024-04-26T07:51:40.417916+0000","last_became_peered":"2024-04-26T07:51:40.417916+0000","last_unstale":"2024-04-26T07:52:21.194249+0000","last_undegraded":"2024-04-26T07:52:21.194249+0000","last_fullsized":"2024-04-26T07:52:21.194249+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'24","last_scrub_stamp":"2024-04-26T07:52:21.194026+0000","last_deep_scrub":"109'24","last_deep_scrub_stamp":"2024-04-26T07:52:21.194026+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.194026+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:25.636433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:01.713395+0000","last_change":"2024-04-26T07:52:01.713436+0000","last_active":"2024-04-26T07:52:01.713395+0000","last_peered":"2024-04-26T07:52:01.713395+0000","last_clean":"2024-04-26T07:52:01.713395+0000","last_became_active":"2024-04-26T07:48:29.603849+0000","last_became_peered":"2024-04-26T07:48:29.603849+0000","last_unstale":"2024-04-26T07:52:01.713395+0000","last_undegraded":"2024-04-26T07:52:01.713395+0000","last_fullsized":"2024-04-26T07:52:01.713395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:01.713273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:01.713273+0000","last_clean_scrub_stamp":"2024-04-26T07:52:01.713273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:06.135446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"54'4","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.827505+0000","last_change":"2024-04-26T07:52:04.827505+0000","last_active":"2024-04-26T07:52:04.827505+0000","last_peered":"2024-04-26T07:52:04.827505+0000","last_clean":"2024-04-26T07:52:04.827505+0000","last_became_active":"2024-04-26T07:48:23.545810+0000","last_became_peered":"2024-04-26T07:48:23.545810+0000","last_unstale":"2024-04-26T07:52:04.827505+0000","last_undegraded":"2024-04-26T07:52:04.827505+0000","last_fullsized":"2024-04-26T07:52:04.827505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:04.827246+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:04.827246+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.827246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:51.792004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"109'46","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.750379+0000","last_change":"2024-04-26T07:52:29.750442+0000","last_active":"2024-04-26T07:52:29.750379+0000","last_peered":"2024-04-26T07:52:29.750379+0000","last_clean":"2024-04-26T07:52:29.750379+0000","last_became_active":"2024-04-26T07:48:21.500291+0000","last_became_peered":"2024-04-26T07:48:21.500291+0000","last_unstale":"2024-04-26T07:52:29.750379+0000","last_undegraded":"2024-04-26T07:52:29.750379+0000","last_fullsized":"2024-04-26T07:52:29.750379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:29.750175+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:29.750175+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.750175+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:48.289635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.668524+0000","last_change":"2024-04-26T07:52:11.668524+0000","last_active":"2024-04-26T07:52:11.668524+0000","last_peered":"2024-04-26T07:52:11.668524+0000","last_clean":"2024-04-26T07:52:11.668524+0000","last_became_active":"2024-04-26T07:48:25.574459+0000","last_became_peered":"2024-04-26T07:48:25.574459+0000","last_unstale":"2024-04-26T07:52:11.668524+0000","last_undegraded":"2024-04-26T07:52:11.668524+0000","last_fullsized":"2024-04-26T07:52:11.668524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:11.668272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:11.668272+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.668272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:17.018585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"109'38","reported_seq":246,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:11.527131+0000","last_change":"2024-04-26T07:52:11.527291+0000","last_active":"2024-04-26T07:52:11.527131+0000","last_peered":"2024-04-26T07:52:11.527131+0000","last_clean":"2024-04-26T07:52:11.527131+0000","last_became_active":"2024-04-26T07:48:27.581642+0000","last_became_peered":"2024-04-26T07:48:27.581642+0000","last_unstale":"2024-04-26T07:52:11.527131+0000","last_undegraded":"2024-04-26T07:52:11.527131+0000","last_fullsized":"2024-04-26T07:52:11.527131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'38","last_scrub_stamp":"2024-04-26T07:52:11.526881+0000","last_deep_scrub":"109'38","last_deep_scrub_stamp":"2024-04-26T07:52:11.526881+0000","last_clean_scrub_stamp":"2024-04-26T07:52:11.526881+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:40.166851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:32.006907+0000","last_change":"2024-04-26T07:52:32.006966+0000","last_active":"2024-04-26T07:52:32.006907+0000","last_peered":"2024-04-26T07:52:32.006907+0000","last_clean":"2024-04-26T07:52:32.006907+0000","last_became_active":"2024-04-26T07:48:29.575700+0000","last_became_peered":"2024-04-26T07:48:29.575700+0000","last_unstale":"2024-04-26T07:52:32.006907+0000","last_undegraded":"2024-04-26T07:52:32.006907+0000","last_fullsized":"2024-04-26T07:52:32.006907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:32.006711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:32.006711+0000","last_clean_scrub_stamp":"2024-04-26T07:52:32.006711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:21.492314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'3","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:39.778847+0000","last_change":"2024-04-26T07:52:39.778905+0000","last_active":"2024-04-26T07:52:39.778847+0000","last_peered":"2024-04-26T07:52:39.778847+0000","last_clean":"2024-04-26T07:52:39.778847+0000","last_became_active":"2024-04-26T07:48:31.756879+0000","last_became_peered":"2024-04-26T07:48:31.756879+0000","last_unstale":"2024-04-26T07:52:39.778847+0000","last_undegraded":"2024-04-26T07:52:39.778847+0000","last_fullsized":"2024-04-26T07:52:39.778847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3","last_scrub_stamp":"2024-04-26T07:52:39.778640+0000","last_deep_scrub":"55'3","last_deep_scrub_stamp":"2024-04-26T07:52:39.778640+0000","last_clean_scrub_stamp":"2024-04-26T07:52:39.778640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:07.393670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"90'4","reported_seq":213,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.622332+0000","last_change":"2024-04-26T07:52:07.622332+0000","last_active":"2024-04-26T07:52:07.622332+0000","last_peered":"2024-04-26T07:52:07.622332+0000","last_clean":"2024-04-26T07:52:07.622332+0000","last_became_active":"2024-04-26T07:48:23.557722+0000","last_became_peered":"2024-04-26T07:48:23.557722+0000","last_unstale":"2024-04-26T07:52:07.622332+0000","last_undegraded":"2024-04-26T07:52:07.622332+0000","last_fullsized":"2024-04-26T07:52:07.622332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-04-26T07:52:07.621942+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-04-26T07:52:07.621942+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.621942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:57.800288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"109'32","reported_seq":233,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.533271+0000","last_change":"2024-04-26T07:52:17.533339+0000","last_active":"2024-04-26T07:52:17.533271+0000","last_peered":"2024-04-26T07:52:17.533271+0000","last_clean":"2024-04-26T07:52:17.533271+0000","last_became_active":"2024-04-26T07:48:21.494448+0000","last_became_peered":"2024-04-26T07:48:21.494448+0000","last_unstale":"2024-04-26T07:52:17.533271+0000","last_undegraded":"2024-04-26T07:52:17.533271+0000","last_fullsized":"2024-04-26T07:52:17.533271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'32","last_scrub_stamp":"2024-04-26T07:52:17.533071+0000","last_deep_scrub":"109'32","last_deep_scrub_stamp":"2024-04-26T07:52:17.533071+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.533071+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:55:00.497968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.778513+0000","last_change":"2024-04-26T07:52:05.778513+0000","last_active":"2024-04-26T07:52:05.778513+0000","last_peered":"2024-04-26T07:52:05.778513+0000","last_clean":"2024-04-26T07:52:05.778513+0000","last_became_active":"2024-04-26T07:48:25.572537+0000","last_became_peered":"2024-04-26T07:48:25.572537+0000","last_unstale":"2024-04-26T07:52:05.778513+0000","last_undegraded":"2024-04-26T07:52:05.778513+0000","last_fullsized":"2024-04-26T07:52:05.778513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.778217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.778217+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.778217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.242490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"109'35","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.190484+0000","last_change":"2024-04-26T07:52:25.190575+0000","last_active":"2024-04-26T07:52:25.190484+0000","last_peered":"2024-04-26T07:52:25.190484+0000","last_clean":"2024-04-26T07:52:25.190484+0000","last_became_active":"2024-04-26T07:51:40.424476+0000","last_became_peered":"2024-04-26T07:51:40.424476+0000","last_unstale":"2024-04-26T07:52:25.190484+0000","last_undegraded":"2024-04-26T07:52:25.190484+0000","last_fullsized":"2024-04-26T07:52:25.190484+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'35","last_scrub_stamp":"2024-04-26T07:52:25.190282+0000","last_deep_scrub":"109'35","last_deep_scrub_stamp":"2024-04-26T07:52:25.190282+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.190282+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:43.729743+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:23.451897+0000","last_change":"2024-04-26T07:52:23.452045+0000","last_active":"2024-04-26T07:52:23.451897+0000","last_peered":"2024-04-26T07:52:23.451897+0000","last_clean":"2024-04-26T07:52:23.451897+0000","last_became_active":"2024-04-26T07:48:29.576214+0000","last_became_peered":"2024-04-26T07:48:29.576214+0000","last_unstale":"2024-04-26T07:52:23.451897+0000","last_undegraded":"2024-04-26T07:52:23.451897+0000","last_fullsized":"2024-04-26T07:52:23.451897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:23.451605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:23.451605+0000","last_clean_scrub_stamp":"2024-04-26T07:52:23.451605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:11.226289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":181,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.906628+0000","last_change":"2024-04-26T07:52:24.906685+0000","last_active":"2024-04-26T07:52:24.906628+0000","last_peered":"2024-04-26T07:52:24.906628+0000","last_clean":"2024-04-26T07:52:24.906628+0000","last_became_active":"2024-04-26T07:48:31.588380+0000","last_became_peered":"2024-04-26T07:48:31.588380+0000","last_unstale":"2024-04-26T07:52:24.906628+0000","last_undegraded":"2024-04-26T07:52:24.906628+0000","last_fullsized":"2024-04-26T07:52:24.906628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:24.906424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:24.906424+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.906424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:17.969687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"90'8","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.783244+0000","last_change":"2024-04-26T07:52:18.783315+0000","last_active":"2024-04-26T07:52:18.783244+0000","last_peered":"2024-04-26T07:52:18.783244+0000","last_clean":"2024-04-26T07:52:18.783244+0000","last_became_active":"2024-04-26T07:48:23.534285+0000","last_became_peered":"2024-04-26T07:48:23.534285+0000","last_unstale":"2024-04-26T07:52:18.783244+0000","last_undegraded":"2024-04-26T07:52:18.783244+0000","last_fullsized":"2024-04-26T07:52:18.783244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'8","last_scrub_stamp":"2024-04-26T07:52:18.783017+0000","last_deep_scrub":"90'8","last_deep_scrub_stamp":"2024-04-26T07:52:18.783017+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.783017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:06:19.426323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"109'62","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.313312+0000","last_change":"2024-04-26T07:52:22.313488+0000","last_active":"2024-04-26T07:52:22.313312+0000","last_peered":"2024-04-26T07:52:22.313312+0000","last_clean":"2024-04-26T07:52:22.313312+0000","last_became_active":"2024-04-26T07:48:21.493821+0000","last_became_peered":"2024-04-26T07:48:21.493821+0000","last_unstale":"2024-04-26T07:52:22.313312+0000","last_undegraded":"2024-04-26T07:52:22.313312+0000","last_fullsized":"2024-04-26T07:52:22.313312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'62","last_scrub_stamp":"2024-04-26T07:52:22.313084+0000","last_deep_scrub":"109'62","last_deep_scrub_stamp":"2024-04-26T07:52:22.313084+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.313084+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:38.066481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.367629+0000","last_change":"2024-04-26T07:52:18.367686+0000","last_active":"2024-04-26T07:52:18.367629+0000","last_peered":"2024-04-26T07:52:18.367629+0000","last_clean":"2024-04-26T07:52:18.367629+0000","last_became_active":"2024-04-26T07:48:25.552983+0000","last_became_peered":"2024-04-26T07:48:25.552983+0000","last_unstale":"2024-04-26T07:52:18.367629+0000","last_undegraded":"2024-04-26T07:52:18.367629+0000","last_fullsized":"2024-04-26T07:52:18.367629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:18.367438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:18.367438+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.367438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:34.844082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"109'26","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.852009+0000","last_change":"2024-04-26T07:52:03.852009+0000","last_active":"2024-04-26T07:52:03.852009+0000","last_peered":"2024-04-26T07:52:03.852009+0000","last_clean":"2024-04-26T07:52:03.852009+0000","last_became_active":"2024-04-26T07:48:27.656230+0000","last_became_peered":"2024-04-26T07:48:27.656230+0000","last_unstale":"2024-04-26T07:52:03.852009+0000","last_undegraded":"2024-04-26T07:52:03.852009+0000","last_fullsized":"2024-04-26T07:52:03.852009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'26","last_scrub_stamp":"2024-04-26T07:52:03.851724+0000","last_deep_scrub":"109'26","last_deep_scrub_stamp":"2024-04-26T07:52:03.851724+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.851724+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:44.785331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":186,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:24.442055+0000","last_change":"2024-04-26T07:52:24.442055+0000","last_active":"2024-04-26T07:52:24.442055+0000","last_peered":"2024-04-26T07:52:24.442055+0000","last_clean":"2024-04-26T07:52:24.442055+0000","last_became_active":"2024-04-26T07:48:29.575898+0000","last_became_peered":"2024-04-26T07:48:29.575898+0000","last_unstale":"2024-04-26T07:52:24.442055+0000","last_undegraded":"2024-04-26T07:52:24.442055+0000","last_fullsized":"2024-04-26T07:52:24.442055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:24.441646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:24.441646+0000","last_clean_scrub_stamp":"2024-04-26T07:52:24.441646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:34.694275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":180,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.929505+0000","last_change":"2024-04-26T07:52:33.929574+0000","last_active":"2024-04-26T07:52:33.929505+0000","last_peered":"2024-04-26T07:52:33.929505+0000","last_clean":"2024-04-26T07:52:33.929505+0000","last_became_active":"2024-04-26T07:48:31.599504+0000","last_became_peered":"2024-04-26T07:48:31.599504+0000","last_unstale":"2024-04-26T07:52:33.929505+0000","last_undegraded":"2024-04-26T07:52:33.929505+0000","last_fullsized":"2024-04-26T07:52:33.929505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:33.929225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:33.929225+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.929225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:53.758867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"59'6","reported_seq":224,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.296636+0000","last_change":"2024-04-26T07:52:10.296697+0000","last_active":"2024-04-26T07:52:10.296636+0000","last_peered":"2024-04-26T07:52:10.296636+0000","last_clean":"2024-04-26T07:52:10.296636+0000","last_became_active":"2024-04-26T07:48:23.535256+0000","last_became_peered":"2024-04-26T07:48:23.535256+0000","last_unstale":"2024-04-26T07:52:10.296636+0000","last_undegraded":"2024-04-26T07:52:10.296636+0000","last_fullsized":"2024-04-26T07:52:10.296636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-04-26T07:52:10.296422+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-04-26T07:52:10.296422+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.296422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:34.609000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"109'36","reported_seq":236,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:28.558554+0000","last_change":"2024-04-26T07:52:28.558640+0000","last_active":"2024-04-26T07:52:28.558554+0000","last_peered":"2024-04-26T07:52:28.558554+0000","last_clean":"2024-04-26T07:52:28.558554+0000","last_became_active":"2024-04-26T07:48:21.501541+0000","last_became_peered":"2024-04-26T07:48:21.501541+0000","last_unstale":"2024-04-26T07:52:28.558554+0000","last_undegraded":"2024-04-26T07:52:28.558554+0000","last_fullsized":"2024-04-26T07:52:28.558554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:28.558333+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:28.558333+0000","last_clean_scrub_stamp":"2024-04-26T07:52:28.558333+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.140829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.550280+0000","last_change":"2024-04-26T07:52:05.550332+0000","last_active":"2024-04-26T07:52:05.550280+0000","last_peered":"2024-04-26T07:52:05.550280+0000","last_clean":"2024-04-26T07:52:05.550280+0000","last_became_active":"2024-04-26T07:48:25.568981+0000","last_became_peered":"2024-04-26T07:48:25.568981+0000","last_unstale":"2024-04-26T07:52:05.550280+0000","last_undegraded":"2024-04-26T07:52:05.550280+0000","last_fullsized":"2024-04-26T07:52:05.550280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:05.550072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:05.550072+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.550072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:50:02.665176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"109'15","reported_seq":210,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:04.465783+0000","last_change":"2024-04-26T07:52:04.465783+0000","last_active":"2024-04-26T07:52:04.465783+0000","last_peered":"2024-04-26T07:52:04.465783+0000","last_clean":"2024-04-26T07:52:04.465783+0000","last_became_active":"2024-04-26T07:48:27.651119+0000","last_became_peered":"2024-04-26T07:48:27.651119+0000","last_unstale":"2024-04-26T07:52:04.465783+0000","last_undegraded":"2024-04-26T07:52:04.465783+0000","last_fullsized":"2024-04-26T07:52:04.465783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'15","last_scrub_stamp":"2024-04-26T07:52:04.465500+0000","last_deep_scrub":"109'15","last_deep_scrub_stamp":"2024-04-26T07:52:04.465500+0000","last_clean_scrub_stamp":"2024-04-26T07:52:04.465500+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:13.082281+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"109'138","reported_seq":442,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.803732+0000","last_change":"2024-04-26T07:52:09.803732+0000","last_active":"2024-04-26T07:52:09.803732+0000","last_peered":"2024-04-26T07:52:09.803732+0000","last_clean":"2024-04-26T07:52:09.803732+0000","last_became_active":"2024-04-26T07:48:29.570856+0000","last_became_peered":"2024-04-26T07:48:29.570856+0000","last_unstale":"2024-04-26T07:52:09.803732+0000","last_undegraded":"2024-04-26T07:52:09.803732+0000","last_fullsized":"2024-04-26T07:52:09.803732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'138","last_scrub_stamp":"2024-04-26T07:52:09.803458+0000","last_deep_scrub":"109'138","last_deep_scrub_stamp":"2024-04-26T07:52:09.803458+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.803458+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:53.903529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"55'5","reported_seq":145,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.122433+0000","last_change":"2024-04-26T07:52:09.122499+0000","last_active":"2024-04-26T07:52:09.122433+0000","last_peered":"2024-04-26T07:52:09.122433+0000","last_clean":"2024-04-26T07:52:09.122433+0000","last_became_active":"2024-04-26T07:51:40.436379+0000","last_became_peered":"2024-04-26T07:51:40.436379+0000","last_unstale":"2024-04-26T07:52:09.122433+0000","last_undegraded":"2024-04-26T07:52:09.122433+0000","last_fullsized":"2024-04-26T07:52:09.122433+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'5","last_scrub_stamp":"2024-04-26T07:52:09.122230+0000","last_deep_scrub":"55'5","last_deep_scrub_stamp":"2024-04-26T07:52:09.122230+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.122230+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:25.598874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"72'6","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.348878+0000","last_change":"2024-04-26T07:52:19.348938+0000","last_active":"2024-04-26T07:52:19.348878+0000","last_peered":"2024-04-26T07:52:19.348878+0000","last_clean":"2024-04-26T07:52:19.348878+0000","last_became_active":"2024-04-26T07:48:23.526553+0000","last_became_peered":"2024-04-26T07:48:23.526553+0000","last_unstale":"2024-04-26T07:52:19.348878+0000","last_undegraded":"2024-04-26T07:52:19.348878+0000","last_fullsized":"2024-04-26T07:52:19.348878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-04-26T07:52:19.348680+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-04-26T07:52:19.348680+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.348680+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:09.968909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"109'28","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.181602+0000","last_change":"2024-04-26T07:52:19.181776+0000","last_active":"2024-04-26T07:52:19.181602+0000","last_peered":"2024-04-26T07:52:19.181602+0000","last_clean":"2024-04-26T07:52:19.181602+0000","last_became_active":"2024-04-26T07:49:08.973730+0000","last_became_peered":"2024-04-26T07:49:08.973730+0000","last_unstale":"2024-04-26T07:52:19.181602+0000","last_undegraded":"2024-04-26T07:52:19.181602+0000","last_fullsized":"2024-04-26T07:52:19.181602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'28","last_scrub_stamp":"2024-04-26T07:52:19.181355+0000","last_deep_scrub":"109'28","last_deep_scrub_stamp":"2024-04-26T07:52:19.181355+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.181355+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:52:26.454123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":149,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.209287+0000","last_change":"2024-04-26T07:52:27.209367+0000","last_active":"2024-04-26T07:52:27.209287+0000","last_peered":"2024-04-26T07:52:27.209287+0000","last_clean":"2024-04-26T07:52:27.209287+0000","last_became_active":"2024-04-26T07:51:40.427906+0000","last_became_peered":"2024-04-26T07:51:40.427906+0000","last_unstale":"2024-04-26T07:52:27.209287+0000","last_undegraded":"2024-04-26T07:52:27.209287+0000","last_fullsized":"2024-04-26T07:52:27.209287+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:27.209071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:27.209071+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.209071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:28.825442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"109'32","reported_seq":234,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.175930+0000","last_change":"2024-04-26T07:52:03.176073+0000","last_active":"2024-04-26T07:52:03.175930+0000","last_peered":"2024-04-26T07:52:03.175930+0000","last_clean":"2024-04-26T07:52:03.175930+0000","last_became_active":"2024-04-26T07:48:27.575539+0000","last_became_peered":"2024-04-26T07:48:27.575539+0000","last_unstale":"2024-04-26T07:52:03.175930+0000","last_undegraded":"2024-04-26T07:52:03.175930+0000","last_fullsized":"2024-04-26T07:52:03.175930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'32","last_scrub_stamp":"2024-04-26T07:52:03.175641+0000","last_deep_scrub":"109'32","last_deep_scrub_stamp":"2024-04-26T07:52:03.175641+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.175641+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:24.733999+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.663317+0000","last_change":"2024-04-26T07:52:06.663476+0000","last_active":"2024-04-26T07:52:06.663317+0000","last_peered":"2024-04-26T07:52:06.663317+0000","last_clean":"2024-04-26T07:52:06.663317+0000","last_became_active":"2024-04-26T07:48:29.594916+0000","last_became_peered":"2024-04-26T07:48:29.594916+0000","last_unstale":"2024-04-26T07:52:06.663317+0000","last_undegraded":"2024-04-26T07:52:06.663317+0000","last_fullsized":"2024-04-26T07:52:06.663317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:06.663096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:06.663096+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.663096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.726359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"59'2","reported_seq":141,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.169457+0000","last_change":"2024-04-26T07:52:10.169518+0000","last_active":"2024-04-26T07:52:10.169457+0000","last_peered":"2024-04-26T07:52:10.169457+0000","last_clean":"2024-04-26T07:52:10.169457+0000","last_became_active":"2024-04-26T07:51:40.432230+0000","last_became_peered":"2024-04-26T07:51:40.432230+0000","last_unstale":"2024-04-26T07:52:10.169457+0000","last_undegraded":"2024-04-26T07:52:10.169457+0000","last_fullsized":"2024-04-26T07:52:10.169457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2024-04-26T07:52:10.169197+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.169197+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.169197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:29.864550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"54'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.431292+0000","last_change":"2024-04-26T07:52:14.431351+0000","last_active":"2024-04-26T07:52:14.431292+0000","last_peered":"2024-04-26T07:52:14.431292+0000","last_clean":"2024-04-26T07:52:14.431292+0000","last_became_active":"2024-04-26T07:48:23.544812+0000","last_became_peered":"2024-04-26T07:48:23.544812+0000","last_unstale":"2024-04-26T07:52:14.431292+0000","last_undegraded":"2024-04-26T07:52:14.431292+0000","last_fullsized":"2024-04-26T07:52:14.431292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:14.431047+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:14.431047+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.431047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:38.253176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"109'56","reported_seq":256,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.128328+0000","last_change":"2024-04-26T07:52:18.128389+0000","last_active":"2024-04-26T07:52:18.128328+0000","last_peered":"2024-04-26T07:52:18.128328+0000","last_clean":"2024-04-26T07:52:18.128328+0000","last_became_active":"2024-04-26T07:48:21.517762+0000","last_became_peered":"2024-04-26T07:48:21.517762+0000","last_unstale":"2024-04-26T07:52:18.128328+0000","last_undegraded":"2024-04-26T07:52:18.128328+0000","last_fullsized":"2024-04-26T07:52:18.128328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'56","last_scrub_stamp":"2024-04-26T07:52:18.128132+0000","last_deep_scrub":"109'56","last_deep_scrub_stamp":"2024-04-26T07:52:18.128132+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.128132+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:51.014245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":192,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.149428+0000","last_change":"2024-04-26T07:52:17.149485+0000","last_active":"2024-04-26T07:52:17.149428+0000","last_peered":"2024-04-26T07:52:17.149428+0000","last_clean":"2024-04-26T07:52:17.149428+0000","last_became_active":"2024-04-26T07:48:25.557395+0000","last_became_peered":"2024-04-26T07:48:25.557395+0000","last_unstale":"2024-04-26T07:52:17.149428+0000","last_undegraded":"2024-04-26T07:52:17.149428+0000","last_fullsized":"2024-04-26T07:52:17.149428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:17.149207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:17.149207+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.149207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:57.651124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"109'24","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.549539+0000","last_change":"2024-04-26T07:52:19.549613+0000","last_active":"2024-04-26T07:52:19.549539+0000","last_peered":"2024-04-26T07:52:19.549539+0000","last_clean":"2024-04-26T07:52:19.549539+0000","last_became_active":"2024-04-26T07:48:27.575293+0000","last_became_peered":"2024-04-26T07:48:27.575293+0000","last_unstale":"2024-04-26T07:52:19.549539+0000","last_undegraded":"2024-04-26T07:52:19.549539+0000","last_fullsized":"2024-04-26T07:52:19.549539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'24","last_scrub_stamp":"2024-04-26T07:52:19.549336+0000","last_deep_scrub":"109'24","last_deep_scrub_stamp":"2024-04-26T07:52:19.549336+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.549336+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:18.267631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:21.839783+0000","last_change":"2024-04-26T07:52:21.839893+0000","last_active":"2024-04-26T07:52:21.839783+0000","last_peered":"2024-04-26T07:52:21.839783+0000","last_clean":"2024-04-26T07:52:21.839783+0000","last_became_active":"2024-04-26T07:48:29.583274+0000","last_became_peered":"2024-04-26T07:48:29.583274+0000","last_unstale":"2024-04-26T07:52:21.839783+0000","last_undegraded":"2024-04-26T07:52:21.839783+0000","last_fullsized":"2024-04-26T07:52:21.839783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:21.839488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:21.839488+0000","last_clean_scrub_stamp":"2024-04-26T07:52:21.839488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:02.773095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:41.778135+0000","last_change":"2024-04-26T07:52:41.778229+0000","last_active":"2024-04-26T07:52:41.778135+0000","last_peered":"2024-04-26T07:52:41.778135+0000","last_clean":"2024-04-26T07:52:41.778135+0000","last_became_active":"2024-04-26T07:48:31.758771+0000","last_became_peered":"2024-04-26T07:48:31.758771+0000","last_unstale":"2024-04-26T07:52:41.778135+0000","last_undegraded":"2024-04-26T07:52:41.778135+0000","last_fullsized":"2024-04-26T07:52:41.778135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:41.777861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:41.777861+0000","last_clean_scrub_stamp":"2024-04-26T07:52:41.777861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:12.927986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"55'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.776875+0000","last_change":"2024-04-26T07:52:22.776940+0000","last_active":"2024-04-26T07:52:22.776875+0000","last_peered":"2024-04-26T07:52:22.776875+0000","last_clean":"2024-04-26T07:52:22.776875+0000","last_became_active":"2024-04-26T07:48:23.521354+0000","last_became_peered":"2024-04-26T07:48:23.521354+0000","last_unstale":"2024-04-26T07:52:22.776875+0000","last_undegraded":"2024-04-26T07:52:22.776875+0000","last_fullsized":"2024-04-26T07:52:22.776875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:22.776639+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:22.776639+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.776639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:18:58.942466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"109'52","reported_seq":197,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.219981+0000","last_change":"2024-04-26T07:52:18.220125+0000","last_active":"2024-04-26T07:52:18.219981+0000","last_peered":"2024-04-26T07:52:18.219981+0000","last_clean":"2024-04-26T07:52:18.219981+0000","last_became_active":"2024-04-26T07:49:08.970883+0000","last_became_peered":"2024-04-26T07:49:08.970883+0000","last_unstale":"2024-04-26T07:52:18.219981+0000","last_undegraded":"2024-04-26T07:52:18.219981+0000","last_fullsized":"2024-04-26T07:52:18.219981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:18.219694+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:18.219694+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.219694+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:18.955859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.348016+0000","last_change":"2024-04-26T07:52:30.348070+0000","last_active":"2024-04-26T07:52:30.348016+0000","last_peered":"2024-04-26T07:52:30.348016+0000","last_clean":"2024-04-26T07:52:30.348016+0000","last_became_active":"2024-04-26T07:48:25.569242+0000","last_became_peered":"2024-04-26T07:48:25.569242+0000","last_unstale":"2024-04-26T07:52:30.348016+0000","last_undegraded":"2024-04-26T07:52:30.348016+0000","last_fullsized":"2024-04-26T07:52:30.348016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:30.347828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:30.347828+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.347828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:45.042865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"109'17","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.877700+0000","last_change":"2024-04-26T07:52:07.877769+0000","last_active":"2024-04-26T07:52:07.877700+0000","last_peered":"2024-04-26T07:52:07.877700+0000","last_clean":"2024-04-26T07:52:07.877700+0000","last_became_active":"2024-04-26T07:48:27.578437+0000","last_became_peered":"2024-04-26T07:48:27.578437+0000","last_unstale":"2024-04-26T07:52:07.877700+0000","last_undegraded":"2024-04-26T07:52:07.877700+0000","last_fullsized":"2024-04-26T07:52:07.877700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'17","last_scrub_stamp":"2024-04-26T07:52:07.877498+0000","last_deep_scrub":"109'17","last_deep_scrub_stamp":"2024-04-26T07:52:07.877498+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.877498+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:19.606631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":185,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.299330+0000","last_change":"2024-04-26T07:52:31.299388+0000","last_active":"2024-04-26T07:52:31.299330+0000","last_peered":"2024-04-26T07:52:31.299330+0000","last_clean":"2024-04-26T07:52:31.299330+0000","last_became_active":"2024-04-26T07:48:29.571463+0000","last_became_peered":"2024-04-26T07:48:29.571463+0000","last_unstale":"2024-04-26T07:52:31.299330+0000","last_undegraded":"2024-04-26T07:52:31.299330+0000","last_fullsized":"2024-04-26T07:52:31.299330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:31.299105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:31.299105+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.299105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:51.128748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":137,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:31.212030+0000","last_change":"2024-04-26T07:52:31.212086+0000","last_active":"2024-04-26T07:52:31.212030+0000","last_peered":"2024-04-26T07:52:31.212030+0000","last_clean":"2024-04-26T07:52:31.212030+0000","last_became_active":"2024-04-26T07:51:40.440377+0000","last_became_peered":"2024-04-26T07:51:40.440377+0000","last_unstale":"2024-04-26T07:52:31.212030+0000","last_undegraded":"2024-04-26T07:52:31.212030+0000","last_fullsized":"2024-04-26T07:52:31.212030+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:31.211832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:31.211832+0000","last_clean_scrub_stamp":"2024-04-26T07:52:31.211832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:46.672908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"80'16","reported_seq":263,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.345522+0000","last_change":"2024-04-26T07:52:29.345580+0000","last_active":"2024-04-26T07:52:29.345522+0000","last_peered":"2024-04-26T07:52:29.345522+0000","last_clean":"2024-04-26T07:52:29.345522+0000","last_became_active":"2024-04-26T07:48:23.523797+0000","last_became_peered":"2024-04-26T07:48:23.523797+0000","last_unstale":"2024-04-26T07:52:29.345522+0000","last_undegraded":"2024-04-26T07:52:29.345522+0000","last_fullsized":"2024-04-26T07:52:29.345522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'16","last_scrub_stamp":"2024-04-26T07:52:29.345291+0000","last_deep_scrub":"80'16","last_deep_scrub_stamp":"2024-04-26T07:52:29.345291+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.345291+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:18.830895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"109'50","reported_seq":256,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:38.631321+0000","last_change":"2024-04-26T07:52:38.631509+0000","last_active":"2024-04-26T07:52:38.631321+0000","last_peered":"2024-04-26T07:52:38.631321+0000","last_clean":"2024-04-26T07:52:38.631321+0000","last_became_active":"2024-04-26T07:49:08.963778+0000","last_became_peered":"2024-04-26T07:49:08.963778+0000","last_unstale":"2024-04-26T07:52:38.631321+0000","last_undegraded":"2024-04-26T07:52:38.631321+0000","last_fullsized":"2024-04-26T07:52:38.631321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'50","last_scrub_stamp":"2024-04-26T07:52:38.631086+0000","last_deep_scrub":"109'50","last_deep_scrub_stamp":"2024-04-26T07:52:38.631086+0000","last_clean_scrub_stamp":"2024-04-26T07:52:38.631086+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:20.695785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"109'2","reported_seq":195,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:03.588924+0000","last_change":"2024-04-26T07:52:03.588987+0000","last_active":"2024-04-26T07:52:03.588924+0000","last_peered":"2024-04-26T07:52:03.588924+0000","last_clean":"2024-04-26T07:52:03.588924+0000","last_became_active":"2024-04-26T07:48:25.567953+0000","last_became_peered":"2024-04-26T07:48:25.567953+0000","last_unstale":"2024-04-26T07:52:03.588924+0000","last_undegraded":"2024-04-26T07:52:03.588924+0000","last_fullsized":"2024-04-26T07:52:03.588924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'2","last_scrub_stamp":"2024-04-26T07:52:03.588732+0000","last_deep_scrub":"109'2","last_deep_scrub_stamp":"2024-04-26T07:52:03.588732+0000","last_clean_scrub_stamp":"2024-04-26T07:52:03.588732+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:47.688802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"109'23","reported_seq":223,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.495785+0000","last_change":"2024-04-26T07:52:02.495868+0000","last_active":"2024-04-26T07:52:02.495785+0000","last_peered":"2024-04-26T07:52:02.495785+0000","last_clean":"2024-04-26T07:52:02.495785+0000","last_became_active":"2024-04-26T07:48:27.567906+0000","last_became_peered":"2024-04-26T07:48:27.567906+0000","last_unstale":"2024-04-26T07:52:02.495785+0000","last_undegraded":"2024-04-26T07:52:02.495785+0000","last_fullsized":"2024-04-26T07:52:02.495785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'23","last_scrub_stamp":"2024-04-26T07:52:02.495366+0000","last_deep_scrub":"109'23","last_deep_scrub_stamp":"2024-04-26T07:52:02.495366+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.495366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:59:24.053723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:51:59.667741+0000","last_change":"2024-04-26T07:51:59.667797+0000","last_active":"2024-04-26T07:51:59.667741+0000","last_peered":"2024-04-26T07:51:59.667741+0000","last_clean":"2024-04-26T07:51:59.667741+0000","last_became_active":"2024-04-26T07:48:29.601811+0000","last_became_peered":"2024-04-26T07:48:29.601811+0000","last_unstale":"2024-04-26T07:51:59.667741+0000","last_undegraded":"2024-04-26T07:51:59.667741+0000","last_fullsized":"2024-04-26T07:51:59.667741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:51:59.667623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:51:59.667623+0000","last_clean_scrub_stamp":"2024-04-26T07:51:59.667623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:10.793974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"55'2","reported_seq":184,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:35.357238+0000","last_change":"2024-04-26T07:52:35.357300+0000","last_active":"2024-04-26T07:52:35.357238+0000","last_peered":"2024-04-26T07:52:35.357238+0000","last_clean":"2024-04-26T07:52:35.357238+0000","last_became_active":"2024-04-26T07:48:31.588584+0000","last_became_peered":"2024-04-26T07:48:31.588584+0000","last_unstale":"2024-04-26T07:52:35.357238+0000","last_undegraded":"2024-04-26T07:52:35.357238+0000","last_fullsized":"2024-04-26T07:52:35.357238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:35.357031+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:35.357031+0000","last_clean_scrub_stamp":"2024-04-26T07:52:35.357031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:36.973402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"90'10","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:02.583013+0000","last_change":"2024-04-26T07:52:02.583013+0000","last_active":"2024-04-26T07:52:02.583013+0000","last_peered":"2024-04-26T07:52:02.583013+0000","last_clean":"2024-04-26T07:52:02.583013+0000","last_became_active":"2024-04-26T07:48:23.552218+0000","last_became_peered":"2024-04-26T07:48:23.552218+0000","last_unstale":"2024-04-26T07:52:02.583013+0000","last_undegraded":"2024-04-26T07:52:02.583013+0000","last_fullsized":"2024-04-26T07:52:02.583013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'10","last_scrub_stamp":"2024-04-26T07:52:02.582912+0000","last_deep_scrub":"90'10","last_deep_scrub_stamp":"2024-04-26T07:52:02.582912+0000","last_clean_scrub_stamp":"2024-04-26T07:52:02.582912+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:19.402059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"109'42","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.910349+0000","last_change":"2024-04-26T07:52:13.910349+0000","last_active":"2024-04-26T07:52:13.910349+0000","last_peered":"2024-04-26T07:52:13.910349+0000","last_clean":"2024-04-26T07:52:13.910349+0000","last_became_active":"2024-04-26T07:48:21.504755+0000","last_became_peered":"2024-04-26T07:48:21.504755+0000","last_unstale":"2024-04-26T07:52:13.910349+0000","last_undegraded":"2024-04-26T07:52:13.910349+0000","last_fullsized":"2024-04-26T07:52:13.910349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:13.910108+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:13.910108+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.910108+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:18.858812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"55'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.548575+0000","last_change":"2024-04-26T07:52:10.548575+0000","last_active":"2024-04-26T07:52:10.548575+0000","last_peered":"2024-04-26T07:52:10.548575+0000","last_clean":"2024-04-26T07:52:10.548575+0000","last_became_active":"2024-04-26T07:48:23.534366+0000","last_became_peered":"2024-04-26T07:48:23.534366+0000","last_unstale":"2024-04-26T07:52:10.548575+0000","last_undegraded":"2024-04-26T07:52:10.548575+0000","last_fullsized":"2024-04-26T07:52:10.548575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:10.548310+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.548310+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.548310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:19.165091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"109'52","reported_seq":255,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.288845+0000","last_change":"2024-04-26T07:52:07.288845+0000","last_active":"2024-04-26T07:52:07.288845+0000","last_peered":"2024-04-26T07:52:07.288845+0000","last_clean":"2024-04-26T07:52:07.288845+0000","last_became_active":"2024-04-26T07:48:21.524115+0000","last_became_peered":"2024-04-26T07:48:21.524115+0000","last_unstale":"2024-04-26T07:52:07.288845+0000","last_undegraded":"2024-04-26T07:52:07.288845+0000","last_fullsized":"2024-04-26T07:52:07.288845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:07.288594+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:07.288594+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.288594+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:27.311783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:09.191274+0000","last_change":"2024-04-26T07:52:09.191274+0000","last_active":"2024-04-26T07:52:09.191274+0000","last_peered":"2024-04-26T07:52:09.191274+0000","last_clean":"2024-04-26T07:52:09.191274+0000","last_became_active":"2024-04-26T07:48:23.549440+0000","last_became_peered":"2024-04-26T07:48:23.549440+0000","last_unstale":"2024-04-26T07:52:09.191274+0000","last_undegraded":"2024-04-26T07:52:09.191274+0000","last_fullsized":"2024-04-26T07:52:09.191274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:09.190998+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:09.190998+0000","last_clean_scrub_stamp":"2024-04-26T07:52:09.190998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:40.527734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"109'36","reported_seq":237,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.041761+0000","last_change":"2024-04-26T07:52:30.041761+0000","last_active":"2024-04-26T07:52:30.041761+0000","last_peered":"2024-04-26T07:52:30.041761+0000","last_clean":"2024-04-26T07:52:30.041761+0000","last_became_active":"2024-04-26T07:48:21.514262+0000","last_became_peered":"2024-04-26T07:48:21.514262+0000","last_unstale":"2024-04-26T07:52:30.041761+0000","last_undegraded":"2024-04-26T07:52:30.041761+0000","last_fullsized":"2024-04-26T07:52:30.041761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'36","last_scrub_stamp":"2024-04-26T07:52:30.041510+0000","last_deep_scrub":"109'36","last_deep_scrub_stamp":"2024-04-26T07:52:30.041510+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.041510+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:49.618526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"80'8","reported_seq":232,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:00.652938+0000","last_change":"2024-04-26T07:52:00.652938+0000","last_active":"2024-04-26T07:52:00.652938+0000","last_peered":"2024-04-26T07:52:00.652938+0000","last_clean":"2024-04-26T07:52:00.652938+0000","last_became_active":"2024-04-26T07:48:23.557827+0000","last_became_peered":"2024-04-26T07:48:23.557827+0000","last_unstale":"2024-04-26T07:52:00.652938+0000","last_undegraded":"2024-04-26T07:52:00.652938+0000","last_fullsized":"2024-04-26T07:52:00.652938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T07:52:00.652831+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T07:52:00.652831+0000","last_clean_scrub_stamp":"2024-04-26T07:52:00.652831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:24.965409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"109'46","reported_seq":247,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.542192+0000","last_change":"2024-04-26T07:52:25.542192+0000","last_active":"2024-04-26T07:52:25.542192+0000","last_peered":"2024-04-26T07:52:25.542192+0000","last_clean":"2024-04-26T07:52:25.542192+0000","last_became_active":"2024-04-26T07:48:21.497072+0000","last_became_peered":"2024-04-26T07:48:21.497072+0000","last_unstale":"2024-04-26T07:52:25.542192+0000","last_undegraded":"2024-04-26T07:52:25.542192+0000","last_fullsized":"2024-04-26T07:52:25.542192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:25.541907+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:25.541907+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.541907+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:15.027511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":199,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.794652+0000","last_change":"2024-04-26T07:52:13.794652+0000","last_active":"2024-04-26T07:52:13.794652+0000","last_peered":"2024-04-26T07:52:13.794652+0000","last_clean":"2024-04-26T07:52:13.794652+0000","last_became_active":"2024-04-26T07:48:23.546396+0000","last_became_peered":"2024-04-26T07:48:23.546396+0000","last_unstale":"2024-04-26T07:52:13.794652+0000","last_undegraded":"2024-04-26T07:52:13.794652+0000","last_fullsized":"2024-04-26T07:52:13.794652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:13.794365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:13.794365+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.794365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:23.937209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"109'64","reported_seq":267,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:27.752602+0000","last_change":"2024-04-26T07:52:27.752602+0000","last_active":"2024-04-26T07:52:27.752602+0000","last_peered":"2024-04-26T07:52:27.752602+0000","last_clean":"2024-04-26T07:52:27.752602+0000","last_became_active":"2024-04-26T07:48:21.492280+0000","last_became_peered":"2024-04-26T07:48:21.492280+0000","last_unstale":"2024-04-26T07:52:27.752602+0000","last_undegraded":"2024-04-26T07:52:27.752602+0000","last_fullsized":"2024-04-26T07:52:27.752602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'64","last_scrub_stamp":"2024-04-26T07:52:27.752316+0000","last_deep_scrub":"109'64","last_deep_scrub_stamp":"2024-04-26T07:52:27.752316+0000","last_clean_scrub_stamp":"2024-04-26T07:52:27.752316+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:47.581959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"55'4","reported_seq":215,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:13.469047+0000","last_change":"2024-04-26T07:52:13.469047+0000","last_active":"2024-04-26T07:52:13.469047+0000","last_peered":"2024-04-26T07:52:13.469047+0000","last_clean":"2024-04-26T07:52:13.469047+0000","last_became_active":"2024-04-26T07:48:23.538105+0000","last_became_peered":"2024-04-26T07:48:23.538105+0000","last_unstale":"2024-04-26T07:52:13.469047+0000","last_undegraded":"2024-04-26T07:52:13.469047+0000","last_fullsized":"2024-04-26T07:52:13.469047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'4","last_scrub_stamp":"2024-04-26T07:52:13.468781+0000","last_deep_scrub":"55'4","last_deep_scrub_stamp":"2024-04-26T07:52:13.468781+0000","last_clean_scrub_stamp":"2024-04-26T07:52:13.468781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:38.842066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"109'70","reported_seq":272,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:19.468114+0000","last_change":"2024-04-26T07:52:19.468114+0000","last_active":"2024-04-26T07:52:19.468114+0000","last_peered":"2024-04-26T07:52:19.468114+0000","last_clean":"2024-04-26T07:52:19.468114+0000","last_became_active":"2024-04-26T07:48:21.498230+0000","last_became_peered":"2024-04-26T07:48:21.498230+0000","last_unstale":"2024-04-26T07:52:19.468114+0000","last_undegraded":"2024-04-26T07:52:19.468114+0000","last_fullsized":"2024-04-26T07:52:19.468114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'70","last_scrub_stamp":"2024-04-26T07:52:19.467859+0000","last_deep_scrub":"109'70","last_deep_scrub_stamp":"2024-04-26T07:52:19.467859+0000","last_clean_scrub_stamp":"2024-04-26T07:52:19.467859+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:09.646205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'4","reported_seq":216,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.807221+0000","last_change":"2024-04-26T07:52:16.807221+0000","last_active":"2024-04-26T07:52:16.807221+0000","last_peered":"2024-04-26T07:52:16.807221+0000","last_clean":"2024-04-26T07:52:16.807221+0000","last_became_active":"2024-04-26T07:48:23.541349+0000","last_became_peered":"2024-04-26T07:48:23.541349+0000","last_unstale":"2024-04-26T07:52:16.807221+0000","last_undegraded":"2024-04-26T07:52:16.807221+0000","last_fullsized":"2024-04-26T07:52:16.807221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-04-26T07:52:16.806813+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-04-26T07:52:16.806813+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.806813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:25.470700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"109'46","reported_seq":248,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.940350+0000","last_change":"2024-04-26T07:52:17.940350+0000","last_active":"2024-04-26T07:52:17.940350+0000","last_peered":"2024-04-26T07:52:17.940350+0000","last_clean":"2024-04-26T07:52:17.940350+0000","last_became_active":"2024-04-26T07:48:21.517014+0000","last_became_peered":"2024-04-26T07:48:21.517014+0000","last_unstale":"2024-04-26T07:52:17.940350+0000","last_undegraded":"2024-04-26T07:52:17.940350+0000","last_fullsized":"2024-04-26T07:52:17.940350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'46","last_scrub_stamp":"2024-04-26T07:52:17.940091+0000","last_deep_scrub":"109'46","last_deep_scrub_stamp":"2024-04-26T07:52:17.940091+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.940091+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:46.580061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"54'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.822917+0000","last_change":"2024-04-26T07:52:10.822917+0000","last_active":"2024-04-26T07:52:10.822917+0000","last_peered":"2024-04-26T07:52:10.822917+0000","last_clean":"2024-04-26T07:52:10.822917+0000","last_became_active":"2024-04-26T07:48:23.527873+0000","last_became_peered":"2024-04-26T07:48:23.527873+0000","last_unstale":"2024-04-26T07:52:10.822917+0000","last_undegraded":"2024-04-26T07:52:10.822917+0000","last_fullsized":"2024-04-26T07:52:10.822917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:10.822644+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:10.822644+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.822644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:57.248404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"109'58","reported_seq":261,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:33.812235+0000","last_change":"2024-04-26T07:52:33.812235+0000","last_active":"2024-04-26T07:52:33.812235+0000","last_peered":"2024-04-26T07:52:33.812235+0000","last_clean":"2024-04-26T07:52:33.812235+0000","last_became_active":"2024-04-26T07:48:21.510711+0000","last_became_peered":"2024-04-26T07:48:21.510711+0000","last_unstale":"2024-04-26T07:52:33.812235+0000","last_undegraded":"2024-04-26T07:52:33.812235+0000","last_fullsized":"2024-04-26T07:52:33.812235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:33.811940+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:33.811940+0000","last_clean_scrub_stamp":"2024-04-26T07:52:33.811940+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:01.378414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"55'2","reported_seq":204,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:08.654716+0000","last_change":"2024-04-26T07:52:08.654810+0000","last_active":"2024-04-26T07:52:08.654716+0000","last_peered":"2024-04-26T07:52:08.654716+0000","last_clean":"2024-04-26T07:52:08.654716+0000","last_became_active":"2024-04-26T07:48:23.552906+0000","last_became_peered":"2024-04-26T07:48:23.552906+0000","last_unstale":"2024-04-26T07:52:08.654716+0000","last_undegraded":"2024-04-26T07:52:08.654716+0000","last_fullsized":"2024-04-26T07:52:08.654716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:08.654501+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:08.654501+0000","last_clean_scrub_stamp":"2024-04-26T07:52:08.654501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:34:27.598040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"109'48","reported_seq":249,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:25.030096+0000","last_change":"2024-04-26T07:52:25.030096+0000","last_active":"2024-04-26T07:52:25.030096+0000","last_peered":"2024-04-26T07:52:25.030096+0000","last_clean":"2024-04-26T07:52:25.030096+0000","last_became_active":"2024-04-26T07:48:21.496965+0000","last_became_peered":"2024-04-26T07:48:21.496965+0000","last_unstale":"2024-04-26T07:52:25.030096+0000","last_undegraded":"2024-04-26T07:52:25.030096+0000","last_fullsized":"2024-04-26T07:52:25.030096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'48","last_scrub_stamp":"2024-04-26T07:52:25.029844+0000","last_deep_scrub":"109'48","last_deep_scrub_stamp":"2024-04-26T07:52:25.029844+0000","last_clean_scrub_stamp":"2024-04-26T07:52:25.029844+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:40.783241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"54'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:17.365149+0000","last_change":"2024-04-26T07:52:17.365274+0000","last_active":"2024-04-26T07:52:17.365149+0000","last_peered":"2024-04-26T07:52:17.365149+0000","last_clean":"2024-04-26T07:52:17.365149+0000","last_became_active":"2024-04-26T07:48:23.527527+0000","last_became_peered":"2024-04-26T07:48:23.527527+0000","last_unstale":"2024-04-26T07:52:17.365149+0000","last_undegraded":"2024-04-26T07:52:17.365149+0000","last_fullsized":"2024-04-26T07:52:17.365149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'2","last_scrub_stamp":"2024-04-26T07:52:17.364889+0000","last_deep_scrub":"54'2","last_deep_scrub_stamp":"2024-04-26T07:52:17.364889+0000","last_clean_scrub_stamp":"2024-04-26T07:52:17.364889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:58.867784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"109'42","reported_seq":245,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.716597+0000","last_change":"2024-04-26T07:52:26.716597+0000","last_active":"2024-04-26T07:52:26.716597+0000","last_peered":"2024-04-26T07:52:26.716597+0000","last_clean":"2024-04-26T07:52:26.716597+0000","last_became_active":"2024-04-26T07:48:21.522737+0000","last_became_peered":"2024-04-26T07:48:21.522737+0000","last_unstale":"2024-04-26T07:52:26.716597+0000","last_undegraded":"2024-04-26T07:52:26.716597+0000","last_fullsized":"2024-04-26T07:52:26.716597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:26.716177+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:26.716177+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.716177+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:41.411214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"54'8","reported_seq":221,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.281677+0000","last_change":"2024-04-26T07:52:12.281677+0000","last_active":"2024-04-26T07:52:12.281677+0000","last_peered":"2024-04-26T07:52:12.281677+0000","last_clean":"2024-04-26T07:52:12.281677+0000","last_became_active":"2024-04-26T07:48:23.549534+0000","last_became_peered":"2024-04-26T07:48:23.549534+0000","last_unstale":"2024-04-26T07:52:12.281677+0000","last_undegraded":"2024-04-26T07:52:12.281677+0000","last_fullsized":"2024-04-26T07:52:12.281677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'8","last_scrub_stamp":"2024-04-26T07:52:12.281168+0000","last_deep_scrub":"54'8","last_deep_scrub_stamp":"2024-04-26T07:52:12.281168+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.281168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:29.100315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"109'28","reported_seq":229,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:14.176145+0000","last_change":"2024-04-26T07:52:14.176145+0000","last_active":"2024-04-26T07:52:14.176145+0000","last_peered":"2024-04-26T07:52:14.176145+0000","last_clean":"2024-04-26T07:52:14.176145+0000","last_became_active":"2024-04-26T07:48:21.524915+0000","last_became_peered":"2024-04-26T07:48:21.524915+0000","last_unstale":"2024-04-26T07:52:14.176145+0000","last_undegraded":"2024-04-26T07:52:14.176145+0000","last_fullsized":"2024-04-26T07:52:14.176145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'28","last_scrub_stamp":"2024-04-26T07:52:14.175886+0000","last_deep_scrub":"109'28","last_deep_scrub_stamp":"2024-04-26T07:52:14.175886+0000","last_clean_scrub_stamp":"2024-04-26T07:52:14.175886+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:25.905019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"55'2","reported_seq":206,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.482768+0000","last_change":"2024-04-26T07:52:07.482768+0000","last_active":"2024-04-26T07:52:07.482768+0000","last_peered":"2024-04-26T07:52:07.482768+0000","last_clean":"2024-04-26T07:52:07.482768+0000","last_became_active":"2024-04-26T07:48:23.539020+0000","last_became_peered":"2024-04-26T07:48:23.539020+0000","last_unstale":"2024-04-26T07:52:07.482768+0000","last_undegraded":"2024-04-26T07:52:07.482768+0000","last_fullsized":"2024-04-26T07:52:07.482768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2024-04-26T07:52:07.482485+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2024-04-26T07:52:07.482485+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.482485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:38.819221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"109'52","reported_seq":254,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:30.636253+0000","last_change":"2024-04-26T07:52:30.636253+0000","last_active":"2024-04-26T07:52:30.636253+0000","last_peered":"2024-04-26T07:52:30.636253+0000","last_clean":"2024-04-26T07:52:30.636253+0000","last_became_active":"2024-04-26T07:48:21.518726+0000","last_became_peered":"2024-04-26T07:48:21.518726+0000","last_unstale":"2024-04-26T07:52:30.636253+0000","last_undegraded":"2024-04-26T07:52:30.636253+0000","last_fullsized":"2024-04-26T07:52:30.636253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'52","last_scrub_stamp":"2024-04-26T07:52:30.635982+0000","last_deep_scrub":"109'52","last_deep_scrub_stamp":"2024-04-26T07:52:30.635982+0000","last_clean_scrub_stamp":"2024-04-26T07:52:30.635982+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:46.032427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"54'4","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:26.222530+0000","last_change":"2024-04-26T07:52:26.222530+0000","last_active":"2024-04-26T07:52:26.222530+0000","last_peered":"2024-04-26T07:52:26.222530+0000","last_clean":"2024-04-26T07:52:26.222530+0000","last_became_active":"2024-04-26T07:51:40.427193+0000","last_became_peered":"2024-04-26T07:51:40.427193+0000","last_unstale":"2024-04-26T07:52:26.222530+0000","last_undegraded":"2024-04-26T07:52:26.222530+0000","last_fullsized":"2024-04-26T07:52:26.222530+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4","last_scrub_stamp":"2024-04-26T07:52:26.222165+0000","last_deep_scrub":"54'4","last_deep_scrub_stamp":"2024-04-26T07:52:26.222165+0000","last_clean_scrub_stamp":"2024-04-26T07:52:26.222165+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:41.618610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"109'42","reported_seq":244,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:18.905403+0000","last_change":"2024-04-26T07:52:18.905403+0000","last_active":"2024-04-26T07:52:18.905403+0000","last_peered":"2024-04-26T07:52:18.905403+0000","last_clean":"2024-04-26T07:52:18.905403+0000","last_became_active":"2024-04-26T07:48:21.522149+0000","last_became_peered":"2024-04-26T07:48:21.522149+0000","last_unstale":"2024-04-26T07:52:18.905403+0000","last_undegraded":"2024-04-26T07:52:18.905403+0000","last_fullsized":"2024-04-26T07:52:18.905403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:18.904991+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:18.904991+0000","last_clean_scrub_stamp":"2024-04-26T07:52:18.904991+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:53.048575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"80'4","reported_seq":214,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:16.552177+0000","last_change":"2024-04-26T07:52:16.552177+0000","last_active":"2024-04-26T07:52:16.552177+0000","last_peered":"2024-04-26T07:52:16.552177+0000","last_clean":"2024-04-26T07:52:16.552177+0000","last_became_active":"2024-04-26T07:48:23.540210+0000","last_became_peered":"2024-04-26T07:48:23.540210+0000","last_unstale":"2024-04-26T07:52:16.552177+0000","last_undegraded":"2024-04-26T07:52:16.552177+0000","last_fullsized":"2024-04-26T07:52:16.552177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T07:52:16.551883+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T07:52:16.551883+0000","last_clean_scrub_stamp":"2024-04-26T07:52:16.551883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:25.215770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"109'54","reported_seq":222,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:36.241060+0000","last_change":"2024-04-26T07:52:36.241060+0000","last_active":"2024-04-26T07:52:36.241060+0000","last_peered":"2024-04-26T07:52:36.241060+0000","last_clean":"2024-04-26T07:52:36.241060+0000","last_became_active":"2024-04-26T07:51:40.445977+0000","last_became_peered":"2024-04-26T07:51:40.445977+0000","last_unstale":"2024-04-26T07:52:36.241060+0000","last_undegraded":"2024-04-26T07:52:36.241060+0000","last_fullsized":"2024-04-26T07:52:36.241060+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'54","last_scrub_stamp":"2024-04-26T07:52:36.240769+0000","last_deep_scrub":"109'54","last_deep_scrub_stamp":"2024-04-26T07:52:36.240769+0000","last_clean_scrub_stamp":"2024-04-26T07:52:36.240769+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:51:33.000505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"80'2","reported_seq":207,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:12.801497+0000","last_change":"2024-04-26T07:52:12.801497+0000","last_active":"2024-04-26T07:52:12.801497+0000","last_peered":"2024-04-26T07:52:12.801497+0000","last_clean":"2024-04-26T07:52:12.801497+0000","last_became_active":"2024-04-26T07:48:23.541991+0000","last_became_peered":"2024-04-26T07:48:23.541991+0000","last_unstale":"2024-04-26T07:52:12.801497+0000","last_undegraded":"2024-04-26T07:52:12.801497+0000","last_fullsized":"2024-04-26T07:52:12.801497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T07:52:12.801171+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T07:52:12.801171+0000","last_clean_scrub_stamp":"2024-04-26T07:52:12.801171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:54.304065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"109'64","reported_seq":266,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:06.315131+0000","last_change":"2024-04-26T07:52:06.315193+0000","last_active":"2024-04-26T07:52:06.315131+0000","last_peered":"2024-04-26T07:52:06.315131+0000","last_clean":"2024-04-26T07:52:06.315131+0000","last_became_active":"2024-04-26T07:48:21.507979+0000","last_became_peered":"2024-04-26T07:48:21.507979+0000","last_unstale":"2024-04-26T07:52:06.315131+0000","last_undegraded":"2024-04-26T07:52:06.315131+0000","last_fullsized":"2024-04-26T07:52:06.315131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'64","last_scrub_stamp":"2024-04-26T07:52:06.314920+0000","last_deep_scrub":"109'64","last_deep_scrub_stamp":"2024-04-26T07:52:06.314920+0000","last_clean_scrub_stamp":"2024-04-26T07:52:06.314920+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:21.520117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"59'6","reported_seq":179,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:05.066559+0000","last_change":"2024-04-26T07:52:05.066559+0000","last_active":"2024-04-26T07:52:05.066559+0000","last_peered":"2024-04-26T07:52:05.066559+0000","last_clean":"2024-04-26T07:52:05.066559+0000","last_became_active":"2024-04-26T07:51:40.433471+0000","last_became_peered":"2024-04-26T07:51:40.433471+0000","last_unstale":"2024-04-26T07:52:05.066559+0000","last_undegraded":"2024-04-26T07:52:05.066559+0000","last_fullsized":"2024-04-26T07:52:05.066559+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2024-04-26T07:52:05.066305+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2024-04-26T07:52:05.066305+0000","last_clean_scrub_stamp":"2024-04-26T07:52:05.066305+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:35.388274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"109'42","reported_seq":243,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:22.044070+0000","last_change":"2024-04-26T07:52:22.044138+0000","last_active":"2024-04-26T07:52:22.044070+0000","last_peered":"2024-04-26T07:52:22.044070+0000","last_clean":"2024-04-26T07:52:22.044070+0000","last_became_active":"2024-04-26T07:48:21.517318+0000","last_became_peered":"2024-04-26T07:48:21.517318+0000","last_unstale":"2024-04-26T07:52:22.044070+0000","last_undegraded":"2024-04-26T07:52:22.044070+0000","last_fullsized":"2024-04-26T07:52:22.044070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:22.043835+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:22.043835+0000","last_clean_scrub_stamp":"2024-04-26T07:52:22.043835+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:49.290922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":52,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"109'42","reported_seq":242,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:29.008131+0000","last_change":"2024-04-26T07:52:29.008191+0000","last_active":"2024-04-26T07:52:29.008131+0000","last_peered":"2024-04-26T07:52:29.008131+0000","last_clean":"2024-04-26T07:52:29.008131+0000","last_became_active":"2024-04-26T07:48:21.512346+0000","last_became_peered":"2024-04-26T07:48:21.512346+0000","last_unstale":"2024-04-26T07:52:29.008131+0000","last_undegraded":"2024-04-26T07:52:29.008131+0000","last_fullsized":"2024-04-26T07:52:29.008131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'42","last_scrub_stamp":"2024-04-26T07:52:29.007933+0000","last_deep_scrub":"109'42","last_deep_scrub_stamp":"2024-04-26T07:52:29.007933+0000","last_clean_scrub_stamp":"2024-04-26T07:52:29.007933+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:53.983775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":196,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:10.684401+0000","last_change":"2024-04-26T07:52:10.684452+0000","last_active":"2024-04-26T07:52:10.684401+0000","last_peered":"2024-04-26T07:52:10.684401+0000","last_clean":"2024-04-26T07:52:10.684401+0000","last_became_active":"2024-04-26T07:48:23.552555+0000","last_became_peered":"2024-04-26T07:48:23.552555+0000","last_unstale":"2024-04-26T07:52:10.684401+0000","last_undegraded":"2024-04-26T07:52:10.684401+0000","last_fullsized":"2024-04-26T07:52:10.684401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T07:52:10.684218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T07:52:10.684218+0000","last_clean_scrub_stamp":"2024-04-26T07:52:10.684218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:35.242533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"109'58","reported_seq":259,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:15.523509+0000","last_change":"2024-04-26T07:52:15.523580+0000","last_active":"2024-04-26T07:52:15.523509+0000","last_peered":"2024-04-26T07:52:15.523509+0000","last_clean":"2024-04-26T07:52:15.523509+0000","last_became_active":"2024-04-26T07:48:21.490501+0000","last_became_peered":"2024-04-26T07:48:21.490501+0000","last_unstale":"2024-04-26T07:52:15.523509+0000","last_undegraded":"2024-04-26T07:52:15.523509+0000","last_fullsized":"2024-04-26T07:52:15.523509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'58","last_scrub_stamp":"2024-04-26T07:52:15.523309+0000","last_deep_scrub":"109'58","last_deep_scrub_stamp":"2024-04-26T07:52:15.523309+0000","last_clean_scrub_stamp":"2024-04-26T07:52:15.523309+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:56.456917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"54'6","reported_seq":209,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-26T07:52:07.227504+0000","last_change":"2024-04-26T07:52:07.227564+0000","last_active":"2024-04-26T07:52:07.227504+0000","last_peered":"2024-04-26T07:52:07.227504+0000","last_clean":"2024-04-26T07:52:07.227504+0000","last_became_active":"2024-04-26T07:48:23.543372+0000","last_became_peered":"2024-04-26T07:48:23.543372+0000","last_unstale":"2024-04-26T07:52:07.227504+0000","last_undegraded":"2024-04-26T07:52:07.227504+0000","last_fullsized":"2024-04-26T07:52:07.227504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'6","last_scrub_stamp":"2024-04-26T07:52:07.227294+0000","last_deep_scrub":"54'6","last_deep_scrub_stamp":"2024-04-26T07:52:07.227294+0000","last_clean_scrub_stamp":"2024-04-26T07:52:07.227294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:16.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":343,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1107,"ondisk_log_size":1107,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1065,"num_read_kb":1546,"num_write":541,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6692,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1014,"ondisk_log_size":1014,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1446,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":1945600,"data_stored":1357749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36632,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335208,"statfs":{"total":96636764160,"available":96599252992,"internally_reserved":0,"allocated":1327104,"data_stored":766721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":1372160,"data_stored":767549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335220,"statfs":{"total":96636764160,"available":96599265280,"internally_reserved":0,"allocated":1314816,"data_stored":766219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40824,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331016,"statfs":{"total":96636764160,"available":96594960384,"internally_reserved":0,"allocated":1359872,"data_stored":768949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36620,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335220,"statfs":{"total":96636764160,"available":96599265280,"internally_reserved":0,"allocated":1314816,"data_stored":766283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40816,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331024,"statfs":{"total":96636764160,"available":96594968576,"internally_reserved":0,"allocated":1351680,"data_stored":767799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41384,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330456,"statfs":{"total":96636764160,"available":96594386944,"internally_reserved":0,"allocated":1933312,"data_stored":1358159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T07:53:04.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T07:53:04.820 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T07:53:04.821 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T07:53:04.821 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T07:53:04.821 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:10.923 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T07:53:10.924 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T07:53:10.924 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:10.988 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T07:53:10.988 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T07:53:10.988 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:11.089 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T07:53:11.089 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T07:53:11.089 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:11.162 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T07:53:11.162 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T07:53:11.162 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:12.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-26T07:53:12.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-26T07:53:17.264 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T07:53:17.264 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T07:53:17.265 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:17.328 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T07:53:17.329 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T07:53:17.329 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:17.417 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T07:53:17.418 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T07:53:17.418 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:17.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-26T07:53:17.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-26T07:53:17.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-26T07:53:23.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-26T07:53:23.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-26T07:53:23.520 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T07:53:23.521 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T07:53:23.521 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T07:53:23.521 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:23.551 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T07:53:23.552 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T07:53:23.552 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:23.580 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T07:53:23.580 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T07:53:23.580 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T07:53:23.580 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:23.605 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T07:53:23.606 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T07:53:23.606 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:23.672 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T07:53:23.673 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T07:53:23.673 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T07:53:23.694 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T07:53:23.694 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T07:53:23.695 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-26T07:53:23.734 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:53:23.735 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T07:53:24.003 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:53:24.004 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T07:53:24.189 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:53:24.189 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T07:53:24.390 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:53:24.391 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T07:53:24.581 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:53:24.581 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T07:53:24.731 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:53:24.732 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T07:53:24.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:53:24.886 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T07:53:25.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:53:25.052 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T07:53:25.236 INFO:tasks.ceph:Archiving mon data... 2024-04-26T07:53:25.238 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/data/mon.a.tgz 2024-04-26T07:53:25.238 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-04-26T07:53:25.244 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.ZkXYJO3W7y 2024-04-26T07:53:25.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZkXYJO3W7y 2024-04-26T07:53:25.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.ZkXYJO3W7y 2024-04-26T07:53:25.489 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.ZkXYJO3W7y is 579KB 2024-04-26T07:53:25.555 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.ZkXYJO3W7y 2024-04-26T07:53:25.560 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/data/mon.c.tgz 2024-04-26T07:53:25.560 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-04-26T07:53:25.609 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.6gQzlVaZ4j 2024-04-26T07:53:25.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.6gQzlVaZ4j 2024-04-26T07:53:25.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.6gQzlVaZ4j 2024-04-26T07:53:25.892 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.6gQzlVaZ4j is 742KB 2024-04-26T07:53:25.959 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.6gQzlVaZ4j 2024-04-26T07:53:25.963 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/data/mon.b.tgz 2024-04-26T07:53:25.964 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-04-26T07:53:25.970 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.Vb15jZNg42 2024-04-26T07:53:25.970 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Vb15jZNg42 2024-04-26T07:53:26.190 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.Vb15jZNg42 2024-04-26T07:53:26.258 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.Vb15jZNg42 is 742KB 2024-04-26T07:53:26.370 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.Vb15jZNg42 2024-04-26T07:53:26.377 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T07:53:26.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T07:53:26.380 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T07:53:26.440 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T07:53:26.480 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T07:53:26.480 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T07:53:26.482 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/remote/smithi053/crash 2024-04-26T07:53:26.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T07:53:26.496 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/remote/smithi191/crash 2024-04-26T07:53:26.497 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T07:53:26.536 INFO:tasks.ceph:Compressing logs... 2024-04-26T07:53:26.536 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T07:53:26.543 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T07:53:26.563 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47382.log 2024-04-26T07:53:26.563 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63015.log 2024-04-26T07:53:26.564 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47382.log.gz 2024-04-26T07:53:26.564 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32037.log 2024-04-26T07:53:26.564 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63015.log.gz 2024-04-26T07:53:26.564 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-26T07:53:26.571 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32204.log 2024-04-26T07:53:26.571 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32037.log.gz 2024-04-26T07:53:26.571 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64991.log 2024-04-26T07:53:26.571 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32204.log.gz 2024-04-26T07:53:26.571 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32828.log 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52627.log 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64991.log: /var/log/ceph/ceph-client.admin.32828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32828.log.gz 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64991.log.gz 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60431.log 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52627.log: /var/log/ceph/ceph-mgr.y.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52627.log.gz 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65015.log 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66577.log 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60431.log.gz 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52817.log 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65015.log.gz 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32794.log 2024-04-26T07:53:26.572 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66577.log.gz 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52817.log.gz 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64367.log 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64050.log 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32794.log.gz 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64367.log.gz 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56281.log 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61148.log 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64050.log.gz 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30646.log 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56281.log.gz 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64590.log 2024-04-26T07:53:26.573 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61148.log.gz 2024-04-26T07:53:26.587 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30646.log.gz 2024-04-26T07:53:26.587 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T07:53:26.587 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30227.log 2024-04-26T07:53:26.587 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64590.log.gz 2024-04-26T07:53:26.587 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66080.log 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30227.log.gz 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59180.log 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64133.log 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66080.log.gz 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30659.log 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59180.log.gz 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64133.log.gz 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32359.log 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38964.log 2024-04-26T07:53:26.588 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30659.log.gz 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32585.log 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32359.log.gz 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49745.log 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38964.log.gz 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32585.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.64185.log 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32585.log.gz 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49745.log.gz 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32212.log 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32590.log 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64185.log.gz 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63337.log 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32212.log.gz 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61828.log 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32590.log.gz 2024-04-26T07:53:26.589 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64159.log 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63337.log.gz 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61828.log.gz 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55965.log 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31081.log 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64159.log.gz 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55965.log.gz 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52894.log 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48562.log 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31081.log.gz 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52894.log.gz 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49809.log 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55071.log 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48562.log.gz 2024-04-26T07:53:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49809.log.gz 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61207.log 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30650.log 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55071.log.gz 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61207.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.33805.log -- replaced with /var/log/ceph/ceph-client.admin.61207.log.gz 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66444.log 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30650.log.gz 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33805.log.gz 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33261.log 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64315.log 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66444.log.gz 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33261.log.gz 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64471.log 2024-04-26T07:53:26.591 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32039.log 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64315.log.gz 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64471.log.gz 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56151.log 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66601.log 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32039.log.gz 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24952.log 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56151.log.gz 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33988.log 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66601.log.gz 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.24952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24952.log.gz 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32919.log 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64784.log 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33988.log.gz 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32919.log.gz 2024-04-26T07:53:26.592 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T07:53:26.614 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T07:53:26.614 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T07:53:26.614 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T07:53:26.614 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25138.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25114.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.25138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25138.log.gz 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25186.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25042.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.25114.log: /var/log/ceph/ceph-client.admin.25186.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25186.log.gz 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25114.log.gz 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.25042.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25042.log.gz 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25090.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25162.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.25090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25210.log 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25090.log.gz/var/log/ceph/ceph-client.admin.25162.log: 2024-04-26T07:53:26.615 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25162.log.gz 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.25210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25210.log.gz 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25066.log 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mon.b.log: 86.4%gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.25066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25066.log.gz 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.4.log: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T07:53:26.616 INFO:teuthology.orchestra.run.smithi191.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T07:53:26.624 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65976.log 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64784.log.gz 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64024.log 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64811.log 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65976.log.gz 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60224.log 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64024.log.gz 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52783.log 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64811.log.gz 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33641.log 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60224.log.gz 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32418.log 2024-04-26T07:53:26.625 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52783.log.gz 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41956.log 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33641.log.gz 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45592.log 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32418.log.gz 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.41956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31964.log 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41956.log.gz 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60456.log 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45592.log.gz 2024-04-26T07:53:26.626 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30438.log 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31964.log.gz 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51809.log 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60456.log.gz 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30438.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30438.log.gz 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66158.log 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51809.log.gz 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30862.log 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65383.log 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66158.log.gz 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30862.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30862.log.gz -5 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60295.log 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.65383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55804.log 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65383.log.gz 2024-04-26T07:53:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60295.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.39594.log -- replaced with /var/log/ceph/ceph-client.admin.60295.log.gz 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55804.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.65018.log -- replaced with /var/log/ceph/ceph-client.admin.55804.log.gz 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.39594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53891.log 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39594.log.gz 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30455.log 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65018.log.gz 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53175.log 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53891.log.gz 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25103.log 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30455.log.gz 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51697.log 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53175.log.gz 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.25103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65002.log 2024-04-26T07:53:26.628 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25103.log.gz 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53236.log 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51697.log.gz 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65002.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.65002.log.gz 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64791.log 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53236.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.53236.log.gz -- 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr: /var/log/ceph/ceph-client.admin.64595.log 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30847.log 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64791.log.gz 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64237.log 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64595.log.gz 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30847.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33196.log 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30847.log.gz 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30363.log 2024-04-26T07:53:26.629 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64237.log.gz 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33196.log.gz 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41365.log 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59295.log 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30363.log.gz 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.41365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33105.log 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41365.log.gz 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57187.log 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59295.log.gz 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33105.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33105.log.gz -5 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33690.log 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60109.log 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57187.log.gz 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30252.log 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33690.log.gz 2024-04-26T07:53:26.630 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66340.log 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60109.log.gz 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33393.log 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30252.log.gz 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33880.log 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66340.log.gz 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30458.log 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33393.log.gz 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31994.log 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33880.log.gz 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65003.log 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30458.log.gz 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51671.log 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31994.log.gz 2024-04-26T07:53:26.631 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63394.log 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65003.log.gz 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64341.log 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51671.log.gz 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63394.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.63394.log.gz --verbose 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr: -- /var/log/ceph/ceph-client.admin.63262.log 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30874.log 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64341.log.gz 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46190.log 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63262.log.gz 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32968.log 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30874.log.gz 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56258.log 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46190.log.gz 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32968.log.gz 2024-04-26T07:53:26.632 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33289.log 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56258.log.gz 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65001.log 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33289.log.gz 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49152.log 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gz 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30306.log 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65001.log.gz 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64445.log 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49152.log.gz 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30306.log.gzgzip 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63312.log 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65277.log 0.0% 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64445.log.gz 2024-04-26T07:53:26.633 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64596.log 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63312.log.gz 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65277.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.65277.log.gz 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64596.log.gz 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56890.log 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66496.log 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56890.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40774.log 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53262.log 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66496.log.gz 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.40774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66132.log 2024-04-26T07:53:26.634 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40774.log.gz 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53262.log.gz 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53009.log 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64523.log 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66132.log.gz 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53009.log.gz 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52924.log 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66262.log 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64523.log: /var/log/ceph/ceph-client.admin.52924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46784.log 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64523.log.gz 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66262.log.gz 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30639.log 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59222.log 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46784.log: gzip/var/log/ceph/ceph-client.admin.30639.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36600.log 2024-04-26T07:53:26.635 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30639.log.gz 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46784.log.gz 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59222.log.gz 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49749.log 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65251.log 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36600.log: /var/log/ceph/ceph-client.admin.49749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35391.log 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36600.log.gz 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49749.log.gz 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65251.log.gz 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32208.log 2024-04-26T07:53:26.636 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55683.log 2024-04-26T07:53:26.648 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35391.log: /var/log/ceph/ceph-client.admin.32208.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35391.log.gz 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32208.log.gz 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55683.log.gz 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60406.log 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65017.log 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.60406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52631.log 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60406.log.gz 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65017.log.gz 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40184.log 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37782.log 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52631.log.gz 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.40184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40184.log.gz 2024-04-26T07:53:26.649 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20174.log 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55874.log 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37782.log.gz 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.20174.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20174.log.gz 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66002.log 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32166.log 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55874.log.gz 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66002.log.gz 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32708.log 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.32166.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32852.log 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32166.log.gz 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32708.log.gz 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31181.log 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64549.log 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32852.log.gz 2024-04-26T07:53:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31181.log.gz 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52585.log 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33603.log 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64549.log.gz 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52585.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30654.log 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52585.log.gz 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33603.log.gz 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31157.log 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55778.log 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30654.log: 0.0%/var/log/ceph/ceph-client.admin.31157.log: -- replaced with /var/log/ceph/ceph-client.admin.30654.log.gz 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31157.log.gz 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31886.log 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31131.log 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55778.log.gz 2024-04-26T07:53:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31886.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64600.log 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31131.log.gz 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65329.log 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51618.log 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64600.log: /var/log/ceph/ceph-client.admin.65329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64600.log.gz 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65329.log.gz 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30280.log 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65303.log 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51618.log: /var/log/ceph/ceph-client.admin.30280.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51618.log.gz 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30280.log.gz 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52544.log 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64211.log 2024-04-26T07:53:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65303.log.gz 2024-04-26T07:53:26.659 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52544.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33055.log 2024-04-26T07:53:26.659 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.659 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64211.log.gz 2024-04-26T07:53:26.659 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47972.log 2024-04-26T07:53:26.659 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30452.log 2024-04-26T07:53:26.659 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33055.log: /var/log/ceph/ceph-client.admin.47972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33055.log.gz 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47972.log.gz 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66054.log 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66288.log 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30452.log: /var/log/ceph/ceph-client.admin.66054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30452.log.gz 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66054.log.gz 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52742.log 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31912.log 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66288.log.gz 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52742.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30396.log 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31912.log.gz 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32515.log 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36577.log 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30396.log: /var/log/ceph/ceph-client.admin.32515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30396.log.gz 2024-04-26T07:53:26.660 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32515.log.gz 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35985.log 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51880.log 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.36577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36577.log.gz 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.35985.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.66314.log -- replaced with /var/log/ceph/ceph-client.admin.35985.log.gz 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51880.log.gz 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64289.log 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66314.log: /var/log/ceph/ceph-client.admin.64289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66314.log.gz 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64289.log.gz 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66236.log 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58547.log 2024-04-26T07:53:26.661 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.66236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66236.log.gz 2024-04-26T07:53:26.662 INFO:teuthology.orchestra.run.smithi053.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T07:53:26.663 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33719.log 2024-04-26T07:53:26.663 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55911.log 2024-04-26T07:53:26.663 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58547.log.gz 2024-04-26T07:53:26.665 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66551.log 2024-04-26T07:53:26.665 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33719.log.gz 2024-04-26T07:53:26.665 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55911.log.gz 2024-04-26T07:53:26.665 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66106.log 2024-04-26T07:53:26.666 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63130.log 2024-04-26T07:53:26.666 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66551.log: /var/log/ceph/ceph-client.admin.66106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66551.log.gz 2024-04-26T07:53:26.666 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66106.log.gz 2024-04-26T07:53:26.666 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60341.log 2024-04-26T07:53:26.668 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64808.log 2024-04-26T07:53:26.668 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63130.log: /var/log/ceph/ceph-client.admin.60341.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63130.log.gz 2024-04-26T07:53:26.668 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60341.log.gz 2024-04-26T07:53:26.668 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66028.log 2024-04-26T07:53:26.668 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56220.log 2024-04-26T07:53:26.668 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64808.log: /var/log/ceph/ceph-client.admin.66028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64808.log.gz 2024-04-26T07:53:26.668 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66028.log.gz 2024-04-26T07:53:26.668 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64810.log 2024-04-26T07:53:26.669 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66366.log 2024-04-26T07:53:26.670 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56220.log.gz 2024-04-26T07:53:26.670 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60155.log 2024-04-26T07:53:26.670 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64810.log.gz 2024-04-26T07:53:26.670 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66366.log.gz 2024-04-26T07:53:26.670 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44962.log 2024-04-26T07:53:26.672 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31055.log 2024-04-26T07:53:26.672 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60155.log: /var/log/ceph/ceph-client.admin.44962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60155.log.gz 2024-04-26T07:53:26.672 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44962.log.gz 2024-04-26T07:53:26.672 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T07:53:26.672 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57957.log 2024-04-26T07:53:26.672 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31055.log.gz 2024-04-26T07:53:26.672 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64107.log 2024-04-26T07:53:26.673 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57957.log.gz 2024-04-26T07:53:26.673 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25210.log 2024-04-26T07:53:26.674 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64107.log.gz 2024-04-26T07:53:26.674 INFO:teuthology.orchestra.run.smithi053.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T07:53:26.674 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57104.log 2024-04-26T07:53:26.675 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32422.log 2024-04-26T07:53:26.675 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.25210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25210.log.gz 2024-04-26T07:53:26.675 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57104.log.gz 2024-04-26T07:53:26.677 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30865.log 2024-04-26T07:53:26.677 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30666.log 2024-04-26T07:53:26.677 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32422.log.gz 2024-04-26T07:53:26.678 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30448.log 2024-04-26T07:53:26.678 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30865.log.gz 2024-04-26T07:53:26.678 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30666.log.gz 2024-04-26T07:53:26.678 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56993.log 2024-04-26T07:53:26.678 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60535.log 2024-04-26T07:53:26.678 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30448.log.gz 2024-04-26T07:53:26.678 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56993.log.gz 2024-04-26T07:53:26.680 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30667.log 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32490.log 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60535.log.gz 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34069.log 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30667.log.gz 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32490.log.gz 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55725.log 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34069.log.gz 2024-04-26T07:53:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2024-04-26T07:53:26.683 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33170.log 2024-04-26T07:53:26.683 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55725.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-26T07:53:26.684 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55725.log.gz 2024-04-26T07:53:26.684 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30456.log 2024-04-26T07:53:26.684 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33170.log.gz 2024-04-26T07:53:26.684 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63156.log 2024-04-26T07:53:26.684 INFO:teuthology.orchestra.run.smithi053.stderr: 92.1% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz/var/log/ceph/ceph-client.admin.30456.log: 2024-04-26T07:53:26.684 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30456.log.gz 2024-04-26T07:53:26.684 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34797.log 2024-04-26T07:53:26.688 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66522.log 2024-04-26T07:53:26.688 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63156.log.gz 2024-04-26T07:53:26.688 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33534.log 2024-04-26T07:53:26.688 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34797.log.gz 2024-04-26T07:53:26.688 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66522.log.gz 2024-04-26T07:53:26.688 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43677.log 2024-04-26T07:53:26.689 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T07:53:26.689 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33534.log.gz 2024-04-26T07:53:26.689 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43677.log.gz 2024-04-26T07:53:26.689 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64602.log 2024-04-26T07:53:26.689 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57072.log 2024-04-26T07:53:26.689 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64602.log.gz 2024-04-26T07:53:26.689 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30864.log 2024-04-26T07:53:26.689 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57072.log.gz 2024-04-26T07:53:26.691 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64796.log 2024-04-26T07:53:26.691 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30864.log.gz 2024-04-26T07:53:26.691 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56117.log 2024-04-26T07:53:26.691 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64796.log.gz 2024-04-26T07:53:26.692 INFO:teuthology.orchestra.run.smithi053.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T07:53:26.692 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-04-26T07:53:26.692 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53121.log 2024-04-26T07:53:26.692 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56117.log: /var/log/ceph/ceph-client.admin.37190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56117.log.gz 2024-04-26T07:53:26.692 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-04-26T07:53:26.692 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56003.log 2024-04-26T07:53:26.694 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54481.log 2024-04-26T07:53:26.694 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56003.log: /var/log/ceph/ceph-client.admin.53121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53121.log.gz 2024-04-26T07:53:26.694 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56003.log.gz 2024-04-26T07:53:26.694 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57228.log 2024-04-26T07:53:26.694 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43144.log 2024-04-26T07:53:26.694 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54481.log.gz 2024-04-26T07:53:26.694 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57228.log.gz 2024-04-26T07:53:26.694 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57335.log 2024-04-26T07:53:26.695 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43144.log.gz 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34121.log 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32036.log 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57335.log: /var/log/ceph/ceph-client.admin.34121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57335.log.gz 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34121.log.gz 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56076.log 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59378.log 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32036.log.gz 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56076.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63081.log 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.697 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59378.log.gz 2024-04-26T07:53:26.699 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32759.log 2024-04-26T07:53:26.700 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30459.log 2024-04-26T07:53:26.700 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63081.log: /var/log/ceph/ceph-client.admin.32759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63081.log.gz 2024-04-26T07:53:26.700 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32759.log.gz 2024-04-26T07:53:26.700 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50399.log 2024-04-26T07:53:26.700 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65019.log 2024-04-26T07:53:26.700 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30459.log.gz 2024-04-26T07:53:26.700 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50399.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64587.log 2024-04-26T07:53:26.700 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.702 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65019.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33508.log 2024-04-26T07:53:26.702 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65019.log.gz 2024-04-26T07:53:26.702 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64587.log.gz 2024-04-26T07:53:26.702 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30875.log 2024-04-26T07:53:26.702 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33455.log 2024-04-26T07:53:26.703 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33508.log.gz 2024-04-26T07:53:26.703 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30875.log.gz 2024-04-26T07:53:26.703 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66470.log 2024-04-26T07:53:26.704 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64799.log 2024-04-26T07:53:26.704 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33455.log.gz 2024-04-26T07:53:26.704 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66470.log.gz 2024-04-26T07:53:26.704 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32646.log 2024-04-26T07:53:26.704 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64799.log.gz 2024-04-26T07:53:26.704 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50989.log 2024-04-26T07:53:26.706 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64603.log 2024-04-26T07:53:26.706 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32646.log.gz 2024-04-26T07:53:26.706 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50989.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33940.log 2024-04-26T07:53:26.706 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.706 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64603.log.gz 2024-04-26T07:53:26.707 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60250.log 2024-04-26T07:53:26.707 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52968.log 2024-04-26T07:53:26.707 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33940.log: /var/log/ceph/ceph-client.admin.60250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33940.log.gz 2024-04-26T07:53:26.707 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60250.log.gz 2024-04-26T07:53:26.707 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57367.log 2024-04-26T07:53:26.708 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56920.log 2024-04-26T07:53:26.709 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52968.log: /var/log/ceph/ceph-client.admin.57367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52968.log.gz 2024-04-26T07:53:26.709 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57367.log.gz 2024-04-26T07:53:26.709 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44964.log 2024-04-26T07:53:26.709 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60612.log 2024-04-26T07:53:26.710 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56920.log: /var/log/ceph/ceph-client.admin.44964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56920.log.gz 2024-04-26T07:53:26.711 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44964.log.gz 2024-04-26T07:53:26.711 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51854.log 2024-04-26T07:53:26.711 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32297.log 2024-04-26T07:53:26.711 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60612.log: /var/log/ceph/ceph-client.admin.51854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60612.log.gz 2024-04-26T07:53:26.711 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51854.log.gz 2024-04-26T07:53:26.711 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31107.log 2024-04-26T07:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51759.log 2024-04-26T07:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32297.log: /var/log/ceph/ceph-client.admin.31107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32297.log.gz 2024-04-26T07:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31107.log.gz 2024-04-26T07:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59477.log 2024-04-26T07:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65355.log 2024-04-26T07:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51759.log.gz 2024-04-26T07:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59477.log.gz 2024-04-26T07:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64076.log 2024-04-26T07:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65355.log.gz 2024-04-26T07:53:26.723 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32331.log 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64076.log.gz 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32331.log.gz 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38966.log 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64419.log 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66392.log 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38966.log.gz 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64419.log.gz 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64393.log 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66392.log.gz 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38372.log 2024-04-26T07:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30457.log 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64393.log.gz 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.38372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38372.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33819.log 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30457.log.gz 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62423.log 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59516.log 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.33819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33819.log.gz 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62423.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65225.log 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59516.log.gz 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34203.log 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60531.log 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65225.log.gz 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.34203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34203.log.gz 2024-04-26T07:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66210.log 2024-04-26T07:53:26.726 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60531.log.gz 2024-04-26T07:53:26.726 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64788.log 2024-04-26T07:53:26.726 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59320.log 2024-04-26T07:53:26.726 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66210.log.gz 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64788.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65199.log 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64788.log.gz 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59320.log.gz 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43759.log 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51943.log 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65199.log: /var/log/ceph/ceph-client.admin.43759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65199.log.gz 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43759.log.gz 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33010.log 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30866.log 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51943.log: /var/log/ceph/ceph-client.admin.33010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51943.log.gz 2024-04-26T07:53:26.732 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33010.log.gz 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64263.log 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30867.log 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30866.log: /var/log/ceph/ceph-client.admin.64263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30866.log.gz 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64263.log.gz 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31938.log 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63229.log 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30867.log.gz 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31938.log.gz 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31207.log 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63229.log.gz 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32557.log 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59407.log 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31207.log.gz 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32557.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30657.log 2024-04-26T07:53:26.733 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32557.log.gz 2024-04-26T07:53:26.734 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59407.log.gz 2024-04-26T07:53:26.734 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59139.log 2024-04-26T07:53:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53080.log 2024-04-26T07:53:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30657.log.gz 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59139.log.gzgzip 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66418.log 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53080.log.gz 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64497.log 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57263.log 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66418.log.gz 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64497.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57030.log 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57263.log.gz 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66184.log 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57030.log.gz 2024-04-26T07:53:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64601.log 2024-04-26T07:53:26.738 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53294.log 2024-04-26T07:53:26.739 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66184.log: /var/log/ceph/ceph-client.admin.64601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66184.log.gz 2024-04-26T07:53:26.739 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64601.log.gz 2024-04-26T07:53:26.739 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53294.log.gz 2024-04-26T07:53:26.843 INFO:teuthology.orchestra.run.smithi191.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T07:53:26.872 INFO:teuthology.orchestra.run.smithi053.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T07:53:27.066 INFO:teuthology.orchestra.run.smithi053.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T07:53:27.249 INFO:teuthology.orchestra.run.smithi191.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T07:53:27.253 INFO:teuthology.orchestra.run.smithi053.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T07:53:27.337 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T07:53:27.396 INFO:teuthology.orchestra.run.smithi053.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T07:53:27.452 INFO:teuthology.orchestra.run.smithi191.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T07:53:27.467 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T07:53:27.468 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-26T07:53:27.468 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m0.885s 2024-04-26T07:53:27.469 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m3.234s 2024-04-26T07:53:27.469 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.140s 2024-04-26T07:53:27.499 INFO:teuthology.orchestra.run.smithi053.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T07:53:27.575 INFO:teuthology.orchestra.run.smithi053.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T07:53:27.577 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-26T07:53:27.577 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m1.033s 2024-04-26T07:53:27.577 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m4.202s 2024-04-26T07:53:27.577 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.227s 2024-04-26T07:53:27.578 INFO:tasks.ceph:Archiving logs... 2024-04-26T07:53:27.578 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/remote/smithi053/log 2024-04-26T07:53:27.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T07:53:28.357 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/remote/smithi191/log 2024-04-26T07:53:28.358 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T07:53:28.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-26T07:53:28.790 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T07:53:28.800 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T07:53:28.801 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T07:53:28.803 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T07:53:28.881 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T07:53:28.892 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T07:53:28.892 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:53:28.895 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T07:53:28.906 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T07:53:28.907 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2024-04-26T07:53:28.907 INFO:teuthology.orchestra.run.smithi053.stdout:*hv01.front.sepi 67.205.162.81 3 u 28 64 377 0.081 -1.164 1.273 2024-04-26T07:53:28.907 INFO:teuthology.orchestra.run.smithi053.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 377 0.074 +0.852 1.538 2024-04-26T07:53:28.907 INFO:teuthology.orchestra.run.smithi053.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.070 -2.123 1.212 2024-04-26T07:53:28.907 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:53:28.909 INFO:teuthology.orchestra.run.smithi191.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T07:53:28.910 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================== 2024-04-26T07:53:28.911 INFO:teuthology.orchestra.run.smithi191.stdout: hv01.front.sepi 67.205.162.81 3 u 26 64 377 0.098 -0.107 1.916 2024-04-26T07:53:28.911 INFO:teuthology.orchestra.run.smithi191.stdout:*hv02.front.sepi 63.231.80.2 3 u 22 64 377 0.078 +0.482 1.410 2024-04-26T07:53:28.911 INFO:teuthology.orchestra.run.smithi191.stdout: hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.093 -1.623 1.371 2024-04-26T07:53:28.911 INFO:teuthology.orchestra.run.smithi191.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T07:53:28.912 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T07:53:28.921 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T07:53:28.922 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T07:53:28.931 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T07:53:28.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T07:53:28.949 INFO:teuthology.task.internal:Duration was 932.672137 seconds 2024-04-26T07:53:28.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T07:53:28.959 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T07:53:28.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T07:53:28.962 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T07:53:28.999 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T07:53:28.999 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-04-26T07:53:28.999 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T07:53:29.050 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-04-26T07:53:29.051 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T07:53:29.061 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T07:53:29.062 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:53:29.094 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T07:53:29.129 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T07:53:29.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T07:53:29.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T07:53:29.233 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T07:53:29.243 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T07:53:29.243 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T07:53:29.256 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T07:53:29.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T07:53:29.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:53:29.301 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:53:29.310 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-04-26T07:53:29.321 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-04-26T07:53:29.402 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:53:29.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:53:29.408 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T07:53:29.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T07:53:29.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T07:53:29.459 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T07:53:29.460 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/remote/smithi053 2024-04-26T07:53:29.460 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T07:53:29.483 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gsalomon-2024-04-26_07:23:10-rgw-fix_error_message_flow-distro-default-smithi/7674619/remote/smithi191 2024-04-26T07:53:29.483 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T07:53:29.514 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T07:53:29.515 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T07:53:29.521 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T07:53:29.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T07:53:29.568 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T07:53:29.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T07:53:29.611 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T07:53:29.612 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T07:53:29.616 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T07:53:29.620 INFO:teuthology.orchestra.run.smithi053.stdout: 658751 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 07:53 /home/ubuntu/cephtest 2024-04-26T07:53:29.623 INFO:teuthology.orchestra.run.smithi191.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 07:53 /home/ubuntu/cephtest 2024-04-26T07:53:29.624 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T07:53:29.687 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T07:53:29.711 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 932.6721367835999 flavor: default owner: scheduled_gsalomon@teuthology success: true 2024-04-26T07:53:29.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T07:53:29.793 INFO:teuthology.run:pass